Information loss of the mahalanobis distance in high dimensions: application to feature selection.
basic_science · Level V
Where this comes from
- Record sourced from PubMed, PMID 19834146.
- Also identified by DOI 10.1109/TPAMI.2009.84.
- No licence information is recorded for this record.
- Because redistribution is not established, this page shows the abstract only. Follow the links below for the full text.
Abstract
When an infinite training set is used, the Mahalanobis distance between a pattern measurement vector of dimensionality D and the center of the class it belongs to is distributed as a chi(2) with D degrees of freedom. However, the distribution of Mahalanobis distance becomes either Fisher or Beta depending on whether cross validation or resubstitution is used for parameter estimation in finite training sets. The total variation between chi(2) and Fisher, as well as between chi(2) and Beta, allows us to measure the information loss in high dimensions. The information loss is exploited then to set a lower limit for the correct classification rate achieved by the Bayes classifier that is used in subset feature selection.