An unsupervised approach to feature discretization and selection
Figueiredo, M. A. T.
Pattern Recognition Vol. 45, Nº 9, pp. 3048 - 3060, September, 2012.
ISSN (print): 0031-3203
ISSN (online): 0031-3203
Journal Impact Factor: 3,279 (in 2008)
Digital Object Identifier: 10.1016/j.patcog.2011.12.008
Download Full text PDF ( 964 KBs)
Many learning problems require handling high dimensional datasets with a relatively small number of instances. Learning algorithms are thus confronted with the curse of dimensionality, and need to address it in order to be effective. Examples of these types of data include the bag-of-words representation in text classification problems and gene expression data for tumor detection/classification. Usually, among the high number of features
characterizing the instances, many may be irrelevant (or even detrimental) for the learning tasks. It is thus clear that there is a need for adequate techniques for feature representation, reduction, and selection, to both improve the classification accuracy and the memory requirements. In this paper, we propose combined unsupervised feature discretization and feature selection techniques, suitable for medium and high-dimensional datasets. The experimental results on several standard datasets, with both sparse and dense features, show the efficiency of the proposed techniques as well as improvements over previous related techniques.