Feature selection using localized generalization error for supervised classification problems using RBFNN

Document Type

Journal article

Source Publication

Pattern Recognition

Publication Date






First Page


Last Page



Feature selection, Generalization error, Neural network, RBFNN


A pattern classification problem usually involves using high-dimensional features that make the classifier very complex and difficult to train. With no feature reduction, both training accuracy and generalization capability will suffer. This paper proposes a novel hybrid filter-wrapper-type feature subset selection methodology using a localized generalization error model. The localized generalization error model for a radial basis function neural network bounds from above the generalization error for unseen samples located within a neighborhood of the training samples. Iteratively, the feature making the smallest contribution to the generalization error bound is removed. Moreover, the novel feature selection method is independent of the sample size and is computationally fast. The experimental results show that the proposed method consistently removes large percentages of features with statistically insignificant loss of testing accuracy for unseen samples. In the experiments for two of the datasets, the classifiers built using feature subsets with 90% of features removed by our proposed approach yield average testing accuracies higher than those trained using the full set of features. Finally, we corroborate the efficacy of the model by using it to predict corporate bankruptcies in the US.



Print ISSN


Funding Information

This work is supported by the Hong Kong Polytechnic University Research Grant G-YD87. {G-YD87}

Publisher Statement

Copyright © 2008 Elsevier Ltd. All rights reserved. Access to external full text or publisher's version may require subscription.

Full-text Version

Publisher’s Version

Recommended Citation

Ng, W. W. Y., Yeung, D. S., Firth, M., Tsang, E. C. C., & Wang, X.-Z. (2008). Feature selection using localized generalization error for supervised classification problems using RBFNN. Pattern Recognition, 41(12), 3706-3719. doi: 10.1016/j.patcog.2008.05.004