Learning nonlinear multiregression networks based on evolutionary computation
Document Type
Journal article
Source Publication
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Publication Date
1-1-2002
Volume
32
Issue
5
First Page
630
Last Page
644
Keywords
Choquet integrals, Data mining, Evolutionary computation, Nonlinear multiregression networks
Abstract
This paper describes a novel knowledge discovery and data mining framework dealing with nonlinear interactions among domain attributes. Our network-based model provides an effective and efficient reasoning procedure to perform prediction and decision making. Unlike many existing paradigms based on linear models, the attribute relationship in our framework is represented by nonlinear nonnegative multiregressions based on the Choquet integral. This kind of multiregression is able to model a rich set of nonlinear interactions directly. Our framework involves two layers. The outer layer is a network structure consisting of network elements as its components, while the inner layer is concerned with a particular network element modeled by Choquet integrals. We develop a fast double optimization algorithm (FDOA) for learning the multiregression coefficients of a single network element. Using this local learning component and multiregression-residual-cost evolutionary programming (MRCEP), we propose a global learning algorithm, called MRCEP-FDOA, for discovering the network structures and their elements from databases. We have conducted a series of experiments to assess the effectiveness of our algorithm and investigate the performance under different parameter combinations, as well as sizes of the training data sets. The empirical results demonstrate that our framework can successfully discover the target network structure and the regression coefficients.
DOI
10.1109/TSMCB.2002.1033182
Print ISSN
10834419
E-ISSN
21682275
Publisher Statement
Copyright © 2002 Institute of Electrical and Electronics Engineers
Access to external full text or publisher's version may require subscription.
Full-text Version
Publisher’s Version
Language
English
Recommended Citation
Leung, K.-S., Wong, M.-L., Lam, W., Wang, Z., & Xu, K. (2002). Learning nonlinear multiregression networks based on evolutionary computation. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 32(5), 630-644. doi: 10.1109/TSMCB.2002.1033182