Learning non-overlapping rules a method based on functional dependency network and mdl genetic programming

Document Type

Conference paper

Source Publication

Proceedings of the 2006 IEEE Congress on Evolutionary Computation, CEC 2006

Publication Date

1-1-2006

First Page

702

Last Page

709

Publisher

Institute of Electrical and Electronics Engineers

Abstract

Classification rule is a useful model in data mining. Given variable values, rules classify data items into different classes. Different rule learning algorithms are proposed, like Genetic Algorithm (GA) and Genetic Programming (GP). Rules can also be extracted from Bayesian Network (BN) and decision trees. However, all of them have disadvantages and may fail to get the best results. Both of GA and GP cannot handle cooperation among rules and thus, the learnt rules are likely to have many overlappings, i.e. more than one rules classify the same data items and different rules have different predictions. The conflicts among the rules reduce their understandability and increase their usage difficulty for expert systems. In contrast, rules extracted from BN and decision trees have no overlapping in nature. But BN can handle discrete values only and cannot represent higher-order relationships among variables. Moreover, the search space for decision tree learning is huge and thus, it is difficult to reach the global optimum. In this paper, we propose to use Functional Dependency Network (FDN) and MDL Genetic Programming (MDLGP) to learn a set of non-overlapping classification rules [17]. The FDN is an extension of BN; it can handle all kind of values; it can represent higher-order relationships among variables; and its learning search space is smaller than decision trees'. The experimental results demonstrate that the proposed method can successfully discover the target rules, which have no overlapping and have the highest classification accuracies.

DOI

10.1109/CEC.2006.1688380

Publisher Statement

Copyright © 2006 IEEE. Access to external full text or publisher's version may require subscription.

Additional Information

Paper presented at the 2006 IEEE Congress on Evolutionary Computation (CEC 2006), 16-21 July 2006, Vancouver, Canada.

ISBN of the source publication: 9780780394872

Full-text Version

Publisher’s Version

Language

English

Recommended Citation

Shum, W.-H., Leung, K.-S., & Wong, M.-L. (2006). Learning non-overlapping rules a method based on functional dependency network and mdl genetic programming. In Proceedings of the 2006 IEEE Congress on Evolutionary Computation, CEC 2006 (pp. 702-709). Piscataway: Institute of Electrical and Electronics Engineers. doi: 10.1109/CEC.2006.1688380

Share

COinS