An Adjustable Description Quality Measure for Pattern Discovery in Large Databases Using the AQ Methodology
Date
2000-03
Authors
Kaufman, Kenneth A.
Michalski, Ryszard S.
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
In concept learning and data mining tasks, the learner is typically faced with a choice of many possible hypotheses or patterns characterizing the input data. If one can assume that training data contain no noise, then the primary conditions a hypothesis must satisfy are consistency and completeness with regard to the data. In real-world applications, however, data are often noisy, and the insistence on the full completeness and consistency of the hypothesis is no longer valid. In such situations, the problem is to determine a hypothesis that represents the best trade-off between completeness and consistency. This paper presents an approach to this problem in which a learner seeks rules optimizing a rule quality criterion that combines the rule coverage (a measure of completeness) and training accuracy (a measure of inconsistency). These factors are combined into a single rule quality measure through a lexicographical evaluation functional (LEF). The method has been implemented in the AQ18 learning system for natural induction and pattern discovery, and compared with several other methods. Experiments have shown that the proposed method can be easily tailored to different problems and can simulate different rule learners.by modifying the parameter of the rule quality criterion.
Description
Keywords
Machine learning, Data mining, Natural induction, AQ learning, Decision rules
Citation
Kaufman, Kenneth A. and Ryszard S. Michalski. "An Adjustable Description Quality Measure for Pattern Discovery in Large Databases Using the AQ Methodology." Journal of Intelligent Information Systems 14:2 (March 2000), p. 199-216.