Translator Disclaimer
Open Access
VOL. 45 | 2004 Scalable mining for classification rules in relational databases

Abstract

Data mining is a process of discovering useful patterns (knowledge) hidden in extremely large datasets. Classification is a fundamental data mining function, and some other functions can be reduced to it. In this paper we propose a novel classification algorithm (classifier) called MIND (MINing in Databases). MIND can be phrased in such a way that its implementation is very easy using the extended relational calculus SQL, and this in turn allows the classifier to be built into a relational database system directly. MIND is truly scalable with respect to I/O efficiency, which is important since scalability is a key requirement for any data mining algorithm.

We have built a prototype of MIND in the relational database management system DB2 and have benchmarked its performance. We describe the working prototype and report the measured performance with respect to the previous method of choice. MIND scales not only with the size of datasets but also with the number of processors on an IBM SP2 computer system. Even on uniprocessors, MIND scales well beyond dataset sizes previously published for classifiers.We also give some insights that may have an impact on the evolution of the extended relational calculus SQL.

Information

Published: 1 January 2004
First available in Project Euclid: 28 November 2007

zbMATH: 1268.62061
MathSciNet: MR2126911

Digital Object Identifier: 10.1214/lnms/1196285404

Subjects:
Primary: 68P20

Keywords: ‎classification‎ , classifier , data mining , relation database , SQL

Rights: Copyright © 2004, Institute of Mathematical Statistics

CHAPTER
30 PAGES


SHARE
Vol. 45 • 1 January 2004
Back to Top