Experimental assessment of the performance of classification algorithms is an important aspect of their development and application on real-world problems. To facilitate this analysis, large numbers of such experiments can be stored in an organized manner and in complete detail in an experiment database. Such databases serve as a detailed log of previously performed experiments and a repository of verifiable learning experiments that can be reused by different researchers. We present an existing database containing 250,000 runs of classifier learning systems, and show how it can be queried and mined to answer a wide range of questions on learning behavior. We believe such databases may become a valuable resource for classification researchers and practitioners alike.
|Title of host publication||Data analysis, machine learning and applications|
|Subtitle of host publication||Proceedings of the 31st Annual Conference of the Gesellschaft für Klassifikation e.V., Albert-Ludwigs-Universität Freiburg, March 7–9, 2007|
|Editors||Christine Preisach, Hans Burkhardt, Lars Schmidt-Thieme|
|Place of Publication||Berlin|
|Number of pages||8|
|Publication status||Published - 2008|
|Name||Studies in Classification, Data Analysis, and Knowledge Organization (STUDIES CLASS)|