Generic performance measure for multiclass-classifiers
| Autor: | Cristian Pasluosta, Bjoern M. Eskofier, Thomas Kautz |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
0301 basic medicine
Computer science business.industry Model selection Feature vector 02 engineering and technology Machine learning computer.software_genre Synthetic data Multiclass classification 03 medical and health sciences ComputingMethodologies_PATTERNRECOGNITION 030104 developmental biology Artificial Intelligence Robustness (computer science) Signal Processing 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Computer Vision and Pattern Recognition Artificial intelligence Data mining business computer Software |
| Zdroj: | Pattern Recognition. 68:111-125 |
| ISSN: | 0031-3203 |
| Popis: | Generic, compact and meaningful performance measure for arbitrary classifiers.Includes confidence indicators in interval [0; 1].Robust towards class imbalance, sensitive towards class separation.Demo implementation available. The evaluation of classification performance is crucial for algorithm and model selection. However, a performance measure for multiclass classification problems (i.e., more than two classes) has not yet been fully adopted in the pattern recognition and machine learning community. In this work, we introduce the multiclass performance score (MPS), a generic performance measure for multiclass problems. The MPS was designed to evaluate any multiclass classification algorithm for any arbitrary testing condition. This measure handles the case of unknown misclassification costs and imbalanced data, and provides confidence indicators of the performance estimation. We evaluated the MPS using real and synthetic data, and compared it against other frequently used performance measures. The results suggest that the proposed MPS allows capturing the performance of a classification with minimum influence from the training and testing conditions. This is demonstrated by its robustness towards imbalanced data and its sensitivity towards class separation in feature space. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect