Application of Preprocessing Methods to Imbalanced Clinical Data: An Experimental Study
[ 1 ] Instytut Informatyki, Wydział Informatyki, Politechnika Poznańska | [ 2 ] Instytut Technologii Mechanicznej, Wydział Budowy Maszyn i Zarządzania, Politechnika Poznańska | [ P ] employee
2016
paper
english
- clinical data
- class imbalance
- data difficulty factors
- preprocessing methods
- classification performance
EN In this paper we describe an experimental study where we analyzed data difficulty factors encountered in imbalanced clinical data sets and examined how selected data preprocessing methods were able to address these factors. We considered five data sets describing various pediatric acute conditions. In all these data sets the minority class was sparse and overlapped with the majority classes, thus difficult to learn. We studied five different preprocessing methods: random under- and oversampling, SMOTE, neighborhood cleaning rule and SPIDER2 that were combined with the following classifiers: k-nearest neighbors, decision trees and rules, naive Bayes, neural networks and support vector machines. Application of preprocessing always improved classification performance, and the largest improvement was observed for random undersampling. Moreover, naive Bayes was the best performing classifier regardless of a used preprocessing method.
503 - 515
WoS (15)