Depending on the amount of data to process, file generation may take longer.

If it takes too long to generate, you can limit the data by, for example, reducing the range of years.

Chapter

Download BibTeX

Title

Selective pre-processing of imbalanced data for improving classification performance

Authors

[ 1 ] Instytut Informatyki (II), Wydział Informatyki i Zarządzania, Politechnika Poznańska | [ P ] employee

Year of publication

2008

Chapter type

paper

Publication language

english

Abstract

EN In this paper we discuss problems of constructing classifiers from imbalanced data. We describe a new approach to selective pre-processing of imbalanced data which combines local over-sampling of the minority class with filtering difficult examples from the majority classes. In experiments focused on rule-based and tree-based classifiers we compare our approach with two other related pre-processing methods – NCR and SMOTE. The results show that NCR is too strongly biased toward the minority class and leads to deteriorated specificity and overall accuracy, while SMOTE and our approach do not demonstrate such behavior. Analysis of the degree to which the original class distribution has been modified also reveals that our approach does not introduce so extensive changes as SMOTE.

Pages (from - to)

283 - 292

DOI

10.1007/978-3-540-85836-2_27

URL

https://link.springer.com/chapter/10.1007/978-3-540-85836-2_27

Book

Data Warehousing and Knowledge Discovery : 10th International Conference, DaWaK 2008 Turin, Italy, September 2008 : proceedings

Presented on

10th International Conference on Data Warehousing and Knowledge Discovery, DaWaK 2008, 2-5.09.2008, Turin, Italy

This website uses cookies to remember the authenticated session of the user. For more information, read about Cookies and Privacy Policy.