A new algorithm for fuzzy rough rule induction with granular computing
[ 1 ] Instytut Informatyki, Wydział Informatyki i Telekomunikacji, Politechnika Poznańska | [ P ] employee
2023
abstract
english
- Fuzzy rough set theory
- Granular computing
- Rule induction
- Interpretable machine learning
EN Interpretability is the next frontier in machine learning research. In the search for white box models - as opposed to black box models like random forests or neural networks - rule induction algorithms are a logical and promising option since the rules they create can easily be understood by humans. Fuzzy and rough set theories have been applied separately to this archetype, to great success. As both applications involve processing equivalence classes, it is only natural to combine them. The QuickRules algorithm was the first attempt at using fuzzy rough set theory for rule induction. It is based on QuickReduct, a greedy algorithm for building decision reducts. QuickRules already showed an improvement over other rule induction methods, but we can further improve on it by using fuzzy rough sets based on ordered weighted average (OWA) operators, which reduces the impact of outliers, and by removing redundant rules in a pruning step, without decreasing accuracy. However, to evaluate the full potential of a fuzzy rough rule induction algorithm, we need to start from the ground up. A fuzzy indiscernibility relation divides the data space into fuzzy granules, which we could combine from the bottom up or create in a top-down approach, both of which could result in a successful rule set. We also need to decide what kind of rule set we require: what is a minimal covering set in this context, and is that desirable? Moreover, we should figure out how to decide which attributes each rule needs to contain, and how to perform the inference process. Additionally, we should evaluate the effect of using OWA-based fuzzy rough sets on the performance and rule set size of the algorithm. Finally, a study evaluating the effect of the indiscernibility relation should also be performed.
139
CC BY (attribution alone)
publisher's website
final author's version
at the time of publication