Meta-Rankings of Journals Publishing Multiple Criteria Decision Aiding Research: Benefit-of-Doubt Composite Indicators for Heterogeneous Qualitative Scales
[ 1 ] Instytut Informatyki, Wydział Informatyki i Telekomunikacji, Politechnika Poznańska | [ P ] employee
2022
chapter in monograph
english
EN This chapter examines the possibility of deriving journal rankings based on multiple ratings from expert panels using different qualitative scales. Such comprehensive rankings are constructed using Benefit-of-Doubt (BoD) composite indicators derived from Data Envelopment Analysis (DEA). Specifically, we consider a value-based efficiency model. An analogous BoD composite indicator can be built considering an additive aggregation model with incomplete information. To illustrate the proposed approach, 50 journals publishing Multiple Criteria Decision Aiding (MCDA) research are ranked based on ratings provided by panels from different geographies (Australia, Brazil, China, Finland, Poland, and the United Kingdom). We construct various rankings depending on whether each alternative minimizes its maximal regret or maximizes its absolute comprehensive value. Moreover, we contrast the elitist and anti-elitist perspectives that emphasize the best classifications or assume the difference between levels decreases as one moves toward better assessments. The results confirm high consistency in the orders of MCDA-related journals irrespective of the modeling options. In particular, the European Journal of Operational Research always appears at the top.
09.02.2022
245 - 268
20