A fuzzy multi-criteria group decision making method for individual research output evaluation with maximum consensus

被引:15
作者
Li, Zongmin [1 ,2 ]
Liechty, Merrill [2 ]
Xu, Jiuping [1 ]
Lev, Benjamin [2 ]
机构
[1] Sichuan Univ, Uncertainty Decis Making Lab, Chengdu 610064, Peoples R China
[2] Drexel Univ, LeBow Coll Business, Dept Decis Sci, Philadelphia, PA 19104 USA
关键词
Multi-criteria group decision making; Individual research output; Bibliometric measures; Peer review; Group consensus; H-INDEX; BIBLIOMETRIC INDICATORS; AGGREGATION OPERATORS; UNIVERSITY; SETS; ECONOMICS; SELECTION; IMPACT; MODEL;
D O I
10.1016/j.knosys.2013.11.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Individual research output (IRO) evaluation is both practically and theoretically. important. Current research tends to only consider either bibliometric measures or peer review in IRO evaluation. This paper argues that bibliometric measures and peer review should be applied simultaneously to evaluate IRO. Moreover, in real life situations IRO evaluations are often made by groups and inevitably contain evaluators' subjective judgments. Accordingly, this paper develops a fuzzy multi-criteria group evaluation method which considers objective and subjective evaluations, i.e., bibliometric measures and peer review opinions simultaneously. The goals here are to conquer weighting difficulty and achieve maximum group consensus. This requires determining criteria weights, which we do with an intuitionistic fuzzy weighted averaging operator and then determining evaluator weights, which we do with a fuzzy distance-based method. Thereafter, we use a revised TOPSIS method to aggregate the objective and subjective ratings. A practical case study is used to test the feasibility of the methodology. Finally, we discuss the effectiveness of the proposed method. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:253 / 263
页数:11
相关论文
共 35 条
[1]   Peer reviews and bibliometric indicators: a comparative study at a Norwegian university [J].
Aksnes, DW ;
Taxt, RE .
RESEARCH EVALUATION, 2004, 13 (01) :33-41
[2]  
[Anonymous], 1981, MULTIPLE ATTRIBUTES
[3]   INTUITIONISTIC FUZZY-SETS [J].
ATANASSOV, KT .
FUZZY SETS AND SYSTEMS, 1986, 20 (01) :87-96
[4]   The citation speed index: A useful bibliometric indicator to add to the h index [J].
Bornmann, Lutz ;
Daniel, Hans-Dieter .
JOURNAL OF INFORMETRICS, 2010, 4 (03) :444-446
[5]  
Chunting Z., 2009, SCI TECHNOLOGY REV, P10
[6]   A fuzzy multi-criteria group decision making framework for evaluating health-care waste disposal alternatives [J].
Dursun, Mehtap ;
Karsak, E. Ertugrul ;
Karadayi, Melis Almula .
EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (09) :11453-11462
[7]   An h-index weighted by citation impact [J].
Egghe, Leo ;
Rousseau, Ronald .
INFORMATION PROCESSING & MANAGEMENT, 2008, 44 (02) :770-780
[8]   Theory and practise of the g-index [J].
Egghe, Leo .
SCIENTOMETRICS, 2006, 69 (01) :131-152
[9]   Measuring co-authors' contribution to an article's visibility [J].
Egghe, Leo ;
Guns, Raf ;
Rousseau, Ronald .
SCIENTOMETRICS, 2013, 95 (01) :55-67
[10]   The objectivity of national research foundation peer review in South Africa assessed against bibliometric indexes [J].
Fedderke, J. W. .
SCIENTOMETRICS, 2013, 97 (02) :177-206