Quality Control in Crowdsourcing Systems Issues and Directions

被引:261
作者
Allahbakhsh, Mohammad [1 ]
Benatallah, Boualem [2 ]
Ignjatovic, Aleksandar [1 ]
Motahari-Nezhad, Hamid Reza [3 ]
Bertino, Elisa [4 ]
Dustdar, Schahram [5 ]
机构
[1] Univ New S Wales, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
[2] Univ New S Wales, Sydney, NSW 2052, Australia
[3] Hewlett Packard Labs, Palo Alto, CA USA
[4] Purdue Univ, W Lafayette, IN 47907 USA
[5] Vienna Univ Technol, Distributed Syst Grp, Inst Informat Syst, Vienna, Austria
关键词
crowdsourcing; crowdsourcing workflows; quality control;
D O I
10.1109/MIC.2013.20
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
As a new distributed computing model, crowdsourcing lets people leverage the crowd's intelligence and wisdom toward solving problems. This article proposes a framework for characterizing various dimensions of quality control in crowdsourcing systems, a critical issue. The authors briefly review existing quality-control approaches, identify open issues, and look to future research directions.
引用
收藏
页码:76 / 81
页数:6
相关论文
共 17 条
[1]  
[Anonymous], 2012, P ACM 2012 C COMP SU, DOI [10.1145/2145204.21453554, DOI 10.1145/2145204.21453554]
[2]  
[Anonymous], 2008, P 2008 INT C WEB SEA
[3]  
[Anonymous], 2010, P 23ND ANN ACM S USE, DOI DOI 10.1145/1866029.1866040
[4]  
[Anonymous], 2012, P ACM 2012 C COMP SU, DOI DOI 10.1145/2145204.2145354
[5]  
[Anonymous], 1979, Quality is Free: The Art of Making Quality Certain
[6]  
Chen JJ, 2011, P CHI 2011 WORKSH CR
[7]   Reputation Systems for Open Collaboration [J].
de Alfaro, Luca ;
Kulshreshtha, Ashutosh ;
Pye, Ian ;
Adler, B. Thomas .
COMMUNICATIONS OF THE ACM, 2011, 54 (08) :81-87
[8]   A survey of trust and reputation systems for online service provision [J].
Josang, Audun ;
Ismail, Roslan ;
Boyd, Colin .
DECISION SUPPORT SYSTEMS, 2007, 43 (02) :618-644
[9]  
Khazankin Roman, 2012, Advanced Information Systems Engineering. Proceedings 24th International Conference, CAiSE 2012, P460, DOI 10.1007/978-3-642-31095-9_30
[10]  
Kittur A, 2008, CHI 2008: 26TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS VOLS 1 AND 2, CONFERENCE PROCEEDINGS, P453