Quality assessment of answers with user-identified criteria and data-driven features in social Q&A

被引:68
作者
Fu, Hengyi [1 ]
Oh, Sanghee [2 ]
机构
[1] Florida State Univ, Sch Informat, Tallahassee, FL 32306 USA
[2] Chungnam Natl Univ, Dept Lib & Informat Sci, Daejeon, Italy
关键词
Social questioning and answering site; Answer quality evaluation; Information quality assessment; User criteria; Quality features; COMMUNITY; WIKIPEDIA; FRAMEWORK;
D O I
10.1016/j.ipm.2018.08.007
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The purpose of the current study is to identify the user criteria and data-driven features, both textual and non-textual, for assessing the quality of answers posted on social questioning and answering sites (social Q&A) across four different knowledge domains-Science, Technology, Art and Recreation. A comprehensive review of literature on quality assessment of information produced in social contexts was carried out to develop the theoretical framework for the current study. A total of 23 user criteria and 24 data features were proposed and tested with high-quality answers obtained from four social Q&A sites in Stack Exchange. Findings indicate that content-related criteria and user and review features were the most frequently used in quality assessments, while the importance of user criteria and data features was variable across the knowledge domains. In the Technology Q&A site containing mostly self-help questions, the utility class was the most frequently used group of criteria. The popularity of the socio-emotional class was more apparent in discussion-oriented topic categories such as Art and Recreation, where people seek others' opinions or advice. Users of Art and Recreation Q&A sites in Stack Exchange appear to place more value on answerers' efforts and time, good attitudes or manners, personal experience, and the same taste. The importance of user features and the emphasis on answerer's expertise on the Science Q&A site was observed. Examining the connection or gap between user quality criteria and data features across the knowledge domains could help to better understand users' evaluation behaviors for their preferred answers, and identify the potential of social Q&A for user education/intervention in answer quality evaluation. This examination also offers practical guidance for designing more effective social Q&A platforms, considering how to customize community support systems, motivate contributions, and control content quality.
引用
收藏
页码:14 / 28
页数:15
相关论文
共 62 条
[1]  
Anderka M, 2012, SIGIR 2012: PROCEEDINGS OF THE 35TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, P981, DOI 10.1145/2348283.2348413
[2]  
[Anonymous], 2008, Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08, DOI DOI 10.1145/1367497.1367673
[3]  
[Anonymous], 2008, P INT C WEB SEARCH W
[4]  
[Anonymous], 2007, P 16 INT C WORLD WID, DOI DOI 10.1145/1242572.1242608
[5]  
[Anonymous], 2007, Proceedings of the 2007 international symposium on Wikis - WikiSym'07, DOI [10.1145/1296951.1296968, DOI 10.1145/1296951.1296968]
[6]  
[Anonymous], 2003, Text & Talk, DOI [10.1515/text.2003.014, DOI 10.1515/TEXT.2003.014]
[7]  
[Anonymous], 2005, P INT C INF QUAL ICI
[8]  
Bian J., 2008, Proceedings of the 17th International Conference on World Wide Web, P467
[9]   Predictors of high-quality answers [J].
Blooma, Mohan John ;
Goh, Dion Hoe-Lian ;
Chua, Alton Yeow-Kuan .
ONLINE INFORMATION REVIEW, 2012, 36 (03) :383-400
[10]  
Burel Gregoire, 2012, The Semantic Web: Research and Applications. Proceedings 9th Extended Semantic Web Conference (ESWC 2012), P514, DOI 10.1007/978-3-642-30284-8_41