A qualitative evaluation of evolution of a learning analytics tool

被引:121
作者
Ali, Liaqat [2 ]
Hatala, Marek [2 ]
Gasevic, Dragan [1 ,2 ]
Jovanovic, Jelena [2 ,3 ]
机构
[1] Athabasca Univ, Sch Comp & Informat Syst, Athabasca, AB T9S 3A3, Canada
[2] Simon Fraser Univ, Burnaby, BC V5A 1S6, Canada
[3] Univ Belgrade, Belgrade 11001, Serbia
关键词
Learning analytics; Visualization; Semantic web; Qualitative evaluation; Content analysis; SEMANTIC WEB; ONTOLOGIES; STYLE;
D O I
10.1016/j.compedu.2011.08.030
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
LOCO-Analyst is a learning analytics tool we developed to provide educators with feedback on students learning activities and performance. Evaluation of the first version of the tool led to the enhancement of the tool's data visualization, user interface, and supported feedback types. The second evaluation of the improved tool allowed us to see how the improvements affected the users' perceived value of the tool. Here, we present the qualitative results of our two evaluations and discuss important lessons learned stemming from the comparison of the two studies. The results show that educators find the kinds of feedback implemented in the tool informative and they value the mix of textual and graphical representations of different kinds of feedback provided by the tool. (C) 2011 Elsevier Ltd. All rights reserved.
引用
收藏
页码:470 / 489
页数:20
相关论文
共 50 条
[1]  
ANDERSON TD, 1998, DISTANCE LEARNING HI, P65
[2]  
[Anonymous], 1999, Readings in information visualization: using vision to think
[3]  
Asadi M., 2011, QUANTITATIVE EVALUAT
[4]  
Baker RSJD., 2009, J Educ data Min, V1, P3, DOI DOI 10.5281/ZENODO.3554657
[5]  
Ben-Naim D., 2009, Proceedings for the 2nd International Conference on Educational Data Mining, P21
[6]  
Burton M C., 2001, Journal of Computer-Mediated Communication, V6, DOI [DOI 10.1111/J.1083-6101.2001.TB00121.X, 10.1111/j.1083-6101.2001.tb00121.x]
[7]  
Cassidy S., 2000, EDUC PSYCHOL-UK, V20, P307, DOI [https://doi.org/10.1080/713663740, DOI 10.1080/713663740, 10.1080/713663740]
[8]   Empirical evaluation of user models and user-adapted systems [J].
Chin, DN .
USER MODELING AND USER-ADAPTED INTERACTION, 2001, 11 (1-2) :181-194
[9]   Investigating patterns of interaction in networked learning and computer-supported collaborative learning: A role for Social Network Analysis [J].
de Laat, Maarten ;
Lally, Vic ;
Lipponen, Lasse ;
Simons, Robert-Jan .
INTERNATIONAL JOURNAL OF COMPUTER-SUPPORTED COLLABORATIVE LEARNING, 2007, 2 (01) :87-103
[10]   The pragmatics of current e-learning standards [J].
Devedzic, Vladan ;
Jovanovic, Jelena ;
Gasevic, Dragan .
IEEE INTERNET COMPUTING, 2007, 11 (03) :19-27