The use of machine learning "black boxes" explanation systems to improve the quality of school education

被引:6
作者
Muhamedyev, R. [1 ,2 ,3 ]
Yakunin, K. [1 ,2 ]
Kuchin, YA. [1 ,2 ]
Symagulov, A. [1 ,2 ]
Buldybayev, T. [4 ]
Murzakhmetov, S. [1 ,2 ]
Abdurazakov, A. [1 ]
机构
[1] Kazakh Natl Res Tech Univ, Satbayev Univ, Alma Ata, Kazakhstan
[2] Inst Informat & Computat Technol MES RK, Alma Ata, Kazakhstan
[3] ISMA Univ, Riga, Latvia
[4] Minist Educ & Sci Republ Kazakhstan, Informat & Analyt Ctr, Astana, Kazakhstan
来源
COGENT ENGINEERING | 2020年 / 7卷 / 01期
关键词
education quality; machine learning; multi-criteria decision support systems; interpretable machine learning; black boxes" explanation; SHAP (SHapley Additive exPlanations); RENEWABLE ENERGY; DECISION-MAKING; HYBRID MCDM; ANP;
D O I
10.1080/23311916.2020.1769349
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The paper describes development of a multi-criteria decision support system (MCDSS) to improve the quality of school education. It is proposed to apply interpretable machine learning models for making decisions on improving the quality of education in secondary schools. Existing DSS are based on the expert judgement, which can be subjective. In addition, the large amount of data and features makes manual analysis difficult. Our approach is referred to as MCDSS with "black boxes" explainer, it consists of three stages. First, we develop the target indicators that measure the quality of education. A set of four features of quality of education (Q-Edu) has been developed. Secondly, we build regression models that link the data of the national educational database (NEDB) with target indicators. Thirdly, we use machine learning model interpreters to develop recommendations. The disadvantage associated with the difficulties of interpreting the results of models is overcome by SHAP (SHapley Additive exPlanations), which is used as a basis for developing recommendations for what features of educational institution could be altered in order to improve quality indicators. Using the described process, we, in particular, revealed the positive impact of the location of the school, ratio of experienced teachers, sports, technical and art studios on Q-Edu indicators. The ratio of experienced teachers and, at the same time, young teachers younger than 25 year positively affects the number of significant student achievements. The proposed universal approach reduces the subjectivity and laboriousness of parameter significance determination in MCDSS.
引用
收藏
页数:19
相关论文
共 38 条
[1]   Developing a novel risk-based methodology for multi-criteria decision making in marine renewable energy applications [J].
Abaei, Mohammad Mandi ;
Arzaghi, Ehsan ;
Abbassi, Rouzbeh ;
Garaniya, Vikram ;
Penesis, Irene .
RENEWABLE ENERGY, 2017, 102 :341-348
[2]   A Hybrid MCDM for Private Primary School Assessment Using DEMATEL Based on ANP and Fuzzy Cognitive Map [J].
Baykasoglu, Adil ;
Durmusoglu, Zeynep D. U. .
INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2014, 7 (04) :615-635
[3]   Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance? [J].
Beggrow, Elizabeth P. ;
Ha, Minsu ;
Nehm, Ross H. ;
Pearl, Dennis ;
Boone, William J. .
JOURNAL OF SCIENCE EDUCATION AND TECHNOLOGY, 2014, 23 (01) :160-182
[4]  
Biran O., 2017, IJCAI 17 WORKSH EXPL, V8, P8
[5]   A PREFERENCE RANKING ORGANIZATION METHOD - (THE PROMETHEE METHOD FOR MULTIPLE CRITERIA DECISION-MAKING) [J].
BRANS, JP ;
VINCKE, PH .
MANAGEMENT SCIENCE, 1985, 31 (06) :647-656
[6]   PV site suitability analysis using GIS-based spatial fuzzy multi-criteria evaluation [J].
Charabi, Yassine ;
Gastli, Adel .
RENEWABLE ENERGY, 2011, 36 (09) :2554-2561
[7]  
Figueira J, 2005, INT SER OPER RES MAN, V78, P133, DOI 10.1007/0-387-23081-5_4
[8]   A New Method for Scoring Additive Multi- attributeValue Models Using Pairwise Rankings of Alternatives [J].
Hansen, Paul ;
Ombler, Franz .
JOURNAL OF MULTI-CRITERIA DECISION ANALYSIS, 2008, 15 (3-4) :87-107
[9]  
Hulstaert L., 2018, UNDERSTANDING MODEL
[10]   A hybrid MCDM approach to assess the sustainability of students' preferences for university selection [J].
Kabak, Mehmet ;
Dagdeviren, Metin .
TECHNOLOGICAL AND ECONOMIC DEVELOPMENT OF ECONOMY, 2014, 20 (03) :391-418