Bridging the Gap Between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-centered AI Systems

被引:249
作者
Ben Shneiderman [1 ]
机构
[1] Univ Maryland, Dept Comp Sci, College Pk, MD 20742 USA
关键词
Human-centered AI; Human-Computer Interaction; Artificial Intelligence; reliable; safe; trustworthy; software engineering practices; management strategies; independent oversight; design; ARTIFICIAL-INTELLIGENCE; MATURITY MODEL; DATA ANALYTICS; TRANSPARENCY;
D O I
10.1145/3419764
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article attempts to bridge the gap between widely discussed ethical principles of Human-centered AI (HCAI) and practical steps for effective governance. Since HCAI systems are developed and implemented in multiple organizational structures, I propose 15 recommendations at three levels of governance: team, organization, and industry. The recommendations are intended to increase the reliability, safety, and trustworthiness of HCAI systems: (1) reliable systems based on sound software engineering practices, (2) safety culture through business management strategies, and (3) trustworthy certification by independent oversight. Software engineering practices within teams include audit trails to enable analysis of failures, software engineering workflows, verification and validation testing, bias testing to enhance fairness, and explainable user interfaces:the safety culture within organizations comes from management strategies that include leadership commitment to safety, hiring and training oriented to safety, extensive reporting of failures and near misses, internal review boards for problems and future plans, and alignment with industry standard practices. The trustworthiness certification comes from industry-wide efforts that include government interventions and regulation, accounting firms conducting external audits, insurance companies compensating for failures, non-governmental and civil society organizations advancing design principles, and professional organizations and research institutes developing standards, policies, and novel ideas. The larger goal of effective governance is to limit the dangers and increase the benefits of HCAI to individuals, organizations. and society.
引用
收藏
页数:31
相关论文
共 127 条
[21]   A health data analytics maturity model for hospitals information systems [J].
Carvalho, Joao Vidal ;
Rocha, Alvaro ;
Vasconcelos, Jose ;
Abreu, Antonio .
INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2019, 46 :278-285
[22]   Artificial intelligence, bias and clinical safety [J].
Challen, Robert ;
Denny, Joshua ;
Pitt, Martin ;
Gompels, Luke ;
Edwards, Tom ;
Tsaneva-Atanasova, Krasimira .
BMJ QUALITY & SAFETY, 2019, 28 (03) :231-237
[23]  
Chen HB, 2019, POLYMERS-BASEL, V11, DOI [10.3390/polym11122039, 10.23919/ursiap-rasc.2019.8738337]
[24]   User Evaluations on Sentiment-based Recommendation Explanations [J].
Chen, Li ;
Yan, Dongning ;
Wang, Feng .
ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2019, 9 (04)
[25]   CLINICAL RESEARCH Medicine contends with how to use artificial intelligence [J].
Couzin-Frankel, Jennifer .
SCIENCE, 2019, 364 (6446) :1119-1120
[26]  
Criado Perez Caroline., 2019, Invisible Women: Exposing Data Bias in a World Designed for Men
[27]  
Daugherty P. R., 2018, HUMAN MACHINE REIMAG
[28]   Robust artificial intelligence and robust human organizations [J].
Dietterich, Thomas G. .
FRONTIERS OF COMPUTER SCIENCE, 2019, 13 (01) :1-3
[29]  
Doshi-Velez Finale., 2017, arXiv: Machine Learning
[30]   EventAction: A Visual Analytics Approach to Explainable Recommendation for Event Sequences [J].
Du, Fan ;
Plaisant, Catherine ;
Spring, Neil ;
Crowley, Kenyon ;
Shneiderman, Ben .
ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2019, 9 (04)