A Conceptual and Computational Model of Moral Decision Making in Human and Artificial Agents

被引:74
作者
Wallach, Wendell [1 ]
Franklin, Stan [2 ]
Allen, Colin [3 ]
机构
[1] Yale Univ, Inst Social & Policy Studies, Interdisciplinary Ctr Bioeth, New Haven, CT 06520 USA
[2] Univ Memphis, Inst Intelligent Syst, Memphis, TN 38152 USA
[3] Indiana Univ, Cognit Sci Program, Bloomington, IN 47405 USA
关键词
Moral decision making; Artificial general intelligence; Artificial intelligence; Global workspace theory; Machine morality; Machine ethics; MEMORY CONSOLIDATION; CONSCIOUSNESS; ARCHITECTURE; PERCEPTION; SELECTION; ROBOTS; MIND; IDA;
D O I
10.1111/j.1756-8765.2010.01095.x
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Recently, there has been a resurgence of interest in general, comprehensive models of human cognition. Such models aim to explain higher-order cognitive faculties, such as deliberation and planning. Given a computational representation, the validity of these models can be tested in computer simulations such as software agents or embodied robots. The push to implement computational models of this kind has created the field of artificial general intelligence (AGI). Moral decision making is arguably one of the most challenging tasks for computational approaches to higher-order cognition. The need for increasingly autonomous artificial agents to factor moral considerations into their choices and actions has given rise to another new field of inquiry variously known as Machine Morality, Machine Ethics, Roboethics, or Friendly AI. In this study, we discuss how LIDA, an AGI model of human cognition, can be adapted to model both affective and rational features of moral decision making. Using the LIDA model, we will demonstrate how moral decisions can be made in many domains using the same mechanisms that enable general decision making. Comprehensive models of human cognition typically aim for compatibility with recent research in the cognitive and neural sciences. Global workspace theory, proposed by the neuropsychologist Bernard Baars (1988), is a highly regarded model of human cognition that is currently being computationally instantiated in several software implementations. LIDA (Franklin, Baars, Ramamurthy, & Ventura, 2005) is one such computational implementation. LIDA is both a set of computational tools and an underlying model of human cognition, which provides mechanisms that are capable of explaining how an agent's selection of its next action arises from bottom-up collection of sensory data and top-down processes for making sense of its current situation. We will describe how the LIDA model helps integrate emotions into the human decision-making process, and we will elucidate a process whereby an agent can work through an ethical problem to reach a solution that takes account of ethically relevant factors.
引用
收藏
页码:454 / 485
页数:32
相关论文
共 104 条
[1]   Prolegomena to any future artificial moral agent [J].
Allen, C ;
Varner, G ;
Zinser, J .
JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2000, 12 (03) :251-261
[2]  
Allen C., 2002, Cognitive, emotive and ethical aspects of decision making and human action, V1, P19
[3]  
Anderson M., 2005, Towards machine ethics, P1
[4]   An approach to computing ethics [J].
Anderson, Michael ;
Anderson, Susan Leigh ;
Armen, Chris .
IEEE INTELLIGENT SYSTEMS, 2006, 21 (04) :56-63
[5]   Machine ethics [J].
Anderson, Michael ;
Anderson, Susan Leigh .
IEEE INTELLIGENT SYSTEMS, 2006, 21 (04) :10-11
[6]  
[Anonymous], ETHICS INFORM TECHNO
[7]  
[Anonymous], 2003, Machine Consciousness
[8]  
[Anonymous], 1999, How Brains Make Up Their Minds
[9]  
[Anonymous], 2001, THESIS MIT
[10]  
[Anonymous], 1986, MULTIMIND