Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines

被引:373
作者
Riek, Laurel D. [1 ]
机构
[1] Univ Notre Dame, Dept Comp Sci & Engn, Notre Dame, IN 46556 USA
来源
JOURNAL OF HUMAN-ROBOT INTERACTION | 2012年 / 1卷 / 01期
关键词
Wizard of Oz; human-robot interaction; systematic review; reporting guidelines; methodology;
D O I
10.5898/JHRI.1.1.Riek
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Many researchers use Wizard of Oz (WoZ) as an experimental technique, but there are methodological concerns over its use, and no comprehensive criteria on how to best employ it. We systematically review 54 WoZ experiments published in the primary HRI publication venues from 2001 - 2011. Using criteria proposed by Fraser and Gilbert (1991), Green et al. (2004), Steinfeld et al. (2009), and Kelley (1984), we analyzed how researchers conducted HRI WoZ experiments. Researchers mainly used WoZ for verbal (72.2%) and non-verbal (48.1%) processing. Most constrained wizard production (90.7%), but few constrained wizard recognition (11%). Few reported measuring wizard error (3.7%), and few reported pre-experiment wizard training (5.4%). Few reported using WoZ in an iterative manner (24.1%). Based on these results we propose new reporting guidelines to aid future research.
引用
收藏
页码:119 / 136
页数:18
相关论文
共 77 条
[21]  
Green A., 2006, IEEE RSJ INT C INT R
[22]   Evaluating the Applicability of Current Models of Workload to Peer-based Human-robot Teams [J].
Harriott, Caroline E. ;
Zhang, Tao ;
Adams, Julie A. .
PROCEEDINGS OF THE 6TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTIONS (HRI 2011), 2011, :45-52
[23]  
Hato Yasuhiko, 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication, P663, DOI 10.1109/ROMAN.2009.5326283
[24]  
Hato Y, 2010, ACMIEEE INT CONF HUM, P301, DOI 10.1109/HRI.2010.5453180
[25]  
Heerink M., 2006, P 15 IEEE INT S ROB, P521, DOI [10.1109/ROMAN.2006.314442, DOI 10.1109/ROMAN.2006.314442]
[26]   Observing conversational expressiveness of elderly users interacting with a robot and screen agent [J].
Heerink, Marcel ;
Krose, Ben ;
Evers, Vanessa ;
Wielinga, Bob .
2007 IEEE 10TH INTERNATIONAL CONFERENCE ON REHABILITATION ROBOTICS, VOLS 1 AND 2, 2007, :751-+
[27]  
Huttenrauch H, 2006, P IEEE RSJ INT C INT
[28]  
IEEE, 2012, IEEEXPLORE
[29]   Do Elderly People Prefer a Conversational Humanoid as a Shopping Assistant Partner in Supermarkets? [J].
Iwamura, Yamato ;
Shiomi, Masahiro ;
Kanda, Takayuki ;
Ishiguro, Hiroshi ;
Hagita, Norihiro .
PROCEEDINGS OF THE 6TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTIONS (HRI 2011), 2011, :449-+
[30]   Interaction with a zoomorphic robot that exhibits canid mechanisms of behaviour [J].
Jones, Trevor ;
Lawson, Shaun ;
Mills, Daniel .
2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, :2128-+