Real-Time In-Situ Visual Feedback of Task Performance in Mixed Environments for Learning Joint Psychomotor-Cognitive Tasks

被引:25
作者
Kotranza, Aaron [1 ]
Lind, D. Scott [2 ]
Pugh, Carla M. [3 ]
Lok, Benjamin [1 ]
机构
[1] Univ Florida, Coll Engn, Gainesville, FL 32611 USA
[2] Med Coll Georgia, Dept Surg, Augusta, GA 30912 USA
[3] Northwestern Univ, Feinberg Sch Med, Chicago, IL USA
来源
2009 8TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY - SCIENCE AND TECHNOLOGY | 2009年
关键词
mixed reality; information visualization; CLINICAL BREAST EXAMINATION; REHABILITATION; SIMULATION;
D O I
10.1109/ISMAR.2009.5336485
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
This paper proposes an approach to mixed environment training of manual tasks requiring concurrent use of psychomotor and cognitive skills. To train concurrent use of both skill sets, the learner is provided real-time generated, in-situ presented visual feedback of her performance. This feedback provides reinforcement and correction of psychomotor skills concurrently with guidance in developing cognitive models of the task. The general approach is presented: 1) Sensors placed in the physical environment detect in real-time a learner's manipulation of physical objects. 2) Sensor data is input to models of task performance which output quantitative measures of the learner's performance. 3) Pre-defined rules are applied to transform the learner's performance data into visual feedback presented in real-time and in-situ with the physical objects being manipulated. With guidance from medical education experts, we have applied this approach to a mixed environment for learning clinical breast exams (CBEs). CBE belongs to a class of tasks that require learning multiple cognitive elements and task-specific psychomotor skills. Traditional approaches to learning CBEs and other joint psychomotor-cognitive tasks rely on extensive one-on-one training with an expert providing subjective feedback. By integrating real-time visual feedback of learners' quantitatively measured CBE performance, a mixed environment for learning CBEs provides on-demand learning opportunities with more objective, detailed feedback than available with expert observation. The proposed approach applied to learning CBEs was informally evaluated by four expert medical educators and six novice medical students. This evaluation highlights that receiving real-time in-situ visual feedback of their performance provides students an advantage, over traditional approaches to learning CBEs, in developing correct psychomotor and cognitive skills.
引用
收藏
页码:125 / +
页数:3
相关论文
共 30 条
[1]  
[Anonymous], 1956, HDB 1 COGNITIVE DOMA
[2]   Merging virtual objects with the real world: seeing ultrasound imagery within the patient [J].
Bajura, Michael ;
Fuchs, Henry ;
Ohbuchi, Ryutarou .
Computer Graphics (ACM), 1992, 26 (02) :203-210
[3]   Interactive tools for virtual X-ray vision in mobile augmented reality [J].
Bane, R ;
Höllerer, T .
ISMAR 2004: THIRD IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, 2004, :231-239
[4]   Does this patient have breast cancer? The screening clinical breast examination: Should it be done? How? [J].
Barton, MB ;
Harris, R ;
Fletcher, SW .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1999, 282 (13) :1270-1280
[5]   MOTOR-SKILLS LEARNING [J].
BILODEAU, EA ;
BILODEAU, IM .
ANNUAL REVIEW OF PSYCHOLOGY, 1961, 12 :243-280
[6]  
BOUD AC, P 1999 IEEE INT C IN, P32
[7]   A Perceptual Process Approach to Selecting Color Scales for Complex Visualizations [J].
Breslow, Leonard A. ;
Trafton, J. Gregory ;
Ratwani, Raj M. .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-APPLIED, 2009, 15 (01) :25-34
[8]   KNOWLEDGE-BASED AUGMENTED REALITY [J].
FEINER, S ;
MACINTYRE, B ;
SELIGMANN, D .
COMMUNICATIONS OF THE ACM, 1993, 36 (07) :53-62
[9]  
HARITOS T, 2005, P 24 DIG AV SYST C 2
[10]   Virtual environments for motor rehabilitation: Review [J].
Holden, MK .
CYBERPSYCHOLOGY & BEHAVIOR, 2005, 8 (03) :187-211