Vision-based closed-loop control of mobile microrobots for micro handling tasks

被引:19
作者
Buerkle, A [1 ]
Schmoeckel, F [1 ]
Kiefer, M [1 ]
Amavasai, BP [1 ]
Caparrelli, F [1 ]
Selvan, AN [1 ]
Travis, JR [1 ]
机构
[1] Univ Karlsruhe, Inst Proc Control & Robot, D-76128 Karlsruhe, Germany
来源
MICROROBOTICS AND MICROASSEMBLY III | 2001年 / 4568卷
关键词
vision sensors; object recognition; tracking; depth estimation; micromanipulation; microrobots;
D O I
10.1117/12.444125
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As part or a European Union ESPRIT funded research project a flexible microrobot system has been developed which can operate under an optical microscope as well as in the chamber of a scanning electron microscope (SEM). The system is highly flexible and configurable and uses a wide range of sensors in a closed-loop control strategy. This paper presents an overview of the vision system and its architecture for vision-controlled micro-manipulation. The range of different applications, e,g. assembly of hybrid microsystems, handling of biological cells and manipulation tasks inside an SEM, imposes great demands on the vision system. Fast and reliable object recognition algorithms have been developed and implemented to provide for two modes of operation: automated and semi-automated robot control. The vision system has a modular design, comprising modules for object recognition, tracking and depth estimation. Communication between the vision modules and the control system takes place via a shared memory system embedding an object database. This database holds information about the appearance and the location of all known objects. A depth estimation method based on a modified sheet-of-light triangulation method is also described. It is fully integrated in the control loop and can be used both for measuring specific points or scanning a complete field of view. Furthermore, the novel approach of electron beam triangulation in the SEM is described.
引用
收藏
页码:187 / 198
页数:12
相关论文
共 14 条
[1]  
AHERNE F, 1997, KYBERNETIKA, V32, P1
[2]  
[Anonymous], IEEE J ROBOTICS AUTO
[3]   STRIP TREES - A HIERARCHICAL REPRESENTATION FOR CURVES [J].
BALLARD, DH .
COMMUNICATIONS OF THE ACM, 1981, 24 (05) :310-321
[4]  
BUERKLE A, 2000, IEEE RSJ INT C INT R
[5]  
BUERKLE A, 1999, P INT C COMP INT MOD
[6]  
CANNY JF, 1986, PAMI, V8, P6, DOI DOI 10.1109/TPAMI.1986.4767851
[7]  
EVANS AC, 1993, P 4 BRIT MACH VIS C
[8]  
FATIKOW S, 1999, SPIES INT S INT SYST
[9]  
FUSIELLO A, 1997, P 1997 C COMP VIS PA
[10]  
Krotkov EP, 1989, ACTIVE COMPUTER VISI