Programming Contact Tasks Using a Reality-based Virtual Environment Integrated with Vision
Abstract:
Abstract—We present an integrated system in which an operator uses a simulated environment to program part-mating and contact tasks. Generation of models within this virtual environment is facilitated using a fast, occlusion-tolerant, 3D grey-scale vision system which can recognize and accurately locate objects within the work site. A major goal of this work is to make robotic programming easy and intuitive for untrained users working with standard desktop hardware. Simulation can help accomplish this, offering the ease-of-use benefits of “programming by demonstration”, coupled with the ability to create a programmer-friendly virtual environment. Within a simulated environment, it is also straightforward to track and interpret an operator’s actions. The simulator models objects as polyhedra and implements full 3D contact dynamics, making is easy to place and manipulate objects using input from a simple 2D mouse. When a manipulation task is completed, local planning techniques are used to turn the virtual environment’s motion sequence history into a set of robot motion commands capable of realizing the prescribed task. I.
Citations
| 44 | The Phantom Robot: Predictive Displays for Teleoperation with Time Delay – Bejczy, Kim, et al. - 1990 |
| 36 | Teleprogramming: Toward delay-invariant remote manipulation – Funda, Lindsay, et al. - 1992 |
| 30 | An Operator Interface for Teleprogramming Employing Synthetic Fixtures – Sayers, Paul - 1994 |
| 23 | Sensor-based space robotics - rotex and its telerobotic features – Hirzinger, Brunner, et al. - 1993 |
| 13 | Learning compliant motions by task-demonstration in virtual environments – Koeppe, Hirzinger - 1995 |
| 11 | Operator Control of Telerobotic Systems for Real World Intervention – Sayers - 1995 |
| 3 | A CADbased contact force simulator as a learning tool for compliant motions – Bruyninckx, Schutter, et al. - 1992 |
| 2 | National Research Council, Virtual Reality: Scientific and Technological Challenges. National Academy – S - 1995 |
