The DLR Multisensory 3D-Modeller (3DMo)

7 July 2008

A “Multisensory 3D modeller” was developed to evaluate different sensor principles and sensor fusion for the generation of photorealistic 3D models. The Modeller can be used hand-guided or automated on a robotic system. Thus, robots should be able to build a photorealistic model of their environment by moving around an end effector equipped with different sensors (a so-called Eye-in-Hand system)

 

 

The 3d-Modeller consists of a core module and application specific extensions. The core module, hereafter simply called modeller, comprehends two digital cameras, a miniaturized rotating laser scanner and two line laser modules. Furthermore it carries a small embedded computer to provide internal computing power, and a graphical colour display. The modeller can be connected to a handhold with various input buttons or to a robot via an industrial quick changing adaptor. On the sides markers are adaptable for optical pose measurement.

Due to the modular design the system allows hand-guided operation as well as automated robot applications. Three mechanically identical free of play couplers enable quick and easy exchangeability of all components (see Fig. 1). The Modeller can be manually operated or controlled remotely. The display along with the handhold enables menu-driven control.

In overall the sensor devices implemented with the 3d-Modeller are

  • Laser Range Scanner (LRS)
  • Stereo Camera Sensor (SCS)
  • Laser Stripe Profiler (LSP), optionally Dual Cross Hair LSP
3dmo-1-1024.JPG 3dmo-transp3-1024
3DMo-justin-kopf-1024

 

Selected Publications

K. H. Strobl and G. Hirzinger. More Accurate Pinhole Camera Calibration with Imperfect Planar Target. Proceedings of the IEEE International Conference on Computer Vision (ICCV 2011), 1st IEEE Workshop on Challenges and Opportunities in Robot Perception, Barcelona, Spain, pp. 1068-1075, November 2011.

K. H. Strobl, E. Mair, and G. Hirzinger. Image-Based Pose Estimation for 3-D Modeling in Rapid, Hand-Held Motion. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2011), Shanghai, China, pp. 2593-2600, May 2011.

E. Mair, K. H. Strobl, T. Bodenmüller, M. Suppa, and D. Burschka. Real-time Image-based Localization for Hand-held 3D-modeling. KI – Künstliche Intelligenz, vol. 24, no. 3, pp. 207-214, May 2010.

K. H. Strobl, E. Mair, T. Bodenmüller, S. Kielhöfer, W. Sepp, M. Suppa, D. Burschka, and G. Hirzinger. The Self-Referenced DLR 3D-Modeler. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2009), St. Louis, MO, USA, pp. 21-28, October 2009, best paper finalist.

K. H. Strobl, W. Sepp, and G. Hirzinger. On the Issue of Camera Calibration with Narrow Angular Field of View. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2009), St. Louis, MO, USA, pp. 309-315, October 2009.

E. Mair, K. H. Strobl, M. Suppa, and D. Burschka. Efficient Camera-Based Pose Estimation for Real-Time Applications. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2009), St. Louis, MO, USA, pp. 2696-2703, October 2009.

Strobl, Klaus und Hirzinger, Gerd (2008) More Accurate Camera and Hand-Eye Calibrations with Unknown Grid Pattern Dimensions. In: Proceedings of ICRA 2008, Seiten 1398-1405. IEEE International Conference on Robotics and Automation, 2008-05-19 - 2008-05-23, Pasadena, CA (USA).

Bodenmüller, Tim und Sepp, Wolfgang und Suppa, Michael und Hirzinger, Gerd (2007) Tackling Multi-sensory 3D Data Acquisition and Fusion. In: Proceedings of IROS, Seiten 2180-2185. IEEE. RSJ International Conference on Intelligent Robots and Systems, 2007-10-29 - 2007-11-02, San Diego, CA, USA.

Suppa, Michael und Kielhöfer, Simon und Langwald, Jörg und Hacker, Franz und Strobl, Klaus und Hirzinger, Gerd (2007) The 3D-Modeller: A Multi-Purpose Vision Platform. In: Proceedings. IEEE. International Conference on Robotics and Automation, ICRA, 2007-04-10 - 2007-04-14, Rome (Italy).

Strobl, Klaus H. und Hirzinger, Gerhard (2006) Optimal Hand-Eye Calibration. In: Proceedings. IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS, RSJ International Conference on Intelligent Robots and Systems, 2006-10-09 - 2006-10-15, Beijing, China.

Hirschmüller, Heiko (2005) Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information. In: IEEE Conference on Computer Vision and Pattern Recognition, 2, Seiten 807-814. IEEE. CVPR 2005, 2005-06-20 - 2005-06-25, San Diego. ISBN 0-76952372-2. ISSN 1063-6919

Hirzinger, G. und Bodenmüller, T. und Hirschmüller, H. und Liu, R. und Sepp, W. und Suppa, M. und Abmayr, T. und Strackenbrock, B. (2005) Photo-realistic 3D modelling - From robotics perception towards cultural heritage. International Workshop on Recording, Modeling and Visualization of Cultural Heritage, Asona, Switzerland, May 22-27, 2005.

Bodenmüller, T. und Hirzinger, G. (2004) Online Surface Reconstruction from Unorganized 3D-Points for the DLR Hand-Guided Scanner System. In: Proceedings, Seiten 285-292. 2nd Symposium on 3D Data Processing, Visualization and Transmission, Thessaloniki, Greece, Sept. 6-9, 2004.

Suppa, M. und Wang, P. und Gupta, K. und Hirzinger, G. (2004) C-space Exploration Using Noisy Sensor Models. In: Proceedings, Seiten 4777-4782. IEEE International Conference on Robotics and Automation ICRA, New Orleans, Louisiana, USA, April 26 - May 1, 2004.

Strobl, K.H. und Sepp, W. und Wahl, E. und Bodenmüller, T. und Suppa, M. und Seara, J.F. und Hirzinger, G. (2004) The DLR Multisensory Hand-Guided Device: The Laser Stripe Profiler. In: Proceedings, Seiten 1927-1932. IEEE International Conference on Robotics and Automation ICRA, New Orleans, Louisiana, USA, April 26 - May 1, 2004.

Suppa, M. und Hirzinger, G. (2004) A Novel System Approach to Multisensory Data Acquisition. In: Intelligent Autonomous Systems 8 (IAS-8), Seiten 996-1004. IOS Press, Amsterdam. Intelligent Autonomous Sytems 8 (IAS-8), Amsterdam, March 10-13, 2004. ISBN 1 58603 414 6.

Wahl, E. und Hillenbrand, U. und Hirzinger, G. (2003) Surflet-Pair-Relation Histograms: A Statistical 3D-Shape representation for Rapid Classification. 3D-Digital Imaging and Modeling (3DIM), Banff, Canada, October 2003.

Sepp W., und Hirzinger G., (2003) Real-Time Texture-Based 3-D Tracking. In: Proceedings of the 25th DAGM Symposium on Pattern Recognition (DAGM 2003), Seiten 330-337. Springer Verlag. DAGM'03-25th Pattern Recognition Symposium, Magdeburg (Germany), September 10-12 2003.

Hacker, F. und Dietrich, J. und Hirzinger, G. (1997) A laser-triangulation based miniaturized 2-d range-scanner as integral part of a multisensory robot-gripper. In: Proceedings EOS 14th Topical Meeting on Optoelectronic Distance/ Displacement Measurements and Applications, Ecole des Mines de Nantes. Ecole des Mines de Nantes, France, ISSN 1167-5357.

 




Contact
Simon Kielhöfer
German Aerospace Center

Institute of Robotics and Mechatronics
, Mechatronic Components and Systems
Tel: +49 8153 28-3342

Fax: +49 8153 28-1134

E-Mail: Simon.Kielhoefer@dlr.de
URL for this article
http://www.dlr.de/rmc/rm/en/desktopdefault.aspx/tabid-4814/7981_read-12958/