2. March 2018
Human-machine interaction in space - first technology experiment using artificial intelligence on the ISS

CI­MON - the in­tel­li­gent as­tro­naut as­sis­tant

CI­MON at EAC in Cologne
Image 1/3, Credit: DLR/T. Bourry/ESA.

CIMON at EAC in Cologne

CI­MON can be seen on the left in the im­age dur­ing a WLAN com­mu­ni­ca­tions test at the ESA Eu­ro­pean As­tro­naut Cen­tre (EAC) in Cologne-Porz on 30 Jan­uary 2018. Peo­ple in the back­ground, from left to right: Chris­tian Kar­rasch, CI­MON Project Man­ag­er at the DLR Space Ad­min­is­tra­tion; Till Eisen­berg, CI­MON project lead at Air­bus Friedrichshafen; and Christoph Kössl, Air­bus soft­ware sys­tems en­gi­neer for CI­MON.
Com­pos­ite im­age of CI­MON on the ISS
Image 2/3, Credit: DLR/T. Bourry/ESA.

Composite image of CIMON on the ISS

Com­pos­ite im­age of CI­MON float­ing in the Colum­bus Pub­lic Re­la­tions Mod­ule at ESA’s Eu­ro­pean As­tro­naut Cen­tre (EAC) in Cologne-Porz (30 Jan­uary 2018). CI­MON is a fly­ing and au­tonomous as­tro­naut as­sis­tant. Equipped with ar­ti­fi­cial in­tel­li­gence, this unique tech­nol­o­gy demon­stra­tor will sup­port the work of as­tro­nauts on the ISS dur­ing Ger­man ESA as­tro­naut Alexan­der Gerst’s Hori­zons mis­sion in the sum­mer of 2018.
CI­MON as­tro­naut as­sis­tance sys­tem
Image 3/3, Credit: DLR/T. Bourry/ESA.

CIMON astronaut assistance system

Chris­tian Kar­rasch, CI­MON Project Man­ag­er at the DLR Space Ad­min­is­tra­tion, and Till Eisen­berg, CI­MON project lead at Air­bus Friedrichshafen, hold CI­MON in their hands in the Colum­bus mod­ule mock-up at the ESA Eu­ro­pean As­tro­naut Cen­tre (EAC) in Cologne-Porz on 30 Jan­uary 2018. CI­MON is an in­no­va­tive, glob­al­ly unique as­tro­naut as­sis­tance sys­tem. This au­tonomous fly­ing sys­tem is equipped with ar­ti­fi­cial in­tel­li­gence and will be used for the first time by Ger­man ESA as­tro­naut Alexan­der Gerst dur­ing his ‘hori­zons’ mis­sion in the sum­mer of 2018. The DLR Space Ad­min­is­tra­tion award­ed the CI­MON project con­tract to Air­bus, and the de­vice was spe­cial­ly de­vel­oped for use in the Eu­ro­pean Colum­bus mod­ule on the ISS.

  • CIMON is the world's first flying, autonomous astronaut assistant featuring artificial intelligence
  • The technology demonstrator is roughly the size of a medicine ball and will be used in the Columbus module of the ISS during Alexander Gerst's Horizons mission from summer 2018
  • CIMON was developed and built in Germany on behalf of the DLR Space Administration
  • Initial 'microgravity test' during the 31st DLR parabolic flight campaign on 9 March 2018 in Bordeaux
  • Focus: Industry 4.0, artificial intelligence, astronautics, human-machine interaction, Internet of Things

The Crew Interactive MObile companioN (CIMON) is able to see, hear, understand, speak – and fly. It is roughly spherical, has a diameter of 32 centimetres and weighs five kilograms. Its robotic predecessor was Professor Simon Wright's 'flying brain', with sensors, cameras and a speech processor in the 1978 cartoon series, 'Captain Future'. Almost 40 years later, CIMON, the astronaut's flight attendant and assistance system, could turn science fiction into 'science fact'.

From summer 2018, CIMON will become the new 'crew member' on the International Space Station (ISS), in order to demonstrate cooperation between humans and intelligent machines in the form of a technology experiment. The interactive astronaut assistant was developed and built by Airbus in Friedrichshafen and Bremen on behalf of the German Aerospace Center (Deutsches Zentrum für Luft- und Raumfahrt; DLR) Space Administration and funded by the German Federal Ministry for Economic Affairs and Energy (Bundesministerium für Wirtschaft und Energie; BMWi). Watson AI technology from the IBM Cloud provides voice-controlled artificial intelligence. The human aspects of the assistance system were co-developed and supervised by scientists at Ludwig-Maximilian University Hospital in Munich (Klinikum der Ludwig-Maximilians-Universität München, LMU). An approximately 50-strong DLR, Airbus, IBM and LMU project team has been working on implementing CIMON since August 2016. "CIMON is globally unique in this form," summarises Christian Karrasch, CIMON Project Manager at the DLR Space Administration in Bonn. "We have implemented this experiment in a very short time. It is intended to show to what extent the astronauts' work can be supported in the European Columbus module on the ISS and relieve them, in particular, of routine tasks. Ideally, the astronauts could use their time better and more effectively. With CIMON, we are entering new territory and operating at the threshold of technological feasibility."

Microgravity in parabolic flight

CIMON will enter microgravity on 9 March 2018 during the 31st DLR parabolic flight campaign in Bordeaux. In particular, orientation, navigation and steering will be tested, to ensure that it is optimally prepared for use on the ISS – in permanent microgravity. In June, CIMON will then travel to the ISS on board the US Space-X CRS-15 space transport mission, where it will be greeted by the German ESA astronaut Alexander Gerst.

Following a functional test, the German astronaut will perform three experiments with his artificial colleague. On the agenda are experiments with crystals and a Rubik’s cube, and a medical experiment in which CIMON will be used as a flying camera.

CIMON allows the astronaut to keep both hands free, with no need to manually operate a computer, for example. Thanks to this fully voice-controlled access to documents and media, the astronaut can conveniently navigate through operating and repair instructions and procedures for experiments and equipment. CIMON will thus serve as a complex database of all the necessary information for working on the ISS, and can also be used as a mobile camera for documentation purposes.

When making its space debut, however, the intelligent artificial assistant will not have all the capabilities envisaged by its developers: "In the medium-term, we want to concentrate on group effects that develop in small teams over a long period of time and can occur during long-term missions to the Moon and Mars. Social interaction between humans and machines, and between astronauts and emotionally intelligent flight attendants could play an important role in the success of these missions," explains Till Eisenberg, CIMON project lead at Airbus Friedrichshafen. The engineers are also interested in processing Big Data and data mining.

"The aim of the CIMON project is to examine the current capabilities of artificial intelligence in a complex environment such as the International Space Station, in order to provide the best possible support to people in such conditions," says Matthias Biniok, IBM's lead Watson architect in Germany, explaining their interest in the project. For example, CIMON uses Watson AI to process text, speech and images, find specific information and knowledge, and interpret moods and feelings. Biniok adds: "These skills can be individually trained and enhanced within the context of their respective application. Artificial intelligence also makes particular use of artificial neural networks."

Scientific background

CIMON also has a scientific background; its advisors are Judith-Irina Buchheim and Alexander Choukèr from the Department of Anaesthesiology at the Ludwig-Maximilian University Hospital in Munich. During a variety of research projects, Buchheim and Choukèr are investigating the effects of stress on the human immune system. "We not only examine patients in intensive care units, but also people exposed to extreme stress and workload as a result of their environment, such as polar explorers in the Antarctic and astronauts on the International Space Station," reports Buchheim, adding: "Our studies show that being subjected to microgravity for a certain period can significantly affect the functioning of an astronaut's immune system. Stress is a major factor here." For example, strenuous tasks that are performed with a colleague are generally less arduous when people work well together. "As a partner and assistant, CIMON could support astronauts with their high workload of experiments and maintenance and repair work, thereby reducing their exposure to stress." According to Buchheim, possible applications on Earth are the support of engineers, researchers and doctors, AI-based enquiries about medical symptoms and everyday assistance for elderly people living alone.

  • CIMON - high-tech made in Germany

    CIMON's structure was built entirely using a 3D printing process, and is made of metal and plastic. Its 'face' is a display unit intended to hover at the astronaut's eye level. It can present and explain information and instructions for scientific experiments and repairs. Its 'eyes' are two cameras, and it also has an additional camera for face recognition. Two side cameras are used for video documentation and could also be used for additional computer-generated functions (augmented reality). Ultrasonic sensors measure distances for collision detection. Seven microphones act as 'ears' for detecting where sounds are originating, and there is a directional microphone for good voice recognition. Its 'mouth' is a loudspeaker that can be used to talk or play music. The core speech comprehension element of the AI is the IBM Watson system. CIMON is unable to learn independently; a human must actively train it. The AI for autonomous navigation is provided by Airbus and used for motion planning and object recognition. CIMON can freely move and rotate in all spatial directions using 14 internal fans. It can therefore turn towards the astronaut when it is spoken to, nod and shake its head and follow the astronaut – autonomously or on command. In microgravity on the ISS, it can be used for two hours. The dimensions of CIMON's face are modelled on the proportions of a human face. Gestures and facial expressions are also possible, as is a female, male or neutral appearance and voice. CIMON's product design was implemented in collaboration with Reichert Design, a company from Stetten am Bodensee.

Additional partners

Additional partners are: the European Space Agency (ESA), in particular the European Space Research and Technology Centre (ESTEC) in Noordwijk (Netherlands) for technical integration, BIOTESC in Lucerne (Switzerland) for operational experiment preparation and implementation of the experiment within the ISS infrastructure, the Columbus Control Center at DLR in Oberpfaffenhofen for operational mission planning, and the European Astronaut Centre (EAC) in Cologne.

  • Elisabeth Mittelbach
    Me­dia in­quiries Ger­man Space Agen­cy
    Ger­man Aerospace Cen­ter (DLR)
    Com­mu­ni­ca­tions, Ger­man Space Agen­cy at DLR
    Telephone: +49 228 447-385
    Fax: +49 228 447-386
    Königswinterer Str. 522-524
    53227 Bonn
  • Christian Karrasch
    Ger­man Aerospace Cen­ter (DLR)
    Ger­man Space Agen­cy at DLR
    Hu­man Space­flight, ISS and Ex­plo­ration
    Telephone: +49 228 447-291
    Fax: +49 228 447-737
    Königswinterer Straße 522-524
    53227 Bonn
Images on this topic

Main menu