MaiSHU
The project "Multimodal Perception and Human-Machine Interfaces of Semi-Autonomous Intelligent Systems for Humanitarian Assistance in Uncertain and Unstructured Environments" (MaiSHU) aims to develop innovative technologies that enable assisted teleoperation of vehicles for humanitarian assistance and delivery of goods in challenging, unstructured environments.
Main goal of the project is the integration of a robust multimodal perception strategy (regional to local), complemented by an AI-based semantic understanding of the environment, and a powerful human-machine interface. In this context, the ZKI will further design a global mission operation centre (GMOC) and develop a multimodal situational picture.
Based on remote sensing as well as vehicle and perception data, a GMOC will primarily carry out the pre-planning and evaluation of truck operations. For this purpose, the ZKI is designing an interactive 3D situational picture including a dashboard.