HOLOGATE Integrates AI into Military XR Training

HOLOGATE, through its training and simulation division HGXR, has entered into a four-year collaboration with the German Army. Partnering with the Wehrtechnische Dienststelle 91 (WTD 91), this initiative aims to revolutionize XR training by integrating advanced artificial intelligence (AI) technologies, including the development of stand-alone AI modules to support service personnel in the field. Through the use of AI technologies, this collaboration seeks to enhance training efficiency, realism, and human resource optimization.

Over the next four years, HGXR will use its expertise to integrate AI-driven solutions for the various aspects of military training to create a holistic, realistic training experience. The focus will be on the implementation and use of advanced behaviors from Non-Player Characters (NPC) and Large Language Models (LLM). In the future, AI will control complex action sequences, generate dynamic training scenarios and realistically represent conversation facilitation with NPCs via AI chatbots. In addition, AI will be used to simulate coordinated group behavior, making training scenarios possible that were previously difficult to represent.

The most important aspects of the project include: the development of an AI behavior editor for the creation and management of NPC actions; an introduction of situational AI-supported facial expressions and gestures; combining of scripted and AI-driven behaviors for a comprehensive training experience; analysis and integration of LLM for communication with NPCs;  and conversation with NPCs via AI chatbots, including the handling of dynamic threat scenarios, such as dealing with suicide bombers on a verbal and non-verbal level.

The project will be continuously evaluated through user feedback and expert workshops to ensure that the AI-driven training modules are in line with the training objectives. This iterative process will help refine and optimize AI capabilities to meet requirements.

This technology is not only being developed for military use but will also be used in police and security training in the future. The aim is to create interactive AI modules that can adapt to different training needs and scenarios to ensure continuous improvement and adaptation to the training objectives of the military, police and security forces.

The project's final stage will see the development of AI modules that can also operate independently of the virtual action trainer. These autonomous solutions are intended to support soldiers in their operational tasks and in training, for example by helping them to make decisions or providing situation assessments during deployment. Additionally, logistical and resource-intensive processes can also be optimized in the future thanks to AI. The potential applications of this technology are far-reaching and varied.