MVRsimulation Integrates Part Task Mission Trainer with Varjo XR-3

MVRsimulation has integrated the Varjo XR-3 mixed-reality headset into the fixed-wing Part Task Mission Trainer (PTMT), increasing suspension of disbelief for military fixed-wing pilot training. The PTMT with integrated Varjo XR-3 headset is being demonstrated in the Varjo booth (#3010) and the Battlespace Simulations booth (#1049) at I/ITSEC in Orlando, Florida, from 29 November – 3 December, 2021.

MVRsimulation designed and built the PTMT to provide a very low-cost, quick-deploy cockpit training solution to fill the gap in current in-use mission tactics training systems for military fixed-wing pilots. The system aims to maximize suspension of disbelief for trainee pilots as they practice mission tactics and coordination in joint, networked environments. It can also operate as a standalone training solution.

The PTMT comprises an all-welded aluminum structure fabricated in the U.S., fully integrated cockpit shell, a curved display and notional aircraft hardware represented by touch screen displays for pilot interaction. The PTMT can be configured for training for current 3rd and 4th generation combat aircraft currently used by NATO nations thanks to its specially designed, patent-pending flight control stick that can be adjusted between side-stick and center-stick positions.

When integrated with the XR-3 headset, pilots are fully immersed in the real-time, 360-degree virtual world created by MVRsimulation’s Virtual Reality Scene Generator (VRSG) high-resolution, geospecific terrain and 3D models, while still being able to interact with physical equipment in the real world. Computer-generated/semi-automated forces are managed via integration with Battlespace Simulations’ MACE, allowing solo or networked trainees to practice mission tactics in peer/near-peer complex training scenarios, such as penetrating advanced adversary air defences, air-to-air/air-to-ground engagement, and achieving and maintaining air supremacy.

The XR-3 integration also enables a real-time, pilot eye gaze tracking facility. VRSG harnesses the XR-3 headset’s built-in, real-time 200 Hz pupil-tracking capability that can precisely capture even the smallest eye movement of the wearer when training in virtual reality and mixed-reality environments. VRSG then exports this data via DIS as a PDU log at the end of the training mission, and visualizes the pilot’s head position, orientation, and gaze vector (with the gaze of each eye depicted as a color-coded cone) over the events of the training session for after-action review.

The PTMT-XR-3 integration will be demonstrated at I/ITSEC showing high speed/low altitude simulated flight over VRSG’s geospecific terrain of Albacete, Spain, including dense urban building structures and 3D replica of Los Llanos Air Base; as well as showcasing the eye-gaze tracking capability.