vrgineers logo

Press Release

Mixed Reality Tracking System for Future Pilot Training

Published: April 11, 2023

April 12, 2023, USA/Prague, Czech Republic – Vrgineers and Advanced Realtime Tracking demonstrate the combination of XTAL 3 headset and SMARTTRACK3/M in a mixed reality pilot trainer. The partnership between these two technological companies started in 2018, and ever since, they have supported each other’s products in the niche market. At IT2EC 2023 in Rotterdam, the integrated SMARTTRACK3/M into an F-35-like Classroom Trainer manufactured and delivered to USAF and RAF will be for display.   

This unique combination of the latest ART infrared all-in-one hardware and Vrgineers algorithms for cockpit motion compensation creates an unseen immersion for every mixed reality training. One of the challenges in next-generation pilot training using virtual technology and motion platforms is the alignment of the pilot’s position in the cockpit. By overcoming this issue, the simulator industry is moving forward to eliminate the disadvantages of simulated training. 

“We are continuously working on removing the technological challenges of modern simulators, one of which is caused by front-facing camera position distance from users’ eyes. We are developing advanced algorithms for motion compensation to minimize the shift between virtual and physical scene, making experience realistic,” says Marek Polcak, CEO of Vrgineers, and adds:  “The durability and compact size of SMARTTRACK3/M, which was optimized for using in cockpits, allows us as training device integrator to make it a comprehensive part of a simulation, increasing convenience of its daily usage.” 

SMARTTRACK3/M embedded two infrared cameras with LEDs is a pre-calibrated system, ready to go with durability to sustain continuous usage for 5+ years without needing service. It creates the perfect solution to be embedded in professional training platforms.   

It is a fully capable 6DOF system that provides real-time transitional and rotational data up to 240Hz. All the data motion and rotation calculations are performed by the SMARTTRACK3/M device itself, easing the computer performance, which can be utilized to run more graphically demanding applications. Thanks to its ethernet connection, it offloads USB traffic, often overloaded when using high-resolution mixed reality cameras.  

“This is the application SMARTTRACK3/M was designed for,” says Andreas Werner, business development manager for simulations at ART. “We have taken the proven hardware from the SMARTTRACK3 and adapted it to the limited space available. As a result, we have the precision and the reliability of a seasoned system in a form factor fitting to simulator cockpits”.  

SMARTTRACK3/M ticks off all the boxes. From design, calculations, and durability to interfaces, SMARTTRACK3/M is optimized for professional pilot training in cockpit replicas, making it the most convenient solution on the market.   

Visit us at booth #A31-A33 at the IT2EC in Rotterdam from the 24. to the 26. April 2023.   

About Vrgineers 

Vrgineers is a leader in developing immersive technologies focused on training professional fighter jets and helicopter pilots. The company develops and manufactures its XTAL headset for virtual and mixed reality. The company’s product portfolio also includes flight simulators – the Classroom, Portable, and Custom Trainer. 

The XTAL headset is developed based on the priorities of professional pilots and instructors from the international aviation community to meet the most demanding requirements for realistic simulation. The company achieved this through the unique combination of a wide field of view and high image quality that XTAL brings. 

Vrgineers simulators form the basis of a modern synthetic training platform. Thanks to the possibility of interconnection, it is possible to train not only pilots but also the cooperation of a pilot with a co-pilot, a gunner with a pilot, JTAC instructors, and the coordination of entire squadrons. Vrgineers simulators support both Western and Eastern aviation platforms, from propeller-driven to subsonic to supersonic aircraft and helicopters. 

About Advanced Realtime Tracking GmbH & Co. KG 


Advanced Realtime Tracking GmbH & Co. KG (ART) offers extensive options for object tracking and localization for a wide variety of applications, including customer-specific requirements. 

Since 1999, Advanced Realtime Tracking GmbH & Co. KG is one of the leading manufacturers of premium optical motion tracking systems for Virtual and Augmented Reality (VR/AR). Typical areas of application are visualization and optimization in design and production steps, motion capture for ergonomic studies as well as teaching and research projects at academic institutions in which Powerwalls, CAVEs, and HMDs are used. 

With new approaches in optics and image processing, ART continuously improves its skills in highly sophisticated and intelligent solutions for object detection and localization. Exciting results were implemented in the VERPOSE® camera system and in the markerless recognition solution CAPTA. 

All ART products are highly precise, reliable in use, and can be customized. Research, development, and production take place in Germany, which enables good quality control and a high degree of flexibility. The company is located in Weilheim i. OB, near Munich, Germany.