ESA Virtual Space: from crew training to Hera's mission in everyday life

European Space Agency (THIS) actively implements augmented reality technologies — from training astronauts to open platforms for developers and the general public. Expected, that these tools will change the approach to space operations and popularization of science.

Augmented reality (XR) is a collective term for several related technologies. Virtual reality completely immerses a person in an artificial environment, augmented reality superimposes digital elements on the real world, and mixed reality combines both approaches, allowing interaction with digital objects in physical space. ESA combines these three areas to train astronauts, internal work and popularization of space.

ESA's XR-Lab works at the European Astronaut Training Center in Cologne. Astronauts study the layout of the International Space Station in a virtual environment (ISS), they practice controlling a robotic arm and practice going into outer space without leaving the Earth. The next step is to transfer these instruments directly aboard the ISS. "Mixed Reality Center" project (Mixed Reality Facility) is already adapting XR devices to work in microgravity. Devices will help the crew work with instructions right in front of their eyes, keeping your hands free, keep in touch with family in shared virtual spaces and stay motivated during daily physical training.

ESA also released the ESA XR Plugin, a toolkit for developing XR applications, built on the Unreal Engine and OpenXR open standard. Developers and companies can use it for their own products, retaining full commercial rights. Access to the recruitment is also open to high school students and university students.

Available XR technologies allow the audience to visualize a model of the Hera mission vehicle in their own space, take a virtual tour of the museum or feel weightlessness and launch a rocket. In parallel, ESA XR Universe — a multi-user platform for collaborative work in virtual spaces — is being developed. The pilot version will soon be launched in the agency for joint design reviews and analysis of Earth remote sensing data, and later it will be opened for everyone.

Source: https://www.esa.int