Advancing Multimodal XR for the Next Generation of Training

SENSORAMA is developing a common foundation for extended reality experiences that combine visual, auditory, force, tactile and thermal feedback. The project will connect these sensory modalities through a synchronized data model and open software interfaces, making XR training more realistic, adaptive and reusable. The technologies will be validated through five applications in hip implant surgery, pedicle screw surgery, dentistry, anatomy education and industrial assembly.

These use cases will demonstrate how the same multimodal foundation can support healthcare, education and Industry 5.0 training. 

Expected Impact

SENSORAMA will strengthen Europe’s position in human-centric Virtual Worlds by advancing interoperable XR technologies, improving training quality and reducing barriers for developers and organisations. Open SDKs and APIs, real-world pilots, ethical safeguards and standardisation activities will support wider research,industrial and societal uptake. 

How SENSORAMA Advances Multimodal XR

01

A synchronized multimodal foundation

A unified data model will represent and align visual, audio, force, tactile and thermal information with low latency.

02

Advanced interaction and devices

The project will improve haptic and thermal hardware, spatial audio, speech interaction, eye tracking and biofeedback-driven adaptation.

03

Real-world training applications

Five demonstrators will test the technologies with domain experts and target users in medical, educational and industrial environments.

Our Target Groups

01

XR developers and researchers

 Use and extend interoperable software, data models, rendering methods and evaluation resources. 

02

Healthcare and education professionals

Explore adaptive and high-fidelity training for surgery, dentistry and anatomy education.

03

A synchronized multimodal foundation

A unified data model will represent and align visual, audio, force, tactile and thermal information with low latency.

04

Standards bodies, policymakers and citizens

Contribute to trustworthy, inclusive and interoperable European Virtual Worlds. 

05

European Digital Innovation Hubs (EDIHs)

Support dissemination, stakeholder engagement and the uptake of SENSORAMA results within European innovation ecosystems.   

Meet the SENSORAMA Consortium

Subscribe to the SENSORAMA Newsletter

Receive SENSORAMA news directly by email and follow theproject from its foundational research to integrated demonstrators and open results.

Newsletter Subscription