INDUX-R at the IEEE ICIR 2026!

At the IEEE ICIR 2026 conference, CERTH presented their work entitled “Real-Time Multimodal Manipulation of 3D Head Avatars from Consumer Sensors”. In this work a new system is described that creates and animates realistic 3D head avatars using consumer devices.

To create a personalized avatar, the system only needs a short video captured with a standard camera (e.g., a mobile phone), eliminating the need for expensive studio equipment or complex camera setups.

Once the avatar is created, it can be animated in real time on a computer, driven either by speaking into a microphone or by moving/speaking in front of a webcam.

This technology was recently put to work within the INDUX-R project to make poster sessions in the VR application more interactive. During a poster session, the service converts written text from the posters into speech, which then drive the personalized 3D avatars to deliver spoken summaries to users. This demonstration highlights how the technology can make information more engaging and accessible, supporting the project’s broader goals.