Enhancing live entertainment with augmented reality

Is it possible to enhance the experience of a live performance using augmented reality glasses?

The impact of technology on live entertainment is significant, with advancements in special effects, promotion, and live streaming. The latest developments in immersive media offer new opportunities for creating more engaging experiences. 

Our goal was to investigate how this technology can be utilized and how it affects the audience's experience.

Robin Kroes and Remy Tilburg, professional contemporary dancers, gave us the opportunity to enhance their original choreography using digital enhancements by means of augmented reality (AR). Our goal was to understand the impact that this technology and projected content would have on the audience's experience. Previous studies have utilized AR in both dance and theater settings, but these were often done with short segments, on smartphone screens, or in sub-optimal conditions for the performance. Our aim was to create an experience that is as close as possible to the original performance, but with the added element of computer graphics.

Together, we developed background and foreground content and a system that could align the digital content with the physical location of the stage and synchronize the timing between 20 AR glasses. Using this, we organized four live performances, allowing up to 20 participants per session to experience the choreography with or without AR.

Although a larger sample size is needed, we can confidently say that live performances can be enhanced by using AR glasses and that the content provides an additional experience. Despite the technology being in an early stage, and the experience being impacted by performance and comfort, we are optimistic that further research and projects will provide us with a greater understanding of the future blending of technology and live entertainment.

Project funding

ClickNL

Project Partners

Effenaar Smart Venues, 4DR Studios, ClickNL, Robin Kroes & Remy Tilburg

More information

You can find more information about this project in this video.