game & interaction design based in Berlin
currently freelancing in
cross media gamified
theater productions
game & interaction design based in Berlin
currently freelancing in
cross media gamified
theater productions
DOWNLOAD HERE
Year:
2023
GRIPS theatAR is a research project initiated and conducted by the GRIPS Theater. A diverse team of game developers and theater creators was engaged in the ideation and experimental implementation of digital theater production segments, some of which are now accessible for reading, viewing, and testing in the official mobile app.
The aim was to explore the synthesis of theater and augmented reality, and to discover new aesthetics, narrative styles, and formats. The experiments were conducted in three main categories: performance, space, and narrative.
My Role:
GRIPS theatAR is a research project initiated and conducted by the GRIPS Theater. A diverse team of game developers and theater creators was engaged in the ideation and experimental implementation of digital theater production segments, some of which are now accessible for reading, viewing, and testing in the official mobile app.
The aim was to explore the synthesis of theater and augmented reality, and to discover new aesthetics, narrative styles, and formats. The experiments were conducted in three main categories: performance, space, and narrative.
The aim was to explore the synthesis of theater and augmented reality, and to discover new aesthetics, narrative styles, and formats. The experiments were conducted in three main categories: performance, space, and narrative.
My Role:
Team:
Project Management Dramaturgy
Game Design Lead Technical Lead
App Development
App Development
App Development
App Development
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Result:
We used consumer VR technology to record performances for the performance and play experiments. The original idea was also to make a performance, digitised live through VR tracking, available online through AR visualisation. However, the live streaming aspect of this experiment was beyond the scope of the research project. Instead, a short performance was created as an example and made available as an AR experience in the documentation app. We also tried a volumetric video setup to record performances and display them in AR. However, in my opinion, the effort required for this workflow is currently justified only for specific, limited meta-aesthetic reasons. As a third exceptional technology, we used AI image recognition algorithms to extract animations from videos. This was a promising process, although occasionally inferior to the depth perception of the VR setup.
In addition to the unrealised live presentation, much thought was given to the living room as a stage, or the extension of the stage space in classic theatre play situations. A recorded performance was also linked to a GPS location in the documentation app, so that the stage could also be set somewhat for the individual performance on the smartphone. 3D scanning of the environment and surface recognition were also tested for this purpose. On several rehearsal days, different stage setups were used in the GRIPS theatre to test ideas for the extended stage space. Marker-based AR, free placement through surface recognition and anchoring through 3D object recognition were used. Three of these stage experiments on interaction, space and lighting can be tried out in the documentation app.
The results of these experiments and other hardware and software tests on the rehearsal stage at Theaterhaus Mitte inspired many new ideas for full-scale productions. In order to provide a perspective after the very broad experimental approach so far, a complete concept for a play has been developed, in which content, narrative style and AR technology are equally necessary components of the final experience. The concept can be found in the documentation app.
Co Project Management,
Dramaturgy
Game Design Lead,
Technical Lead
App Development
App Development
App Development
App Development
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
Research Team
In addition to the unrealised live presentation, much thought was given to the living room as a stage, or the extension of the stage space in classic theatre play situations. A recorded performance was also linked to a GPS location in the documentation app, so that the stage could also be set somewhat for the individual performance on the smartphone. 3D scanning of the environment and surface recognition were also tested for this purpose. On several rehearsal days, different stage setups were used in the GRIPS theatre to test ideas for the extended stage space. Marker-based AR, free placement through surface recognition and anchoring through 3D object recognition were used. Three of these stage experiments on interaction, space and lighting can be tried out in the documentation app.
The results of these experiments and other hardware and software tests on the rehearsal stage at Theaterhaus Mitte inspired many new ideas for full-scale productions. In order to provide a perspective after the very broad experimental approach so far, a complete concept for a play has been developed, in which content, narrative style and AR technology are equally necessary components of the final experience. The concept can be found in the documentation app.
partner:
Partner:
spotlights:
Spotlights: