A space for experiencing virtual encounters
Interested visitors were given a first taste of interacting with a virtual counterpart at the 13th Venice Architecture Biennale in 2012. The installation there was designed by Wolfgang Tschapeller upon an invitation from the Commissioner, Arno Ritter. Tschapeller and his team mounted a mirror down one side of the long Austrian pavilion. Animated 3D figures, digitally created on the basis of real people, were projected onto the opposite side. The mirror imagery provided a place of encounter for real and virtual guests. Through its PEEK Programme for arts-based research, the Austrian Science Fund FWF funded the interdisciplinary design of this multifaceted experiential space, named INTRA-SPACE. It offered a kind of test zone for speculating about the relationships between virtual figures and real people and for providing first-hand experience of such relationships.
An experience of space in the moment
The principal investigator, Wolfgang Tschapeller from the Institute for Art and Architecture at the Academy of Fine Arts Vienna, set up an interdisciplinary team of 18 people covering the fields of motion capture, 3D visualisation, computer graphics and animation, architecture, architectural theory, artificial intelligence, neuro-science and dance. At the core of INTRA-SPACE lies the notion of intra-action, coined by the theoretical physicist and feminist philosopher Karen Barad. Differing from interaction, intra-action considers processes, identities and objects as not being pre-defined but as something that emerges on the spur of the moment. This entwining is what Barad calls intra-action: “We were inspired by Karen Barad's concept and tried to translate it into a spatial system of reference in which virtual bodies and real bodies can mingle”, says Christina Jauernik, an architect and arts-research collaborator in the project, describing the underlying concept. Based on an exploration of the nature of real-time measurements, the team members spent two-and-a-half years working together, on site or remotely, on this space: an experimental model for intra-action.
Encounters without technical assistance
A central element in the project was the co-operation with the Institute for Visual Computing and Human-Centered Technology at TU Wien (Michael Wimmer, Christian Freude) and with Nils Hasler and his research team at the Max-Planck Institute in Saarbrücken. The scientists there developed an experimental motion-capture system that does not require body-suits with motion-tracking markers as currently utilised for computer animation. The researchers used industrial cameras and algorithms which compute motion data from the difference between static space and moving people. They created nine different “diaphanous” (i.e. transparent, transient) figures, controlled in real-time via the motion and behaviour of each real-life counterpart: an elderly lady, the young girl “Carla”, “Bob”, a man in his mid-thirties, an old man, etc. These virtual figures have a few superhuman tricks up their sleeves: they can melt into each other, stand upside-down on the ceiling, transform body parts into objects, zoom, morph, disappear and pop up somewhere else.
