Klangkörper

Klangkörper is an interactive media installation developed as part of "Imaging & Interaction - Perspectives on Mediated Realities", an interdisciplinary seminar investigating cross-sections of virtual and physical space from the perspective of architecture, film and gameplay, and was exhibited at the Long Night of the Sciences in Berlin.

http://imaginginteraction.com/

A body tracking system was developed using an array of six trackers and a camera to measure their position. Swiping gestures link each tracker to a body part.

The captured information is processed into a digital mirror projection. Hip, head, feet, and hands form a visual network that envelops the digital projection of the body.

The configuration of each body part is translated into modulation parameters such as pitch and amplitude. A sound generating algorithm mixes the different parameters into a soundscape driven by the movement of the body.