Body Language

Turning Movement into Art and Music for Rhinannin's debut album release show

2024
Role: Creative Technologist & Visual Designer
Client: Rhinannin Music
Show: Effenaar, Eindhoven
Supported by: Stimulerings Fonds Music x Design
Technology: TouchDesigner, GLSL, Leap motion hand tracking, drum tracking, point cloud, abelton
Photographers: Jostijn Ligtvoet & Joep Elderman
Introduction

The project, Bodylanguage, also the name of the album, explored how to transform body language into an immersive visual and audio experience. The innovative installation responds visually and audibly to her movements and emotions, inviting the audience to experience her multidisciplinary art with all their senses. After the completion of the project, the LED installation has been travelling with her and the band, showed at Paradox Tilburg, Intro in Situ and more in the future.

I created 13 unique visuals for her songs, turning her paintings, silhouettes, and movements into interactive art, using live body tracking with Orbbec camera in TouchDesigner. I also turned visuals into audio reactive, enabled by acoustic drum triggers.

I worked with Eva van der Born on developing a human theremin, designed with leap motion hand tracking and Abelton, that translates Rhiannin’s hand gestures into a musical narrative—allowing her to manipulate her voice and conduct the sound simultaneously.
Visual Design - Point Cloud

Visual Design - Drum Reactive

Visual Design - Video Processing

Visual Design - Generative Art

Technology

Tech Stack