Body Language

Turning Movement into Art and Music for Rhinannin's debut album release show

2024
Client: Rhinannin Music
Album release show: Effenaar, Eindhoven
Role: Creative Technologist at Bureau Moeilijke Dingen
Supported by: Stimulerings Fonds Music x Design
Technology: TouchDesigner, GLSL, Leap motion hand tracking, drum tracking, point cloud, abelton
 
Photographers: Jostijn Ligtvoet & Joep Elderman
Introduction

I collaborated with Rhinannin and together with their band consisting of Frank Wintermans (drums), Timon Koomen (guitar) and Jornt Duyx (keyboards, bass, guitar), shown at her album release at Effenaar during Dutch Design Week 2024.

The project, Bodylanguage, also the name of the album, explored how to transform body language into an immersive visual and audio experience. The innovative installation responds visually and audibly to her movements and emotions, inviting the audience to experience her multidisciplinary art with all their senses. After the completion of the project, the LED installation has been travelling with her and the band, showed at Paradox Tilburg, Intro in Situ and more in the future.
Technology

I created 13 unique visuals for her songs, turning her paintings, silhouettes, and movements into interactive art, using live body tracking with Orbbec camera in TouchDesigner. I also turned visuals into audio reactive, enabled by acoustic drum triggers.

I worked with Eva van der Born on developing a human theremin, designed with leap motion hand tracking and Abelton, that translates Rhiannin’s hand gestures into a musical narrative—allowing her to manipulate her voice and conduct the sound simultaneously.