BodyBeats

An interactive display which monitors your body movement and accordingly activates music

Individaul Project
Date: August 2023
Tools: Touchdesigner
Kinect Sensor
Mentor: Hrishikesh Wagle

Vision

Human body has perpetually served as a means of self-expression. This can occur through dancing, subtle motions, signals, restlessness, or utter stillness, as our bodies constantly convey emotions.

In this project,focusing on dancing as a medium to emote, I aim to alter the storyline from 'body-responds-to-music' to 'music-responds-to-body.'

Generating Visual

Utilizing TouchDesigner, I created a depiction of psychedelic visuals through animated patterns and anti-naturalistic colours because of its tendencies of captivating and mezmerizing the viewers. Along with the moving patterns, the spectator's silhouette instantly merges with the visuals upon being detected by the Kinect.

Sensors and body mapping

I utilized a Kinect sensor to map a human body. In this project, there are 3 states:

  1. Trigger - When an individual is detected, a base beat begins playing to show that the display is active

  2. Right arm - Movement of the right arm is mapped to initiate the second layer of beats

  3. Left arm - Movement of the left arm activates the 3rd layer, resulting in a full music track.

Trigger- Body Detected

Base beat begins

[hover for audio]

Right Arm Movement

2nd layer of beats

[hover for audio]

Left Arm Movement

3 layer of beat

[hover for audio]

Takeaways

  1. The audio choice can make or break the project

  2. The visual displayed was as important as the audio in engaging the audience

  3. Patience is the key

BodyBeats

An interactive display which monitors your body movement and accordingly activates music

Individaul Project
Date: August 2023
Tools: Touchdesigner
Kinect Sensor
Mentor: Hrishikesh Wagle

Vision

Human body has perpetually served as a means of self-expression. This can occur through dancing, subtle motions, signals, restlessness, or utter stillness, as our bodies constantly convey emotions.

In this project,focusing on dancing as a medium to emote, I aim to alter the storyline from 'body-responds-to-music' to 'music-responds-to-body.'

Generating Visual

Utilizing TouchDesigner, I created a depiction of psychedelic visuals through animated patterns and anti-naturalistic colours because of its tendencies of captivating and mezmerizing the viewers. Along with the moving patterns, the spectator's silhouette instantly merges with the visuals upon being detected by the Kinect.

Sensors and body mapping

I utilized a Kinect sensor to map a human body. In this project, there are 3 states:

  1. Trigger - When an individual is detected, a base beat begins playing to show that the display is active

  2. Right arm - Movement of the right arm is mapped to initiate the second layer of beats

  3. Left arm - Movement of the left arm activates the 3rd layer, resulting in a full music track.

Trigger- Body Detected

Base beat begins

[hover for audio]

Right Arm Movement

2nd layer of beats

[hover for audio]

Left Arm Movement

3 layer of beat

[hover for audio]

Takeaways

  1. The audio choice can make or break the project

  2. The visual displayed was as important as the audio in engaging the audience

  3. Patience is the key