Weave

.problem statement


In a world where screens often distance us from our bodies, I wanted to explore the opposite: what if our hands became the medium?

Weave translates hand movements into sound in real-time. Using VS Code, p5.js, ml5.js, and p5.sound, it creates a responsive system where motion itself becomes the interaction

Getting gestures to feel natural was tricky. Early tests lagged, and the audio was choppy. Refining thresholds, tweaking the mapping, and adding fade effects made the interaction smoother and more responsive.

.outcome

Exhibited at MFA IxD Studio, where over 100 engaged with the installation. Now it's your turn to try it.