Web Gestural Controller

Handmate MIDI is a browser-based MIDI controller which allows you to control MIDI using your hand gestures, detected via Google MediaPipe's Hand model. Below is a YouTube demo:

Handmate Effects is a browser-based audio effects controller which allows you to control audio effects on your own audio input and audio files using your hand gestures, detected via Google MediaPipe's Hand model. Below is a YouTube demo:

For OSC output, MediaPipe-Hands-OSC implements hand-tracking for 2 hands on the web browser. Instructions for installation, usage and code here.