KAOS turns your hand's distance from the camera into MIDI CC — real time, sub-20ms latency, no hardware. Mount your webcam above your keyboard and play.
HAND TRACKING
Mount a webcam directly above your keyboard, pointing straight down at around 50cm. KAOS uses Google MediaPipe to track your hand in real time — lift your hand to increase the CC value, lower it to decrease. Works out of the box with CC11 (Expression) and CC1 (Modulation).
No gloves. No sensors. No pedals. Just your hand and a webcam.
HOW IT WORKS
Position a webcam directly above your keyboard, pointing straight down. Best height is ~50cm.
MediaPipe detects 21 landmarks on your hand in real time.
Hand height above the keyboard maps to 0–127, smoothed with a One Euro Filter.
Sent as MIDI CC via macOS IAC Driver — zero driver installs.
Assign the CC to any knob, fader, or parameter in any DAW.
FEATURES
Powered by Google MediaPipe. Mount your webcam ~50cm above your keyboard pointing straight down — hand height maps directly to CC value.
Adaptive smoothing that eliminates jitter at rest and stays responsive during fast gestures. Tune smoothing and speed independently.
Set MIN and MAX points to map the full 0–127 CC range for your exact hand size, camera position, and playing style.
Move your hand left or right to control pitch bend simultaneously. Available in v1.0 as an early beta — enable in settings.
Apply a power curve for expression-pedal feel. Flip linear. Invert any time. Deadzone keeps it steady when idle.
Capture FPS, Vision FPS, latency, and current CC value update at 20 Hz in the browser. Always know what KAOS is doing.
Optional live skeleton overlay streamed as MJPEG — for setup and calibration. Turn it off for lowest latency in performance.
Works with any USB or built-in webcam. Connects to any DAW via macOS IAC Driver. No MIDI interface, no dongle.
Double-click to install. Python env, ML model, all dependencies — local. No cloud, no accounts, no internet after first run.
GET STARTED
Unzip KAOS.zip
Right-click KAOS.command → Open (Gatekeeper, first time only)
Follow the setup — done in ~2 minutes
Open http://localhost:5050 in your browser
Mount your webcam directly above your keyboard, pointing straight down at ~50cm height
Calibrate MIN and MAX, assign CC11 (Expression) or CC1 (Modulation) in your DAW, and play
STAY IN THE LOOP
New features, hand lock, multi-CC support and more — drop your email and we'll let you know when they land.