Gesture-based MIDI control is no longer a novelty. Composers, performers, and producers are using hand movement to shape expression, automate parameters, and bring a physical dimension back to software-based music making.
But the tools available range from a £5000 pair of gloves to a free webcam app — and the right choice depends entirely on what you're actually trying to do. This guide covers the main options in 2026, what they're genuinely good at, and where each one falls short.
We'll cover: Leap Motion (Ultraleap), MiMu Gloves, AirBending, and KAOS.
Quick comparison
| Product | Price | Hardware needed | MIDI output | Platform | Best for |
|---|---|---|---|---|---|
| Leap Motion / Ultraleap | £80–£200 | Dedicated sensor | Via middleware | Mac, Windows | Dev / installation art |
| MiMu Gloves | £1,500–£5,000+ | Wearable gloves + receiver | MIDI / OSC | Mac, Windows | Professional performance |
| AirBending | £0–£5/mo | iPhone / iPad | MIDI over Wi-Fi | iOS → Mac | Quick mobile setup |
| KAOS This guide | Free / £9.99 Pro | Any webcam | MIDI CC direct | macOS 11+ | Studio + live performance |
Leap Motion / Ultraleap
Leap Motion started the consumer gesture tracking conversation when it launched in 2013. The company has since rebranded as Ultraleap and pivoted hard toward XR and enterprise, but the hardware is still available and still impressive for hand tracking precision.
The problem for musicians is that Leap Motion doesn't output MIDI directly. You need third-party middleware — typically something like Geco MIDI or a Max/MSP patch — to convert the gesture data into MIDI CC. That's a real barrier for anyone who just wants to play.
A powerful tracking sensor with genuine accuracy — but it requires technical setup to get MIDI output, and the ecosystem has drifted away from music production.
Pros
- Excellent tracking precision
- Tracks both hands independently
- Works with third-party MIDI tools
Cons
- Requires separate MIDI middleware
- Dedicated hardware cost
- Ecosystem focused on XR, not music
- Awkward desk placement for keyboard players
MiMu Gloves
MiMu gloves are the gold standard for wearable gesture control. Used by Imogen Heap, Ariana Grande, and orchestras worldwide, they track finger bend, wrist orientation, and absolute hand position — outputting MIDI or OSC with very low latency.
If you're performing professionally on stage and gesture control is central to your instrument, MiMu is the benchmark. But at this price point and with the lead time involved (they're custom made), they're simply not an option for most composers and producers.
Best-in-class wearable gesture MIDI. Incredible range, robust on stage, genuinely musical. Reserved for professional touring artists with the budget to match.
Pros
- Most expressive gesture control available
- Used in major touring productions
- Direct MIDI + OSC output
- Custom build, fits your hands
Cons
- £1,500–£5,000+ cost
- Long lead time (custom order)
- Can't play keys wearing them
- Requires dedicated performance setup
AirBending
AirBending is an iOS app that uses your iPhone or iPad's front camera to track hand gestures and send MIDI over a Wi-Fi connection to your Mac or PC. It's a neat idea — especially if you already have an iPad sitting on your studio desk.
In practice, the Wi-Fi MIDI connection introduces variable latency that's noticeable in a performance context. The gesture vocabulary is also more limited than dedicated solutions, and the positioning of a phone or tablet camera makes it less natural for keyboard players.
A clever use of existing hardware with zero additional cost. Worth trying if you have an iPad. The Wi-Fi latency and limited gesture range hold it back for serious use.
Pros
- No additional hardware if you own an iPad
- Free to start
- Quick to set up
Cons
- Wi-Fi MIDI latency
- Limited gesture types
- Awkward camera positioning for keys
- iOS dependency
KAOS — Webcam gesture control for Mac
KAOS takes a different approach: instead of dedicated sensors or wearables, it uses a standard webcam mounted above your keyboard pointing straight down. Google MediaPipe tracks 21 hand landmarks in real time and converts the movement into MIDI CC — with sub-20ms latency and no middleware required.
The free version gives you hand height mapped to CC 11 Expression — useful immediately for any string, vocal, or orchestral library. KAOS Pro (£9.99 one-time) adds four more gesture axes simultaneously, per-axis CC assignment from 1–128, and six rotary tuning controls per axis to shape curve, smoothing, deadzone, and response speed independently.
Setup takes under two minutes. The app runs locally at localhost:5050 — no cloud, no account, no internet after install. It connects to any DAW via macOS IAC Driver: Logic Pro, Ableton Live, EastWest, Cubase, MainStage, Reaper.
The most accessible gesture MIDI controller available in 2026. Works with hardware you already own, costs nothing to start, and provides genuinely musical control suitable for both studio production and live performance.
Pros
- Free — works with any webcam
- Sub-20ms latency
- Up to 5 simultaneous gesture axes
- Direct MIDI CC, no middleware
- Works while your hands are on the keys
- Fully local — no subscription
- macOS Apple Silicon native
Cons
- macOS only (no Windows yet)
- Requires webcam overhead mount
- Lighting affects tracking quality
Which gesture MIDI controller should you choose?
You're a film composer or studio producer on Mac and want expression control without a pedal: start with KAOS free. Mount a webcam above your keyboard, assign CC 11 to your string library's Expression parameter, and you're done. If you want more axes for complex performances, upgrade to Pro for £9.99.
You perform live and gesture control is central to your show, and budget isn't the primary constraint: MiMu Gloves are the professional answer. Nothing else comes close for on-stage expressiveness.
You need precise 3D hand tracking for interactive installation, VR, or custom software: Leap Motion / Ultraleap remains a strong sensor, though you'll need to build the MIDI bridge yourself.
You have an iPad and want to experiment quickly: AirBending is a zero-cost starting point, with the caveat that Wi-Fi latency makes it less suitable for real-time musical expression.
For most musicians — composers, keyboardists, producers using Logic, Ableton, or orchestral libraries — KAOS is the clear starting point. It's free, requires no new hardware, and has the lowest barrier to first use of any gesture MIDI solution on the market.
Setting up webcam gesture MIDI control
If you're new to gesture MIDI control, here's the basic setup for KAOS with a standard DAW:
- Enable the IAC Driver in macOS: Audio MIDI Setup → MIDI Studio → IAC Driver → Device is online
- Mount any USB webcam directly above your keyboard, pointing straight down at roughly 50cm height
- Download and run KAOS — it opens at
localhost:5050 - In Logic Pro: add a Software Instrument, open the CC MIDI assignment, assign CC 11 to Expression
- In Ableton: enable the IAC Driver in MIDI preferences, then use CMD+M to MIDI-learn any parameter
- Raise and lower your hand above the keys — the CC value follows in real time
Calibrate the MIN (hand far from keyboard) and MAX (hand close) points once, and KAOS maps your natural playing range to the full 0–127 CC output.
Try KAOS free — no hardware required
Works with any webcam. Logic Pro, Ableton, EastWest, Spitfire — any DAW that accepts MIDI CC.
Download KAOS Free for MacWhat's coming next for gesture MIDI
The trend is clear: gesture-based MIDI control is moving away from proprietary hardware toward software-defined solutions that use existing devices — webcams, phones, depth sensors that are already in the room.
The remaining challenges are latency (KAOS is already at sub-20ms), tracking robustness in challenging lighting, and expanding the gesture vocabulary beyond a single hand. KAOS Pro's multi-axis approach — five simultaneous MIDI CCs from one hand — is a step toward treating the hand as a full instrument rather than a single slider.
If you're a musician who's wanted physical expression control without the expense or bulk of hardware controllers, 2026 is the year the software-only route became a serious option.
KAOS is a free hand gesture MIDI controller for Mac — mount any webcam above your keyboard and control expression, modulation, or any MIDI CC in real time. No hardware, no gloves, no account required.