MadHand

MadHand is an innovative MIDI controller that uses computer vision to translate hand movements into musical notes. By leveraging webcam input and hand tracking technology, it allows users to create music through intuitive gestures. MadHand uses MediaPipe for hand tracking and converts the position of your hand into MIDI notes. The vertical position of your index finger determines the note, while the thumb controls velocity. Making a fist holds the current note.

Installation

Download

Download the latest release for your operating system from our Releases page.

MIDI Controller Setup

1. Install loopMIDI and create a virtual MIDI port.
2. In the MadHand application, select the created virtual MIDI port.
3. Use a synthesizer like Vital to generate sounds based on the MIDI signals from MadHand.
4. Launch the application
5. Select your MIDI output (virtual MIDI port) device and webcam
6. Adjust settings as desired
7. Click "RUN" to start
8. Use your hand to control MIDI output
9. Click "STOP" when finished, or changed some value

Features

• Real-time hand tracking to MIDI conversion
• Adjustable note range and smoothing
• Multi-channel MIDI output
• Graphical user interface for easy configuration
• Command-line script version for advanced users

Dependencies

The following dependencies are required for the script-only version:

• OpenCV
• MediaPipe
• Mido
• NumPy
• PyQt5

Script-Only Version

If you prefer to run the script version or want to set up a development environment:

1. Ensure you have Python 3.7 or later installed.
2. Install the required dependencies:
3. Clone the repository:

   git clone https://github.com/itsmadson/MadHand.git
   cd MadHand

4. Install the required dependencies:

   pip install opencv-python mediapipe mido numpy pyqt5

5. Run the script:

   python madhand.py

Acknowledgments

• MediaPipe for hand tracking technology
• Mido for MIDI functionality
• OpenCV for video processing
• loopMIDI for virtual MIDI port creation
• Vital for sound synthesis