Virtual Musical Instruments 🥁 🎹 🎶

• It helps users to virtually play musical instruments by waving their hands while holding a coloured object in the air.
• It detects the coordinate position of the hand using colour detection and, depending on it, presses the keyboard button and plays the respective instrument sound.
• This project uses the concept of Computer Vision and is implemented using Python, OpenCV, Numpy, PyAutoGUI.
• Click here to watch the Demo Video

System Requirements:

• Python
• OpenCV
• PyAutoGUI
• Numpy
• Web Camera

How to use:

For Drumkit set 🥁

• Hold any blue/red colored object in your hand.
• Open OneMotion in your browser.
• Run your python file.
• Keep both OneMotion & your output window side by side.
• Just wave your hand holding that object infront of camera and move towards any insturment.
• It will press the keyboard button depending on the instrument and will play the sound.

For Piano 🎹

• Wear black colored gloves.
• Open ONLINE PIANIST in your browser.
• Run your python file.
• Keep both Online Pianist window and your output window side by side.
• Just wave your hands/fingers while wearing black gloves in front of the camera.
• It will press the keyboard button depending on the keys of the piano and will play the sound.

Concepts used:

• Color Tracking : It tracks the colored object held at hand.
• Contour Detection: Detects the position of the colored object and making a rectangle over it.
• Image Masking: Image mask is created after detecting the color.
• Color Space Conversion: Converts the BGR into HSV values.

Screenshots:

Initial Window after running the python file:

When you move the object towards the instrument:

For Air Piano:

Hope you all liked it ❤️