Control PC games using hand gestures with your webcam! This project uses MediaPipe and OpenCV to detect hand gestures and map them to keyboard controls like moving, turning, and jumping.
| Gesture | Action | Description |
|---|---|---|
| ✊ Fist | Stop | All fingers folded |
| ☝️ Index up | Move forward (W) | Only index finger is extended |
| ✌️ Two fingers | Move back (S) | Index and middle fingers extended |
| 👍 Pinky Finger + Thumb (Pointing right) | Strafe right (D) | Thumb extended to the right |
| 👈 Pinky Finger + Thumb (Pointing left) | Strafe left (A) | Thumb extended to the left |
| 🖐️ Open palm | Jump (Spacebar) | All fingers extended |
- Python 3.10+
- OpenCV
- MediaPipe
pynput
Install dependencies:
pip install opencv-python mediapipe pynput.keyboard- Clone the repository:
git clone https://github.com/N0TM3-1/hand-controller.git cd hand-controller - Run the script:
python main.py
- The script uses MediaPipe to detect 21 hand landmarks
- It compares the landmark positions to determine finger states
- The gestures are mapped to the keyboard using pynput
Karthik Sankar, who created the Hack Club Visioneer project (would've never done this if it wasn't for him).