A comprehensive computer vision-based gesture control system that enables wireless interaction with computers and multimedia through hand gestures. Perfect for large studio setups, multiscreen environments, and hands-free computer interaction.
- Real-time hand detection using MediaPipe
- 21-point hand landmark detection for precise gesture recognition
- Multi-hand support (up to 2 hands simultaneously)
- Finger counting and gesture classification
- Wireless mouse control using hand gestures
- Click and drag functionality through finger proximity detection
- Scroll control with different finger configurations
- Smooth cursor movement with configurable smoothing
- Volume control using thumb and index finger distance
- Brightness adjustment through hand positioning
- Media playback control (play, pause, next, previous)
- Arrow key navigation for presentations
- Speech recognition for voice commands
- Text-to-speech responses
- Web browsing and application control
- System control (shutdown, restart, lock)
- Information retrieval (Wikipedia, weather, time)
Tork/
├── HandTracking/ # Core hand tracking modules
│ ├── HandTrackingModuleFull.py # Main hand detection class
│ ├── VirtualMouse.py # Virtual mouse implementation
│ ├── mediacontroller.py # Media control gestures
│ ├── Voice Assistant.py # Voice assistant integration
│ ├── Brightness Control.py # Brightness control module
│ └── line_volume.py # Volume control implementation
├── BodyTracking/ # Body tracking modules (future development)
├── Bin/ # Binary/executable modules
└── requirements.txt # Python dependencies
-
Clone the repository
git clone https://github.com/niteshmandall/Tork.git cd Tork -
Install dependencies
pip install -r requirements.txt
-
Ensure camera access
- Make sure your webcam is connected and accessible
- Grant camera permissions if prompted
python HandTracking/HandTrackingModuleFull.pypython HandTracking/VirtualMouse.pyGestures:
- Index + Middle finger up: Move mouse cursor
- Fingers close together: Left click
- Ring + Pinky close: Right click and drag
- Thumb + Index close: Volume control
- No fingers: Scroll down
- One finger: Scroll up
python HandTracking/mediacontroller.pyGestures:
- 1 finger: Next track/right arrow
- 2 fingers: Previous track/left arrow
- 3 fingers: Volume up/up arrow
- 4 fingers: Volume down/down arrow
- 5 fingers: Play/pause/space
python HandTracking/Voice Assistant.pyVoice Commands:
- "Open YouTube/Google/StackOverflow"
- "Play music"
- "What time is it?"
- "Tell me a joke"
- "Lock window"
- "Shutdown system"
python HandTracking/Brightness Control.py- Use thumb and index finger distance to control screen brightness
python HandTracking/line_volume.py- Use thumb and index finger distance to control system volume
- Default resolution: 640x480
- Frame reduction: 100px border
- Smoothing factor: 7
- Maximum hands: 2
- Detection confidence: 0.5
- Tracking confidence: 0.5
- Python 3.7+
- Webcam/Camera
- Windows/Linux/macOS
- Minimum 4GB RAM recommended
| Gesture | Action | Description |
|---|---|---|
| 👆 Index + Middle | Mouse Move | Move cursor around screen |
| ✌️ Fingers Close | Click | Left mouse click |
| 🤏 Ring + Pinky Close | Drag | Right click and drag |
| 👍 Thumb + Index | Volume | Control system volume |
| 👋 No Fingers | Scroll Down | Scroll down |
| 👆 One Finger | Scroll Up | Scroll up |
| 1-5 Fingers | Media Control | Different media actions |
- Real-time FPS display for performance monitoring
- Configurable detection parameters for different environments
- Multi-platform support (Windows, Linux, macOS)
- Modular architecture for easy customization
- Voice integration for hands-free operation
- Body tracking integration
- Multi-screen support for large setups
- Custom gesture training
- Mobile app integration
- AR/VR compatibility
- Fork the repository
- Create a feature branch
- Make your changes
- Test thoroughly
- Submit a pull request
- Nitesh Kumar (@niteshmandall) - Project Lead
- Yash Tandon (@YashTandon01) - Contributor
- Sambit Kumar Pathy (@sambit2129) - Contributor
GitHub: https://github.com/niteshmandall/Tork
- ⭐ 1 star | 🍴 3 forks | 👀 1 watching
- 🐍 100% Python codebase
- 📝 38 commits in master branch
Note: This system is designed for large studio setups and multiscreen environments where traditional input methods may be impractical or inconvenient.