Skip to content

niteshmandall/Tork

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Tork - Gesture Control System

A comprehensive computer vision-based gesture control system that enables wireless interaction with computers and multimedia through hand gestures. Perfect for large studio setups, multiscreen environments, and hands-free computer interaction.

🚀 Features

Hand Tracking & Gesture Recognition

  • Real-time hand detection using MediaPipe
  • 21-point hand landmark detection for precise gesture recognition
  • Multi-hand support (up to 2 hands simultaneously)
  • Finger counting and gesture classification

Virtual Mouse Control

  • Wireless mouse control using hand gestures
  • Click and drag functionality through finger proximity detection
  • Scroll control with different finger configurations
  • Smooth cursor movement with configurable smoothing

Media Control

  • Volume control using thumb and index finger distance
  • Brightness adjustment through hand positioning
  • Media playback control (play, pause, next, previous)
  • Arrow key navigation for presentations

Voice Assistant Integration

  • Speech recognition for voice commands
  • Text-to-speech responses
  • Web browsing and application control
  • System control (shutdown, restart, lock)
  • Information retrieval (Wikipedia, weather, time)

📁 Project Structure

Tork/
├── HandTracking/           # Core hand tracking modules
│   ├── HandTrackingModuleFull.py    # Main hand detection class
│   ├── VirtualMouse.py              # Virtual mouse implementation
│   ├── mediacontroller.py           # Media control gestures
│   ├── Voice Assistant.py           # Voice assistant integration
│   ├── Brightness Control.py        # Brightness control module
│   └── line_volume.py               # Volume control implementation
├── BodyTracking/           # Body tracking modules (future development)
├── Bin/                    # Binary/executable modules
└── requirements.txt        # Python dependencies

🛠️ Installation

  1. Clone the repository

    git clone https://github.com/niteshmandall/Tork.git
    cd Tork
  2. Install dependencies

    pip install -r requirements.txt
  3. Ensure camera access

    • Make sure your webcam is connected and accessible
    • Grant camera permissions if prompted

🎯 Usage

Basic Hand Tracking

python HandTracking/HandTrackingModuleFull.py

Virtual Mouse Control

python HandTracking/VirtualMouse.py

Gestures:

  • Index + Middle finger up: Move mouse cursor
  • Fingers close together: Left click
  • Ring + Pinky close: Right click and drag
  • Thumb + Index close: Volume control
  • No fingers: Scroll down
  • One finger: Scroll up

Media Control

python HandTracking/mediacontroller.py

Gestures:

  • 1 finger: Next track/right arrow
  • 2 fingers: Previous track/left arrow
  • 3 fingers: Volume up/up arrow
  • 4 fingers: Volume down/down arrow
  • 5 fingers: Play/pause/space

Voice Assistant

python HandTracking/Voice Assistant.py

Voice Commands:

  • "Open YouTube/Google/StackOverflow"
  • "Play music"
  • "What time is it?"
  • "Tell me a joke"
  • "Lock window"
  • "Shutdown system"

Brightness Control

python HandTracking/Brightness Control.py
  • Use thumb and index finger distance to control screen brightness

Volume Control

python HandTracking/line_volume.py
  • Use thumb and index finger distance to control system volume

🔧 Configuration

Camera Settings

  • Default resolution: 640x480
  • Frame reduction: 100px border
  • Smoothing factor: 7

Hand Detection Parameters

  • Maximum hands: 2
  • Detection confidence: 0.5
  • Tracking confidence: 0.5

📋 Requirements

  • Python 3.7+
  • Webcam/Camera
  • Windows/Linux/macOS
  • Minimum 4GB RAM recommended

🎮 Gesture Guide

Gesture Action Description
👆 Index + Middle Mouse Move Move cursor around screen
✌️ Fingers Close Click Left mouse click
🤏 Ring + Pinky Close Drag Right click and drag
👍 Thumb + Index Volume Control system volume
👋 No Fingers Scroll Down Scroll down
👆 One Finger Scroll Up Scroll up
1-5 Fingers Media Control Different media actions

🚀 Advanced Features

  • Real-time FPS display for performance monitoring
  • Configurable detection parameters for different environments
  • Multi-platform support (Windows, Linux, macOS)
  • Modular architecture for easy customization
  • Voice integration for hands-free operation

🔮 Future Development

  • Body tracking integration
  • Multi-screen support for large setups
  • Custom gesture training
  • Mobile app integration
  • AR/VR compatibility

🤝 Contributing

  1. Fork the repository
  2. Create a feature branch
  3. Make your changes
  4. Test thoroughly
  5. Submit a pull request

👨‍💻 Authors

🔗 Repository

GitHub: https://github.com/niteshmandall/Tork

📊 Project Stats

  • 1 star | 🍴 3 forks | 👀 1 watching
  • 🐍 100% Python codebase
  • 📝 38 commits in master branch

Note: This system is designed for large studio setups and multiscreen environments where traditional input methods may be impractical or inconvenient.

About

Our project enable the large studio or multiscreen setup to work wirelessly and visualize the model in the real world.

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages