Turning hand movements into three-dimensional digital space.

---

About the Project

Imagine drawing in mid-air without touching a screen or holding a controller.

This project transforms natural hand movements into persistent three-dimensional strokes using computer vision and gesture recognition. Every fingertip movement is tracked in real time, filtered for stability, and projected into an interactive 3D environment where users can freely explore their creations.

Beyond visualization, the project investigates how human gestures can become intuitive control signals for robotic systems, making it a practical research prototype for Human-Robot Interaction and Spatial Computing.

---

Research Objective

The project explores how computer vision can bridge the gap between human intention and robotic movement.

Instead of traditional input devices, the system interprets natural hand gestures as spatial commands that can later be mapped to robotic arm trajectories, digital twins, or immersive visualization systems.

---

Live Pipeline

📷 Camera

      │

      ▼

✋ Hand Detection

      │

      ▼

21 Hand Landmarks

      │

      ▼

👆 Fingertip Tracking

      │

      ▼

🎯 One-Euro Filter

      │

      ▼

📐 Coordinate Mapping

      │

      ▼

🌌 3D Stroke Generation

      │

      ▼

🤖 Robotic Motion Interpretation

---

System Preview

Replace this GIF with your own recording of the application to showcase real hand tracking and 3D drawing.

---

Features

Vision System Live webcam tracking MediaPipe hand landmarks Fingertip localization Real-time frame processing Stable gesture detection	Spatial Drawing Air drawing Persistent 3D strokes Interactive scene Smooth rendering Free-space visualization
Gesture Controls Open palm detection Index finger drawing Fist reset gesture Recording toggle Motion filtering	Robotics Research Motion mapping Human movement capture Spatial trajectory generation Robot path planning concepts Human-Robot Interaction research

---

Technology Stack

Component	Technology
Programming Language	Python
Computer Vision	OpenCV
Hand Tracking	MediaPipe
Mathematics	NumPy
Rendering	PyGame
Motion Smoothing	One-Euro Filter

---

Gesture Mapping

Gesture	Action
☝️ Index Finger	Draw
✋ Open Palm	Start Recording
✊ Fist	Clear Canvas
👋 Hand Movement	Navigate 3D Space

---

Project Structure

3D-Interactive-Air-Drawing

├── assets/
├── filters/
├── utils/
│
├── Iteration-10.1.py
├── requirements.txt
└── README.md

---

Installation

Clone the repository

git clone https://github.com/fazilkhan0786/3D-Interractive-Air-Drawing.git

Install the required packages

pip install opencv-python mediapipe numpy pygame

Run the application

python Iteration-10.1.py

---

Technical Highlights

• Real-time computer vision pipeline
• One-Euro Filter for smooth trajectories
• Spatial coordinate transformation
• Gesture-based interaction
• Interactive 3D visualization
• Modular Python architecture
• Low-latency processing

---

Applications

• Human-Robot Interaction
• Spatial Computing
• Gesture Interfaces
• Robotic Arm Control
• Digital Twin Systems
• Educational Visualization
• Computer Vision Research
• XR and AR Prototyping

---

Future Development

• Full six-degree-of-freedom interaction
• Multi-hand collaboration
• Robotic arm integration
• ROS compatibility
• VR support
• AR visualization
• Dynamic gesture learning
• Deep Learning based recognition
• Trajectory prediction
• Cloud visualization

---

Developer

Mohammad Fazil Firojkhan Malek

Computer Vision Developer

AI Engineer

Exploring the intersection of Artificial Intelligence, Spatial Computing, and Human-Robot Interaction.

---

Research Vision

The long-term vision of this project is to create intuitive interfaces where humans communicate with intelligent machines using natural movement instead of conventional controllers, enabling more seamless interaction between people and robotic systems.

---

Human movement is the most natural interface.

⭐ If you found this project interesting, consider starring the repository.