A real-time voice translation and sign language translation application with video chat capabilities that helps connect with people worldwide.
- Speech Recognition: Uses the built-in browser API (Web Speech) to capture your spoken words.
- Real-Time Translation: Calls a translation service (like Google Translate API) or a local mock translator to convert recognized text.
- Sign Detection: Optional integration with TensorFlow handpose + Mediapipe to detect simple sign language gestures.
- UI Panel: A draggable, resizable panel over your Google Meet window, with toggle buttons for starting/stopping translations.
- Minimize: Collapses to a small icon so it doesn’t obstruct your video call.
-Chrome Browser (ideally version 88 or above), since it relies on Chrome’s built-in SpeechRecognition. -Microphone Access: The extension asks for mic permission to do speech recognition.
- Pre-commit Hooks: Automated checks for:
- Code linting
- Unit tests
- Secret scanning
- Security vulnerabilities
- GitHub Security:
- Branch protection rules
- Automated dependency updates (Dependabot)
- Secret scanning
- Code scanning with ESLint security rules
- Automated Testing:
- Unit tests with Jest
- Code coverage reports (minimum 80% coverage required)
- Security scanning
- Build Process:
- Automated builds on push/PR
- Artifact storage
- Deployment:
- Automated deployment to production for main branch
- Environment-based secret management
- ESLint with security rules
- Prettier for code formatting
- TypeScript for type safety
- Husky for git hooks
- Lint-staged for incremental linting
Infrastructure Security:
- HTTPS enforcement
- Secure WebRTC configuration
- Rate limiting
- Error handling
- Install dependencies:
npm install- Set up pre-commit hooks:
npm run prepare- Start development server:
npm start- Run tests:
npm test- Run security checks:
npm run security-audit
npm run scan-secrets- Create a new branch
- Make changes
- Ensure all checks pass:
- Tests
- Linting
- Security scans
- Submit a pull request
Required environment variables:
REACT_APP_SIGNAL_SERVER_URL: WebRTC signaling server URLREACT_APP_API_KEY: API key for translation service (if applicable)
MIT