Beyond QWERTY is an AI-powered, voice-enabled form-filling system designed to make digital interactions effortless. Using advanced speech recognition, it allows users to fill forms seamlessly, reducing typing effort and eliminating manual data entry challenges. It also breaks language barriers, improving inclusivity and accessibility.
- Time-consuming and error-prone process
- Typing difficulties for non-tech users, elderly, and differently-abled individuals
- Language barriers hinder vernacular users
- Need for a voice-enabled, AI-powered solution to simplify form-filling
- 🎤 Voice-Enabled Form Filling – Users can speak instead of typing, making the process faster and more convenient.
- 🤖 AI-Powered Error Correction – NLP ensures accurate text input, reducing mistakes.
- 🖥️ User-Friendly Interface – Simple and intuitive UI for easy navigation.
- 🌍 Accessibility for All – Designed to assist elderly users and differently-abled individuals.
The system architecture and workflow are illustrated in the Lucidchart diagram linked below:
The detailed research on Speech-to-Text models is available in the repository.
📌 View Research Paper
📌 Run Whisper Model on Google Colab
- Gemini – AI-driven text processing
- AssemblyAI – Speech-to-text conversion
- Frontend: React.js (Hosted on Vercel)
- Backend: Express.js (Hosted on Render)
- Database: NeonDB (For storing structured data)
✅ Multi-Language Support
✅ AI-Powered Processing
✅ Real-Time Error Detection
✅ Seamless Integration
✔️ Increased Accessibility
✔️ Higher Accuracy
✔️ User-Friendly
✔️ Boosts Productivity
Ensure you have the following installed on your system:
- Node.js (Latest LTS version)
- Git
- A code editor (VS Code recommended)
- Clone the Repository
git clone https://github.com/your-repo/beyond-qwerty.git cd beyond-qwerty
- Navigate to the backend directory:
cd backend - Install the backend dependencies:
npm install
- Create a
.envfile in the backend directory and configure your environment variables as needed. You can refer to the.env.examplefile for guidance. - Start the backend server:
node server.js
- Navigate to the frontend directory:
cd ../vaaniFill - Install the frontend dependencies:
npm install
- Start the frontend development server:
npm run dev
- Open your browser and go to
http://localhost:3000to view the application.
-
For building the frontend for production, run:
npm run build
-
To preview the production build, run:
npm run preview
This project is licensed under the MIT License
- Thanks to all contributors and libraries that made this project possible.