Note AI is an advanced AI-powered educational tool designed to capture, transcribe, and summarize live lectures and video archives. Built with a modern tech stack, it leverages Google's Gemini 1.5 Flash for multimodal analysis and Supabase for secure, scalable data persistence.
- 🔴 Live Meeting Intelligence:
- Automated bot (Playwright) keeps track of live Google Meet/Zoom sessions.
- Real-time audio capturing and transcript streaming.
- Instant "Stop & Summarize" triggers.
- 📂 Multi-Modal Uploads: Uses Gemini 1.5's native multimodal capabilities to process audio/video files (MP3, MP4, WAV) directly.
- 🧠 Advanced Summarization:
- Speaker Diarization: Distinguishes between Instructor and Students.
- Auto-Chaptering: Generates time-stamped breakdown of topics.
- Knowledge Checks: Auto-generates quiz questions for review.
- 🔐 Secure Architecture:
- Robust Authentication via Supabase Auth.
- Row Level Security (RLS) ensuring user data privacy.
- Session-based API Key management for security.
- Frontend: Streamlit (Python) for rapid, interactive UI development.
- Backend & Database: Supabase (PostgreSQL) for transactional data and Auth.
- AI Engine: Google Gemini 1.5 Flash (via
google-generativeaiSDK). - Automation: Playwright & PyAudio for headless browser automation and audio stream capture.
- Storage: Supabase Storage buckets for media archiving.
-
Clone the Repository
git clone https://github.com/Sohail-Ansari-afk/Note-AI.git cd Note-AI -
Install Dependencies
pip install -r requirements.txt playwright install
-
Environment Setup Create a
.envfile in the root directory:# Supabase Configuration SUPABASE_URL=your_supabase_url SUPABASE_KEY=your_supabase_anon_key # AI Configuration (Optional, can be entered in UI) GEMINI_API_KEY=your_gemini_api_key
-
Run the Application
streamlit run app.py
- Go to Google AI Studio.
- Log in with your Google Account.
- Click on "Get API key" in the sidebar.
- Create a key in a new project.
- Copy the key and use it in the Note AI app sidebar or
.envfile.
Contributions are welcome! Please fork the repository and submit a pull request for any enhancements.
Built with ❤️ by Sohail Ansari