Skip to content
ย 
ย 

Latest commit

ย 

History

15 Commits

Folders and files

NameName
Last commit message
Last commit date
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

NeuroGrid ScriptSense

AI-Powered Medical Prescription Translation with Text-to-Speech

NeuroGrid ScriptSense is an advanced Streamlit-based web application that leverages DigitalOcean Gradient AI (Llama 3.3 70B) to accurately translate medical prescriptions into 27+ Indian languages. This innovative tool bridges language barriers in healthcare, ensuring patients and healthcare providers can communicate effectively regardless of their native language.


โœจ Key Features

๐ŸŒ Multi-Language Translation

  • Translate medical prescriptions into 27+ Indian languages
  • Supports: Hindi, Bengali, Telugu, Marathi, Tamil, Urdu, Gujarati, Malayalam, Kannada, Punjabi, and many more
  • Preserves medical terminology and dosage accuracy

๐Ÿ”Š Text-to-Speech (NEW!)

  • Convert translated prescriptions to audio format
  • Play audio directly in the browser
  • Download audio as MP3 files
  • Supports all Indian languages with native pronunciation
  • Perfect for patients with reading difficulties or visual impairments

๐Ÿ“„ Comprehensive Prescription Management

  • User-friendly interface for patient details and medication information
  • Support for multiple medications per prescription
  • Fields for diagnosis, treatment details, and follow-up appointments
  • Download translated prescriptions as text files
  • Professional formatting for medical documentation

๐Ÿš€ Powered by Advanced AI

  • DigitalOcean Gradient AI - Serverless inference
  • Llama 3.3 70B Instruct Model - State-of-the-art translation quality
  • Fast and accurate translations
  • Medical terminology preservation

โ™ฟ Accessibility Features

  • Audio playback for visually impaired patients
  • Multiple download formats (text and audio)
  • Clear, professional layout
  • Mobile-responsive design

๐Ÿ“ธ Screenshots

block diagram System Architecture

Screenshot 1 Main Interface

Screenshot 2 Prescription Input

Screenshot 3 Medications

Screenshot 4 Translation Results

Screenshot 5 _Multi-language Support _

Screenshot 6 Text to Speech audio output


๐Ÿš€ Quick Start

Prerequisites

  • Python 3.10 or higher
  • DigitalOcean Gradient AI Model Access Key

Installation

  1. Clone the repository:
git clone https://github.com/preethamresearch/hacktoctober.git
cd hacktoctober
  1. Install dependencies:
pip install -r requirements.txt
  1. Configure API Key:

    GRADIENT_MODEL_ACCESS_KEY = "your_actual_api_key_here"
  2. Run the application:

streamlit run main.py
  1. Access the app:

๐Ÿ“– Usage Guide

Step 1: Enter Patient Information

  1. Fill in patient name, ID, and age
  2. Add doctor's name and contact information
  3. Enter diagnosis details

Step 2: Add Medications

  1. Specify the number of medications
  2. For each medication, enter:
    • Medication name
    • Dosage instructions
    • Frequency (e.g., "Twice daily")
    • Duration (e.g., "7 days")

Step 3: Additional Information

  1. Add known allergies (if any)
  2. Include special notes or instructions

Step 4: Translate

  1. Select target language from 27+ options
  2. Click "Translate" button
  3. View the translated prescription

Step 5: Audio & Download

  1. ๐Ÿ”Š Listen to audio: Click play on the audio player
  2. ๐Ÿ“ฅ Download text: Click "Download Translated Prescription"
  3. ๐Ÿ“ฅ Download audio: Click "Download Audio (MP3)"

๐ŸŒ Supported Languages

Full Text-to-Speech support for:

  • Hindi (เคนเคฟเคจเฅเคฆเฅ€)
  • Bengali (เฆฌเฆพเฆ‚เฆฒเฆพ)
  • Telugu (เฐคเฑ†เฐฒเฑเฐ—เฑ)
  • Marathi (เคฎเคฐเคพเค เฅ€)
  • Tamil (เฎคเฎฎเฎฟเฎดเฏ)
  • Urdu (ุงุฑุฏูˆ)
  • Gujarati (เช—เซเชœเชฐเชพเชคเซ€)
  • Malayalam (เดฎเดฒเดฏเดพเดณเด‚)
  • Kannada (เฒ•เฒจเณเฒจเฒก)
  • Punjabi (เจชเฉฐเจœเจพเจฌเฉ€)
  • Assamese (เฆ…เฆธเฆฎเง€เฆฏเฆผเฆพ)
  • Odia (เฌ“เฌกเฌผเฌฟเฌ†)
  • Sindhi (ุณู†ฺŒูŠ)

And 14+ more regional languages!


๐Ÿ› ๏ธ Technologies Used

AI & Machine Learning

  • DigitalOcean Gradient AI - Serverless inference platform
  • Llama 3.3 70B Instruct - Advanced language model
  • Google Text-to-Speech (gTTS) - Audio generation

Web Framework

  • Streamlit - Interactive web application
  • Python 3.10+ - Core programming language

Data Processing

  • Pandas - Data manipulation
  • NumPy - Numerical operations

Additional Libraries

  • Requests - HTTP requests
  • Base64 - File encoding
  • BytesIO - Audio processing

๐Ÿ“ Project Structure

NeuroGrid-ScriptSense/
โ”œโ”€โ”€ main.py                          # Main application
โ”œโ”€โ”€ requirements.txt                 # Python dependencies
โ”œโ”€โ”€ README.md                        # Project documentation
โ”œโ”€โ”€ SETUP.md                         # Setup guide
โ”œโ”€โ”€ MIGRATION_GUIDE.md              # Gradient AI migration guide
โ”œโ”€โ”€ TTS_FEATURE_GUIDE.md            # Text-to-Speech documentation
โ”œโ”€โ”€ QUICK_START.md                  # Quick start guide
โ”œโ”€โ”€ QUICK_REFERENCE.md              # Command reference
โ”œโ”€โ”€ check_env.py                    # Environment verification
โ”œโ”€โ”€ run_app.bat                     # Windows batch script
โ”œโ”€โ”€ run_app.ps1                     # PowerShell script
โ”œโ”€โ”€ .gitignore                      # Git ignore rules
โ”œโ”€โ”€ .env.example                    # Environment variable template
โ””โ”€โ”€ Screen/                         # Screenshots and diagrams
    โ”œโ”€โ”€ medical-prescription-blockdiagram.png
    โ””โ”€โ”€ img-*.png

๐ŸŽฏ Use Cases

For Healthcare Providers

โœ… Communicate with patients in their native language
โœ… Reduce medication errors due to language barriers
โœ… Provide audio instructions for better understanding
โœ… Generate professional multilingual documentation

For Patients

โœ… Understand prescriptions in native language
โœ… Listen to audio version if unable to read
โœ… Share prescriptions with family/caregivers
โœ… Better medication compliance

For Pharmacists

โœ… Verify prescriptions in multiple languages
โœ… Communicate dosage instructions clearly
โœ… Reduce dispensing errors


๐Ÿ“š Documentation


๐Ÿ” Security & Privacy

  • โœ… No data storage - Translations generated on-demand
  • โœ… Local processing - Audio created in memory
  • โœ… No cloud upload - Patient data stays secure
  • โœ… API key protection - Environment variable support

โš ๏ธ Important: Never commit your API key to version control. Use environment variables or .env files (already in .gitignore).


๐Ÿค Contributing

We welcome contributions! Here's how you can help:

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

๐Ÿ› Known Issues & Limitations

  • Internet required for both translation and audio generation
  • API rate limits may apply based on your Gradient AI plan
  • Some regional languages use Hindi TTS as fallback
  • Audio quality depends on translation accuracy

๐Ÿ”„ Recent Updates

Version 2.0 (October 2025)

  • โœ… Migrated from Google Gemini to DigitalOcean Gradient AI
  • โœ… Added Text-to-Speech functionality
  • โœ… Rebranded to NeuroGrid ScriptSense
  • โœ… Added audio download feature
  • โœ… Improved error handling
  • โœ… Enhanced documentation

Version 1.0

  • Initial release with Gemini AI
  • Basic translation functionality
  • Multi-language support

๐Ÿ“Š Sample Output

Patient Name: John Doe
Age: 45
Diagnosis: Hypertension

Medication 1:
Name: Amlodipine 5mg
Dosage: One tablet
Frequency: Once daily
Duration: 30 days

[Translated to Hindi, Tamil, Telugu, etc.]
[Audio playback available]
[Download as text and MP3]

๐Ÿ“ž Support

For issues, questions, or suggestions:


๐Ÿ“œ License

This project is licensed under the MIT License - see the LICENSE file for details.


๐Ÿ™ Acknowledgments

  • DigitalOcean Gradient AI - For providing the AI infrastructure
  • Google Text-to-Speech - For audio generation capabilities
  • Streamlit - For the excellent web framework
  • Open Source Community - For continuous support

๐ŸŒŸ Star Us!

If you find this project helpful, please give it a โญ on GitHub!


Built with โค๏ธ by NeuroGrid
Powered by DigitalOcean Gradient AI & Llama 3.3 70B


ยฉ 2025 NeuroGrid. All rights reserved.

Sample Translated Prescription

You can find a sample translated prescription here.

About

NeuroGrid ScriptSense is a Streamlit-based web application that leverages. This tool is designed to bridge language barriers in healthcare, ensuring patients and healthcare providers can communicate effectively regardless of their native language.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages