Skip to content

TTS/STT: Proof of Concept implementation for STT eval #511

@Prajna1999

Description

@Prajna1999
  1. PoC implementation of STT eval for below providers along with Word Error Rate and Lenient Word Error Rate for the below providers.
    • Gemini-2.5-pro
    • Gemin-2.5-flash
    • Gemini-3
    • Chirp V3 (Google-STT)
    • OpenAI - Whisper -1
    • OpenAI - OpenAI-4o-transcribe
    • AI4Bharat
    • Bhasini

Evaluation metrics
- WER
- Lenient WER
- Average scores
- Count of errors insertion, substitution, deletion.
- Summary scores

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions