Skip to content

Handle Groq vision TPM limits - #13

Merged
arena-ai-coding-agent[bot] merged 1 commit into
mainfrom
arena/019fd7ce-nalam
Aug 6, 2026
Merged

arena-ai-coding-agent[bot] merged 1 commit into
mainfrom
arena/019fd7ce-nalam

Conversation

@arena-ai-coding-agent

Copy link
Copy Markdown
Contributor

Summary

  • cap vision completion tokens to fit Groq's 8K TPM on-demand tier
  • retry token-budget 413 responses with progressively smaller output budgets
  • compact schema prompts and document the vision token configuration
  • preserve provider failures as retryable processing errors

Validation

  • python -m py_compile backend/medical_extractor.py backend/api.py
  • git diff --check

Co-authored-by: arena-agent <297053741+arena-agent@users.noreply.github.com>
@arena-ai-coding-agent
arena-ai-coding-agent Bot merged commit 8c7a28b into main Aug 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant