Skip to content

Add fallback provider chain and automatic retries to Venice AI client #387

Description

@devJaja

Goal: Awareness-resistant inference.
Why it matters: A single provider outage halts all coordination.
Proposed scope:

  • Configurable provider fallback list, per-call timeouts, retries with backoff, graceful degradation to cached results.
    Acceptance criteria:
  • Provider failure triggers failover without failing the task.
  • Circuit breaker opens after repeated failures.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions