Skip to content

Integration tests pin a retired Anthropic model (claude-3-haiku-20240307 → 404) #192

Closed

Description

@ptimizeroracle

Three integration test parametrisations pin claude-3-haiku-20240307, which Anthropic has retired. A direct call now returns:

Error code: 404 - {'type': 'error', 'error': {'type': 'not_found_error', 'message': 'model: claude-3-haiku-20240307'}}

Affected:

  • tests/integration/test_all_providers.py:26
  • tests/integration/test_structured_output.py:33
  • tests/integration/test_unified_client_e2e.py (same parametrisation)

These tests currently fail for a second, unrelated reason too — the parallel_tool_calls bug fixed in #188 — so the retired model was masked behind that. Once #188 lands, they will fail on the 404 instead.

Worth pinning a current model (e.g. claude-3-5-haiku-latest) and adding a note that provider model IDs need periodic review, since a retired model produces a confusing failure that looks like a code bug.

While updating: instructor.from_litellm(..., mode=ANTHROPIC_TOOLS) raises RegistryError: Mode Mode.ANTHROPIC_TOOLS is not registered for provider Provider.OPENAI — the litellm path only accepts OpenAI-family modes, so any Anthropic-via-litellm route needs its own mode handling. Related to #187.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions