Skip to content

Update litellm dependency pin to >=1.83.3#52

Closed
mgeorgaklis wants to merge 1 commit into
scaleapi:mainfrom
mgeorgaklis:update-litellm
Closed

Update litellm dependency pin to >=1.83.3#52
mgeorgaklis wants to merge 1 commit into
scaleapi:mainfrom
mgeorgaklis:update-litellm

Conversation

@mgeorgaklis

@mgeorgaklis mgeorgaklis commented Jun 18, 2026

Copy link
Copy Markdown

This updates the litellm dependency to ensure we have the "context circulation" (thought recirculation) fix for Gemini models, which was introduced in version 1.83.3.

TAG=agy
CONV=cd1cf52d-8d17-4823-9574-432cbf70ecc4

Greptile Summary

  • Raises the MCP eval service LiteLLM dependency floor to >=1.83.3.
  • Keeps the LiteLLM minimum version aligned between services/mcp_eval/pyproject.toml and services/mcp_eval/requirements.txt.
  • Refreshes services/mcp_eval/uv.lock for the updated LiteLLM resolution and related transitive packages.

Confidence Score: 5/5

The dependency update is narrowly scoped and keeps declared package constraints aligned with the refreshed lockfile.

The changed files only adjust the LiteLLM floor and lockfile resolution for the MCP eval service, with no application logic or API behavior changes indicated.

T-Rex T-Rex Logs

What T-Rex did

  • T-Rex ran the litellm-pin-validation-script.py to capture the before state, showing litellm pinned to 1.75.x and uv.lock locked to 1.76.3 with checks failing against the 1.83.3 target.
  • T-Rex updated the pin to litellm>=1.83.3 and reran the validation script to capture the after state, showing litellm pinned to 1.89.2 with checks passing.

View all artifacts

T-Rex Ran code and verified through T-Rex

Reviews (1): Last reviewed commit: "Update litellm dependency pin to >=1.83...." | Re-trigger Greptile

This updates the litellm dependency to ensure we have the "context circulation" (thought recirculation) fix for Gemini models, which was introduced in version 1.83.3.

TAG=agy
CONV=cd1cf52d-8d17-4823-9574-432cbf70ecc4
@socket-security

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff Package Supply Chain
Security
Vulnerability Quality Maintenance License
Updatedpypi/​litellm@​1.76.3 ⏵ 1.89.276 +2100 +75100100100

View full report

@mgeorgaklis

Copy link
Copy Markdown
Author

@geobio could you please take a look at this PR when you have a moment? It updates the LiteLLM dependency to enable Gemini's context circulation (thought recirculation) for multi-turn runs.

@geobio

geobio commented Jul 17, 2026

Copy link
Copy Markdown
Collaborator

Closing as obsolete — superseded by the v2.0.0 restructure (#53).

This PR bumps litellm in services/mcp_eval/{pyproject.toml,requirements.txt,uv.lock}, but #53 (merged after this PR was opened) deleted all three files and removed the entire Python mcp_completion service. On current main:

  • litellm is no longer a declared dependency anywhere (not in the new root requirements.txt, no version pin, and no import litellm in any Python file).
  • LiteLLM is now an external proxy the TypeScript harness talks to over HTTP — litellm-strategy.ts POSTs to LLM_BASE_URL/v1/chat/completions. Its version is owned by whatever proxy backs LLM_BASE_URL, not pinned in this repo.

So there's nothing left to rebase onto. The original goal (Gemini "thought recirculation" fix, LiteLLM ≥1.83.3) is still valid but is now an operational change — bump LiteLLM on the proxy serving LLM_BASE_URL rather than in this repo.

Thanks @mgeorgaklis!

@geobio geobio closed this Jul 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants