feat(litellm): add OrcaRouter as a named cloud provider route - #2934
Open
XiaoHuo888-hue wants to merge 1 commit into
Open
feat(litellm): add OrcaRouter as a named cloud provider route#2934XiaoHuo888-hue wants to merge 1 commit into
XiaoHuo888-hue wants to merge 1 commit into
Conversation
Add an 'orcarouter' model route to the LiteLLM gateway so ODS users can route cloud traffic through OrcaRouter (https://www.orcarouter.ai) in cloud and hybrid modes, mirroring the existing MiniMax integration. The route targets https://api.orcarouter.ai/v1 with model orcarouter/auto and is backed by a new ORCAROUTER_API_KEY env var. Wire the key through the runtime config renderer, checked-in LiteLLM configs, compose env passthrough, env schema/example, Linux/macOS/Windows installers, and offline sanitization. Add renderer + settings-env tests. Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: XiaoHuo888-hue <jinhao.song@myflashcloud.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a named
orcaroutermodel route to the LiteLLM gateway so ODS users can route cloud traffic through OrcaRouter incloudandhybridmodes — mirroring the existing MiniMax integration.OrcaRouter is an OpenAI-compatible model gateway (
https://api.orcarouter.ai/v1). It also runs gateway-level, zero-trust security for AI agents on the same endpoint — screening every prompt/response and governing every tool call on a default-deny basis, with no application code changes.Changes
ods/scripts/render-runtime-configs.py): add anorcarouterroute (model: openai/orcarouter/auto,api_base: https://api.orcarouter.ai/v1,api_key: os.environ/ORCAROUTER_API_KEY) to thelitellm-cloud,litellm-hybrid, and switchboard hybrid route lists.ods/config/litellm/{cloud,hybrid,switchboard}.yaml): add the matchingorcarouterroute so renderer contracttest_checked_in_mode_configs_match_rendererstays byte-identical.ORCAROUTER_API_KEYin.env.schema.json(secret: true),.env.example, Linux/macOS/Windows installer env generators, phase 06 key preservation, phase 09 offline sanitization, and LiteLLM compose env passthrough.docs/MODE-SWITCH.md(cloud provider table + env table).ORCAROUTER_API_KEYadded to the dashboard-api settings-env secret-key regression test.[Unreleased].AI Assistance
This PR was drafted with AI assistance (change planning, test authoring, and PR description). All changes were reviewed by the human author.
Release Lane
release/2.6.xmainStable hotfix reason:
Changed Surface
Risk And Validation
git diff --checkrelease/2.6.xCommands/results:
Note:
tests/contracts/test-installer-contracts.shreports a single FAIL on aPodman/systemd lifecycle case ("forced session restart selected the stale system
unit") — this reproduces identically on unmodified
mainand is an environmentlimitation (no systemd in this container), unrelated to this change.
Operational Change Check
The new route is additive and only activates when the user sets
ORCAROUTER_API_KEYand selects theorcaroutermodel name.Notes For Reviewers
This mirrors the existing MiniMax provider route exactly. The route is inert
until the user supplies
ORCAROUTER_API_KEYin.env.Disclosure: I'm an engineer on the OrcaRouter team.