Skip to content

docs: define foreign web-search compatibility contract - #22

Merged
AviBackToBlack merged 20 commits into
mainfrom
docs/v0.3-foreign-web-search-contract
Sep 14, 2026
Merged

AviBackToBlack merged 20 commits into
mainfrom
docs/v0.3-foreign-web-search-contract

Conversation

@AviBackToBlack

@AviBackToBlack AviBackToBlack commented Sep 14, 2026 •

Copy link
Copy Markdown
Owner

Summary

Close the v0.3 foreign web-search research/design gate before changing production behavior.

This PR records the source-backed contract discovered from current Codex and LiteLLM behavior:

  • Codex supports_search_tool is about tool discovery/deferred exposure, not hosted web search
  • hosted web_search is gated by provider capability + runtime web-search mode; web_search_tool_type only selects request shape
  • current configured/custom Codex providers inherit web_search=true
  • the model catalog has no hosted-search disabled variant
  • LiteLLM supports_web_search is capability evidence but does not prove that every routed deployment accepts the exact OpenAI Responses hosted-search wire shape Codex emits
  • therefore foreign hosted-search enablement remains deferred

The contract also identifies an immediate follow-up bugfix: stop mapping LiteLLM supports_web_search to Codex supports_search_tool, and stop describing foreign supports_search_tool=false as a hosted-search disable guarantee.

The companion source index makes the research re-checkable against future version-matched Codex/LiteLLM releases.

Refs #5


Devin Review

Copilot AI lite review requested due to automatic review settings September 14, 2026 11:41

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 2 potential issues.

Devin Review

Comment thread docs/foreign-web-search.md Outdated
Comment thread docs/foreign-web-search-sources.md Outdated
Copilot AI review requested due to automatic review settings September 14, 2026 11:46

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Copilot AI review requested due to automatic review settings September 14, 2026 11:47

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Copilot AI review requested due to automatic review settings September 14, 2026 11:47

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Copilot AI review requested due to automatic review settings September 14, 2026 11:48

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@AviBackToBlack
AviBackToBlack merged commit 2606b0d into main Sep 14, 2026
8 checks passed
@AviBackToBlack
AviBackToBlack deleted the docs/v0.3-foreign-web-search-contract branch September 14, 2026 11:52
AviBackToBlack added a commit that referenced this pull request Sep 14, 2026
## Summary

Follow up the merged foreign web-search compatibility contract from #22
with the intentionally small production fix it identified.

This PR:

- stops mapping LiteLLM `supports_web_search=false` to Codex
`supports_search_tool=false` for exact templates
- stops treating `supports_web_search` overrides as provenance/ownership
for exact `supports_search_tool`
- keeps foreign `supports_search_tool=false` as a conservative
**tool-search/deferred-discovery** decision, not a hosted-web-search
suppression guarantee
- keeps LiteLLM/override `supports_web_search` visible as capability
evidence in `explain`
- adds regressions for raw exact evidence, exact overrides, and foreign
override provenance
- aligns the older model-group aggregation design text with the
source-backed web-search contract

No foreign hosted-web-search enablement is added. Provider/runtime
hosted-search behavior remains deferred under
`docs/foreign-web-search.md`.

Refs #5
<!-- devin-review-badge-begin -->

---

<a
href="https://app.devin.ai/review/avibacktoblack/litellm-codex-models/pull/23"
target="_blank">
  <picture>
<source media="(prefers-color-scheme: dark)"
srcset="https://static.devin.ai/assets/gh-devin-review-dark.svg?v=3">
<img src="https://static.devin.ai/assets/gh-devin-review-light.svg?v=3"
alt="Devin Review">
  </picture>
</a>
<!-- devin-review-badge-end -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants