Skip to content

Improving config for build.nvidia.com hosted inference#1684

Open
randerzander wants to merge 6 commits intoNVIDIA:mainfrom
randerzander:main
Open

Improving config for build.nvidia.com hosted inference#1684
randerzander wants to merge 6 commits intoNVIDIA:mainfrom
randerzander:main

Conversation

@randerzander
Copy link
Collaborator

Fixing how use of NVIDIA_API_KEY as a shell env is picked up and passed along for run_mode="inprocess"

Now allows user to pass a single argument to use all build.nvidia.com hosted inference, instead of setting URLs explicitly in all ingestor tasks

ingestor = create_ingestor(..., inference="build.nvidia.com")

Copilot AI and others added 4 commits March 21, 2026 20:41
…NVIDIA_API_KEY propagation

Co-authored-by: randerzander <1692914+randerzander@users.noreply.github.com>
Agent-Logs-Url: https://github.com/randerzander/NeMo-Retriever/sessions/037c979d-5620-42c2-96a4-bbd162fb8e02
…uild.nvidia.com" preset

Co-authored-by: randerzander <1692914+randerzander@users.noreply.github.com>
Agent-Logs-Url: https://github.com/randerzander/NeMo-Retriever/sessions/d4532bf9-2c7e-4ca1-be3c-8adcbf4b1b2b
Add `inference="build.nvidia.com"` preset to `create_ingestor()` and fix `NVIDIA_API_KEY` propagation
@randerzander randerzander requested a review from a team as a code owner March 21, 2026 23:58
@randerzander randerzander requested a review from jioffe502 March 21, 2026 23:58
@copy-pr-bot
Copy link

copy-pr-bot bot commented Mar 21, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@randerzander
Copy link
Collaborator Author

partially addresses #1669

@sosahi sosahi requested a review from a team as a code owner March 24, 2026 02:09
@sosahi sosahi requested review from a team and edknv and removed request for a team March 24, 2026 02:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants