remove api keys from metadata build

[nadolskit]

No description provided.

[Copilot]

Pull Request Overview

This PR refactors how API keys are supplied by removing them from each model's metadata and centralizing them in the ENV_VARS block.

• Uncomment loading of OPENAI_API_KEY and ANTHROPIC_API_KEY in ENV_VARS
• Remove api_key entries from each model's litellm_params

Comments suppressed due to low confidence (2)

src/scripts/deploy.py:55

• Removing the per-model api_key from litellm_params will prevent each model from receiving credentials unless you explicitly inject them elsewhere. Consider updating the model initialization to merge in the global API key (e.g., add a lookup for ENV_VARS["ANTHROPIC_API_KEY"] or ENV_VARS["OPENAI_API_KEY"]).

"litellm_params": {

src/scripts/deploy.py:19

• Add an explicit validation step for OPENAI_API_KEY and ANTHROPIC_API_KEY at startup (e.g., check os.getenv and raise a clear error) rather than relying on a raw KeyError when accessing os.environ. This provides more user-friendly diagnostics.

"OPENAI_API_KEY": os.environ["OPENAI_API_KEY"],

[jamesbraza]

Any chance you can add a ValueError special case somewhere if there is an api_key in litellm_params? Just thinking about catching this moving forward

[nadolskit]

we can totally do that on the server side of the platform 🫡