Skip to content

feat: add router architecture deployment configs for multi-model production setup - #170

Open
blefo wants to merge 3 commits into
mainfrom
feat-router-configuration
Open

feat: add router architecture deployment configs for multi-model production setup#170
blefo wants to merge 3 commits into
mainfrom
feat-router-configuration

fix: adjust GPU memory utilization to 0.20 in Docker Compose for Qwen…

639e69f
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar