Skip to content

Switch to vLLM with custom stopping criteria#9

Open
lee101 wants to merge 1 commit into
mainfrom
codex/migrate-inference-server-to-vllm
Open

Switch to vLLM with custom stopping criteria#9
lee101 wants to merge 1 commit into
mainfrom
codex/migrate-inference-server-to-vllm

Add vLLM inference integration

c870079
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs