llmrouter

Here are 3 public repositories matching this topic...

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.

golang openai openai-api llm llm-serving llamacpp vllm localllm ai-gateway localllama llmrouter

web www llmrouter radlabdev

Add a description, image, and links to the llmrouter topic page so that developers can more easily learn about it.

To associate your repository with the llmrouter topic, visit your repo's landing page and select "manage topics."