diff --git a/README.md b/README.md index e587cfd3..eff50cfd 100644 --- a/README.md +++ b/README.md @@ -37,15 +37,15 @@ For more details, please see our [website](https://routeworks.github.io/leaderbo | Rank | Router | Affiliation | Acc-Cost Arena | Accuracy | Cost/1K Queries | Optimal Selection | Optimal Cost | Optimal Accuracy | Latency | Robustness | |------|--------------------|-----------------------------|--------|----------|---------|-----------------|--------------|----------------|---------|------------| -| πŸ₯‡ | [Sqwish Router](https://www.sqwish.ai/) | πŸ‘€ [@namitha-sqwish](https://github.com/namitha-sqwish) | 75.27 | 76.40 | $0.18 | 7.41 | 25.10 | 90.47 | β€” | 100.00 | -| πŸ₯ˆ | [AgentForge Router]() | πŸ‘€ [@YangY-Z](https://github.com/YangY-Z) | 74.13 | 74.72 | $0.13 | 17.84 | 52.47 | 98.68 | β€” | 40.48 | -| πŸ₯‰ | [Nadir Router](https://github.com/NadirRouter/NadirClaw) | πŸŽ“ NadirRouter | 73.33 | 74.87 | $0.29 | β€” | β€” | β€” | β€” | 25.48 | -| 4 | [Weave Router](https://workweave.ai) | πŸŽ“ Weave | 72.82 | 76.32 | $0.94 | β€” | β€” | β€” | β€” | 100.00 | -| 5 | [OrcaRouter‑Adaptive](https://www.orcarouter.ai/) [[Code]](https://github.com/Continuum-AI-Corp/OrcaRouter-Lite) [[Paper]](https://arxiv.org/abs/2605.30736) [[X]](https://x.com/orcarouter) | πŸŽ“ [Continuum AI](https://www.continuum01.ai/) | 72.08 | 75.54 | $1.00 | β€” | β€” | β€” | β€” | 22.62 | -| 6 | [Azure-Model-Router](https://ai.azure.com/catalog/models/model-router) [[Web]](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/model-router) | πŸ’Ό Microsoft | 71.87 | 72.82 | $0.22 | β€” | β€” | β€” | β€” | 71.43 | -| 7 | [R2-Router](https://arxiv.org/abs/2602.02823/) | πŸŽ“ UCF | 71.60 | 71.23 | $0.06 | 24.51 | 48.70 | 99.85 | β€” | 45.71 | -| 8 | [Auto Router]() | πŸ‘€ [@cxf2015](https://github.com/cxf2015) | 70.05 | 70.17 | $0.12 | 37.58 | 40.02 | 86.04 | β€” | 49.52 | -| 9 | [vLLM‑SR](https://vllm-semantic-router.com/) [[Code]](https://github.com/vllm-project/semantic-router) [[HF]](https://huggingface.co/llm-semantic-router) | πŸŽ“ vLLM SR Team | 67.23 | 66.53 | $0.06 | 84.66 | 90.71 | 89.24 | β€” | 90.95 | +| πŸ₯‡ | [vLLM‑SR](https://vllm-semantic-router.com/) [[Code]](https://github.com/vllm-project/semantic-router) [[HF]](https://huggingface.co/llm-semantic-router) | πŸŽ“ vLLM SR Team | 75.38 | 75.97 | $0.11 | 20.12 | 24.52 | 89.87 | β€” | 73.10 | +| πŸ₯ˆ | [Sqwish Router](https://www.sqwish.ai/) | πŸ‘€ [@namitha-sqwish](https://github.com/namitha-sqwish) | 75.27 | 76.40 | $0.18 | 7.41 | 25.10 | 90.47 | β€” | 100.00 | +| πŸ₯‰ | [AgentForge Router]() | πŸ‘€ [@YangY-Z](https://github.com/YangY-Z) | 74.13 | 74.72 | $0.13 | 17.84 | 52.47 | 98.68 | β€” | 40.48 | +| 4 | [Nadir Router](https://github.com/NadirRouter/NadirClaw) | πŸŽ“ NadirRouter | 73.33 | 74.87 | $0.29 | β€” | β€” | β€” | β€” | 25.48 | +| 5 | [Weave Router](https://workweave.ai) | πŸŽ“ Weave | 72.82 | 76.32 | $0.94 | β€” | β€” | β€” | β€” | 100.00 | +| 6 | [OrcaRouter‑Adaptive](https://www.orcarouter.ai/) [[Code]](https://github.com/Continuum-AI-Corp/OrcaRouter-Lite) [[Paper]](https://arxiv.org/abs/2605.30736) [[X]](https://x.com/orcarouter) | πŸŽ“ [Continuum AI](https://www.continuum01.ai/) | 72.08 | 75.54 | $1.00 | β€” | β€” | β€” | β€” | 22.62 | +| 7 | [Azure-Model-Router](https://ai.azure.com/catalog/models/model-router) [[Web]](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/model-router) | πŸ’Ό Microsoft | 71.87 | 72.82 | $0.22 | β€” | β€” | β€” | β€” | 71.43 | +| 8 | [R2-Router](https://arxiv.org/abs/2602.02823/) | πŸŽ“ UCF | 71.60 | 71.23 | $0.06 | 24.51 | 48.70 | 99.85 | β€” | 45.71 | +| 9 | [Auto Router]() | πŸ‘€ [@cxf2015](https://github.com/cxf2015) | 70.05 | 70.17 | $0.12 | 37.58 | 40.02 | 86.04 | β€” | 49.52 | | 10 | [MIRT‑BERT](https://arxiv.org/pdf/2506.01048) [[Code]](https://github.com/Mercidaiha/IRT-Router) | πŸŽ“ USTC | 66.89 | 66.88 | $0.15 | 3.44 | 19.62 | 78.18 | 27.03 | 61.19 | | 11 | [NIRT‑BERT](https://arxiv.org/pdf/2506.01048) [[Code]](https://github.com/Mercidaiha/IRT-Router) | πŸŽ“ USTC | 66.12 | 66.34 | $0.21 | 3.83 | 14.04 | 77.88 | 10.42 | 49.29 | | 12 | [GPT‑5](https://openai.com/index/introducing-gpt-5/) | πŸ’Ό OpenAI | 64.32 | 73.96 | $10.02 | β€” | β€” | β€” | β€” | β€” |