I am trying to set up the SGLang backend in a CUDA 12.8 environment, but the standard install path fails:
uv pip install -e ".[sglang]"
Environment:
CUDA: 12.8
Python: 3.11
Install command: uv pip install -e ".[sglang]"
Backend: sglang
From pyproject.toml, the SGLang extra currently depends on:
sglang[all] @ git+https://github.com/sgl-project/sglang.git@refs/pull/23000/head#subdirectory=python
However, when installing in a CUDA 12.8 environment, many dependencies appear to resolve toward CUDA 13.0 / newer SGLang-compatible packages, and the installation fails. My guess is that the latest SGLang PR dependency may currently assume or prefer CUDA 13.0-compatible packages, while CUDA 12.8 is still common in cloud environments.
Would it be possible to provide one of the following?
- A recommended installation command for CUDA 12.8.
- A known-good constraints file for
uv pip install -e ".[sglang]".
- A pinned SGLang commit/PR that works with CUDA 12.8.
- An official Docker image for the SGLang backend.
- Documentation clarifying which CUDA / PyTorch / SGLang versions are expected to work.
For example, a CUDA 12.8 setup guide could specify the exact compatible versions of:
torch
torchvision
torchaudio
sglang
flashinfer
cuda-python
transformers
This would make it much easier to reproduce the SGLang backend environment reliably.
Thanks!
I am trying to set up the SGLang backend in a CUDA 12.8 environment, but the standard install path fails:
uv pip install -e ".[sglang]"Environment:
From
pyproject.toml, the SGLang extra currently depends on:However, when installing in a CUDA 12.8 environment, many dependencies appear to resolve toward CUDA 13.0 / newer SGLang-compatible packages, and the installation fails. My guess is that the latest SGLang PR dependency may currently assume or prefer CUDA 13.0-compatible packages, while CUDA 12.8 is still common in cloud environments.
Would it be possible to provide one of the following?
uv pip install -e ".[sglang]".For example, a CUDA 12.8 setup guide could specify the exact compatible versions of:
This would make it much easier to reproduce the SGLang backend environment reliably.
Thanks!