docs: document Qwen3-Next balance serve build - #2137
Conversation
Greptile SummaryThis PR adds inline build steps for enabling the
Confidence Score: 5/5Documentation-only change that adds a missing build step and a troubleshooting note; no code is affected. The change is confined to a single markdown file. The added shell commands are technically correct, the working-directory issue from the prior review is resolved with Files Needing Attention: No files require special attention.
|
| Filename | Overview |
|---|---|
| doc/en/Qwen3-Next.md | Adds USE_BALANCE_SERVE=1 build block and sched_ext troubleshooting note to Section 3; working-directory and Installation Guide link concerns from prior review are both addressed. |
Flowchart
%%{init: {'theme': 'neutral'}}%%
flowchart TD
A[Reader starts Qwen3-Next setup] --> B[Section 2: Download model via huggingface-cli]
B --> C[Section 3: Check prerequisites via Installation Guide]
C --> D["git clone + git submodule update --init --recursive"]
D --> E["USE_BALANCE_SERVE=1 bash ./install.sh"]
E --> F{Build succeeded?}
F -- Yes --> G["cd .. (restore parent dir)"]
F -- No / ModuleNotFoundError: sched_ext --> H[Re-run install in clean environment]
H --> E
G --> I["Section 4: python ktransformers/server/main.py --backend_type balance_serve"]
I --> J[Section 5: curl /v1/chat/completions]
Reviews (2): Last reviewed commit: "[docs]: align Qwen3-Next install flow" | Re-trigger Greptile
|
Thanks for the review — I pushed Changes made:
Validation:
|
Summary
USE_BALANCE_SERVE=1 bash ./install.shbuild step to the Qwen3-Next tutorial.ModuleNotFoundError: No module named 'sched_ext'means thebalance_servescheduler extension was not built in the active environment.Refs #1514
Test Plan
pythondocumentation guard check for the new Qwen3-Nextbalance_servebuild guidancegit diff --check HEAD~1..HEAD