docs: clarify CPU-only runtime path - #2134
Conversation
Greptile SummaryThis PR adds a single clarifying bullet to the "Preparation" section of
Confidence Score: 5/5Documentation-only change with no impact on runtime behaviour; safe to merge. The diff is five lines of Markdown inserted as a bullet point. The linked file ( Files Needing Attention: No files require special attention.
|
| Filename | Overview |
|---|---|
| doc/en/install.md | Adds a 5-line note clarifying the CUDA GPU requirement for local_chat / ktransformers.server and linking CPU-only users to the llamafile operator guide. The referenced file exists and the link is well-formed. |
Flowchart
%%{init: {'theme': 'neutral'}}%%
flowchart TD
A[User reads install.md] --> B{Has a CUDA-capable GPU?}
B -- Yes --> C[Follow CUDA setup steps]
C --> D[local_chat / ktransformers.server\nCPU-GPU heterogeneous inference]
B -- No --> E[CPU-only path]
E --> F[Use KT-Kernel CPU backends\ne.g. LLAMAFILE with GGUF weights]
F --> G[See llamafile operator guide]
Reviews (2): Last reviewed commit: "[docs]: clarify CPU-only install guidanc..." | Re-trigger Greptile
|
Thanks for the review — I pushed Changes made:
Validation:
|
Summary
local_chat/ktransformers.serverexamples indoc/en/install.mdtarget CPU-GPU heterogeneous inference and require a CUDA-capable GPU.LLAMAFILEwith GGUF weights.Refs #337
Test Plan
pythondocumentation guard check for the new CPU-only runtime notegit diff --check HEAD~1..HEAD