docs: add flash-attn import troubleshooting - #2133
Conversation
Greptile SummaryThis PR adds a flash-attn import troubleshooting block to the installation guide, addressing issue #944. The addition covers the
Confidence Score: 5/5Documentation-only change with no runtime impact; the link target and diagnostic command are both correct. The change adds a self-contained troubleshooting block to a Markdown file. The Files Needing Attention: No files require special attention.
|
| Filename | Overview |
|---|---|
| doc/en/install.md | Adds 12-line troubleshooting block for flash-attn import errors; link target and diagnostic command are both valid. |
Flowchart
%%{init: {'theme': 'neutral'}}%%
flowchart TD
A[flash_attn_func NameError at runtime] --> B{Run import check}
B --> |"python -c 'from flash_attn import flash_attn_func'"| C{Import succeeds?}
C --> |Yes| D[Reinstall KTransformers / check sys.path]
C --> |No| E{Using balance_serve backend?}
E --> |Yes| F[Follow balance-serve FlashInfer note\nDo NOT replace patched FlashInfer]
E --> |No| G[Download matching flash-attn wheel\nPython + CUDA + PyTorch + C++ ABI]
G --> H[Reinstall wheel & retry]
Reviews (2): Last reviewed commit: "[docs]: refine flash-attn troubleshootin..." | Re-trigger Greptile
|
Thanks for the review — I pushed Changes made:
Validation:
|
Summary
NameError: name 'flash_attn_func' is not definedin the install guide.flash-attnwheel must match Python / PyTorch / CUDA / C++ ABI.balance_serveusers to the patched FlashInfer note instead of replacing that package.Refs #944
Test Plan
pythondocumentation guard check for the new flash-attn troubleshooting text and link targetgit diff --check HEAD~1..HEAD