glm5next: avoid soft_max gridDim.y overflow in the indexer - #28727

Closed

AIalliAI wants to merge 45 commits into

ggml-org:masterfrom

AIalliAI:fix/glm5next-kpool-softmax-grid-y

Commits on Aug 26, 2026

llama: load glm5next hparams and tensors

danielhanchen
authored and
danielhanchen
committed
a505a75
llama: add glm5next mHC wide residual

danielhanchen
authored and
danielhanchen
committed
9e1cc20
llama: add glm5next KDA linear attention
danielhanchen
committed
20a8077
llama: add glm5next MoE feed-forward with clamped SwiGLU
danielhanchen
committed
1d99a5a
llama: add glm5next dense DSA attention
danielhanchen
committed
f320a28
llama: save the indexer kpool and hyper-connection keys
danielhanchen
committed
7f2560e
test-llama-archs: enable glm5next
danielhanchen
committed
cd69d60
llama: assert the glm5next indexer selection width
danielhanchen
committed
6a58359
glm5next: trim DSA dense comments
danielhanchen
committed
3841592
llama: third kv cache for the glm5next lightning indexer
danielhanchen
committed
2db8295
glm5next: trim pooled indexer comments
danielhanchen
committed
839597c
glm5next: lightning indexer graph, pooled sparse selection

danielhanchen
authored and
danielhanchen
committed
8c49836
mtmd: don't normalize patch embeddings when norm_embd is absent
danielhanchen
committed
fe95953
convert: refuse to write a GGUF with zero tensors
danielhanchen
committed
582fe81
mtmd: add glm5next (GLM-5.3-Flash) vision tower
danielhanchen
committed
9901ab4
mtmd: implement the glm5next 0826 image preprocessor
danielhanchen
committed
41cd923
mtmd: resample glm5next images with bicubic, matching the reference
danielhanchen
committed
02fa4a4
llama: enable ignore_merges for the glm4 pre-tokenizer

danielhanchen
authored and
danielhanchen
committed
81e3e67
llama: shorten comment
danielhanchen
committed
2d9570d
glm5next: repair conflict resolution from the rebase onto master
danielhanchen
committed
6c59f9b

Commits on Aug 27, 2026

glm5next: do not inherit deepseek4's n_embd_out
danielhanchen
committed
eab9ee9
glm5next: keep precision-sensitive tensors at source precision
danielhanchen
committed
869e878
glm5next: restore the vision preprocessor tests
danielhanchen
committed
282ef61
glm5next: fix E301 lint in gguf_writer
danielhanchen
committed
cadbe97
glm5next: pool the indexer per sequence so a unified KV cache works
danielhanchen
committed
204fa70
glm5next: test the per-sequence pool runs instead of the old refusal
danielhanchen
committed
ef531f8
glm5next: store the indexer selection masks in f16

danielhanchen
authored and
danielhanchen
committed
e88c92d
glm5next : use the fused lightning indexer for the pool scores

danielhanchen
authored and
danielhanchen
committed
2e0e57f

Commits on Aug 28, 2026

Commits on Aug 30, 2026

Commits on Aug 31, 2026

glm5next: cut comments
danielhanchen
committed
949f7ef

Commits on Sep 4, 2026

Fix merge conflicts
danielhanchen
committed
caeff2e
conversion: drop the double blank lines flake8 flags in glm5next
danielhanchen
committed
629b505

Commits on Sep 7, 2026

Fix merge conflicts
danielhanchen
committed
b9b8207

Commits on Sep 10, 2026

Merge upstream master into glm5next
danielhanchen
committed
2af9da2
glm5next: use ggml_prec_set_acc for the indexer weights
danielhanchen
committed
d94f44e

Commits on Sep 11, 2026

glm5next: avoid soft_max gridDim.y overflow in the indexer
AIalliAI
committed
2dc7307
glm5next: clarify soft_max gridDim comment
AIalliAI
committed
d798de9