Skip to content

Bump llama.cpp to b3ce5ce (b9789), release v0.8.29#61

Merged
nyo16 merged 1 commit into
masterfrom
bump-llama-cpp-b9789
Jun 25, 2026
Merged

Bump llama.cpp to b3ce5ce (b9789), release v0.8.29#61
nyo16 merged 1 commit into
masterfrom
bump-llama-cpp-b9789

Conversation

@nyo16

@nyo16 nyo16 commented Jun 25, 2026

Copy link
Copy Markdown
Owner

Update vendor/llama.cpp submodule from dec5ca557 to b3ce5cedf (26 commits, tag b9789) and cut release v0.8.29.

NIF changes

None. include/llama.h, the ggml headers, and common/{json-schema-to-grammar,sampling,speculative}.h are all unchanged. The two binding-compiled headers that did change touch only server-side code:

  • common/common.h — bumps a server default (checkpoint_min_step 256 → 8192).
  • common/chat.h — reworks the chat message-splitting API (common_chat_msg_span.role becomes a common_chat_role enum; new common_chat_msg_spans / common_chat_msg_delimiters containers replace
    the free-standing common_chat_split_by_role; common_chat_params.message_spansmessage_delimiters). All consumed by the server, not the binding.

The NIF only calls common_chat_templates_inputs, common_chat_msg, and common_chat_templates_apply. The implementation behind that last call (common/chat.cpp) was refactored as part of the same
work, so the chat-template smoke path was re-exercised against the freshly built NIF.

Notable upstream changes

  • model: LFM2.5-ColBERT-350M, LFM2.5-Embedding-350M (#24913); Granite Speech Plus (#24818)
  • quant: fix quantizing MoE with MTP (#24986)
  • server: draft-context error checks (#24922), remote preset fix (#24938), per-user-message checkpoints (#24176)
  • vulkan / sycl / opencl / hexagon: broad backend fixes and op coverage (FA bias-before-softmax overflow fix #24909, GET_ROWS_BACK #24883, CONV_3D #24612, hexagon MUL_MAT rework #24954, etc.)

Full list in CHANGELOG.md.

Verification

  • Full test suite: 158 passed, 4 skipped
  • Smoke tests (--include smoke): 7 passed — generation, streaming, chat templates, JSON-schema grammar, raw GBNF, embeddings (Qwen3-Embedding model)
  • mix format --check-formatted: clean
  • mix dialyzer: 0 errors

checksum.exs intentionally untouched — CI regenerates it from the release artifacts after the tag is pushed.

Update vendor/llama.cpp submodule from dec5ca557 to b3ce5cedf (26 commits,
tag b9789) and cut release v0.8.29.

No NIF changes required. include/llama.h, the ggml headers, and
common/{json-schema-to-grammar,sampling,speculative}.h are all unchanged.
The two binding-compiled headers that did change touch only server-side
code: common/common.h bumps a server default (checkpoint_min_step), and
common/chat.h reworks the chat message-splitting API (role enum, new
*_spans/*_delimiters containers, message_spans -> message_delimiters) used
by the server, not the binding. The NIF only calls common_chat_templates_*
and common_chat_msg; the underlying common/chat.cpp was refactored as part
of that work, so the chat-template smoke path was re-verified.

Verification: full suite 158 passed / 4 skipped, all 7 smoke tests pass
(generation, streaming, chat, JSON-schema grammar, raw GBNF, embeddings),
mix format clean, Dialyzer 0 errors.
@nyo16 nyo16 merged commit 27cabce into master Jun 25, 2026
4 checks passed
@nyo16 nyo16 deleted the bump-llama-cpp-b9789 branch June 25, 2026 20:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant