Bump llama.cpp to a646006 (b9932) for v0.8.34#68
Merged
Conversation
Submodule cb295bf59 -> a646006f0 (44 commits). Header diffs in the range are additive only (Q2_0 quant enums, common_speculative_init_result helper, server_base param) — no NIF changes required. Full suite against the rebuilt NIF: 191 tests, 0 failures. Also documents speculative-type support status (MTP only) in README and the MTP moduledoc, including measured DFlash-on-Metal results at b9932.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
vendor/llama.cppfrom cb295bf59 to a646006f0 (44 commits, tagb9932) and bumps the package version to v0.8.34.
changed additively only: new
Q2_0quant enum values inggml.h/llama.h, anew
common_speculative_init_resulthelper incommon/speculative.h, and aserver_basefield +<fstream>include incommon/common.h.LlamaCppEx.MTPmoduledoc): the binding exposes MTP only; DFlash/EAGLE-3/n-gram exist upstream
behind the same
common_speculativeAPI but are not reachable throughspeculative_inityet.DFlash on Apple Silicon (tested at b9932, M4 Max)
Ran upstream
llama-clibuilt from this exact submodule commit with--spec-type draft-dflash, Qwen3.5-4B Q4_K_XL target + z-lab 0.6B drafter(f16):
Functional end-to-end on Metal, but net slower at this target size — same
wide-verify-batch economics as the MTP note in the README. Community
drafter-GGUF conversions are also still incompatible across converter
revisions (upstream
#25116 arch mismatch,
#25110 metadata refactor);
of three third-party drafter repos tested, only one loads with current
upstream. Documented in the README rather than exposed as a feature.
Testing
mix test --include smokewith local gen/embedding models → 191 passed, 0 failures, 4skipped.
checksum.exsintentionally untouched — CI regenerates it after the releasetag.