Skip to content

feat: sync llama.cpp to b10951 - #394

Merged
jhen0409 merged 5 commits into
mainfrom
auto/sync-llama.cpp
Sep 14, 2026
Merged

jhen0409 merged 5 commits into
mainfrom
auto/sync-llama.cpp

Conversation

@github-actions

@github-actions github-actions Bot commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

🤖 Automated llama.cpp sync

This PR was automatically created/updated by the daily sync workflow.

Changes:

  • Updated the vendored llama.cpp (vendor/llama.cpp) from b10829 to b10951
  • Re-applied scripts/patches and regenerated version files

Verification:

  • ✅ Vendor sync, scripts/update-llama-cpp.sh
  • 🚫 Android libraries build (cancelled)
  • 🚫 iOS frameworks build (cancelled)
  • ⏭️ C++ unit tests (skipped)
  • ⏭️ TypeScript build (skipped)

⚠️ Some steps failed. Check the workflow run for logs. Fixes can be pushed to auto/sync-llama.cpp directly: while this PR stays open, later sync runs build on top of the branch instead of resetting it.

📋 llama.cpp changes (b10829 → b10951)
  • 093a2f8 common : move llama_n_rs_seq to before llama_decode (#28749)
  • ad6c668 ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846)
  • 7a16a6c grammar : coalesce find + insert into a single insert and adjust move/copy mechanics (#26885)
  • 5f436dd tests : exclude HY_V4 from WebGPU test-llama-archs tests (#28855)
  • e49d2c2 models : guard the expert FFN size fallback in nemotron-h against a zero divisor (#28779)
  • 6978052 ggml-cpu(s390x): guard VXE-only repack helpers (#28775)
  • 243a308 tests : fix typo in test-quant-type-selection for nemotron 3 nano (#28835)
  • b6b003d sycl : Fix get mem error (#28227)
  • c95f8e4 ci : run editorconfig and code-style checks on ubuntu-slim (#28854)
  • bc52a12 pi : prefer PI_MODEL_NAME env var for model disclosure (#28853)
  • 4a89937 tests : reduce FA test sizes (#28842)
  • 37b3a9e ci : remove leftover command (#28839)
  • 002a12a ci : cap test-backend-ops parallel jobs at 2 and add a 3600s timeout (#28833)
  • f1e44dc vulkan: workaround NV queuesubmit driver bug (#28830)
  • 56b9eb2 opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0, not just q6_K (#28575)
  • 790cf51 chat : improve parsing of complex types in qwen3-coder (#28742)
  • 8e33095 common: add LOG_JSON macro to log structured data (#28586)
  • acecd56 common : implement common_schema internal representation for JSON schemas (#28736)
  • ae9afff jinja : support dot property integer literals (#28817)
  • 737e098 cmake: leave the timestamp out of precompiled headers on clang (#28816)
  • 3057bb6 ui : add cache (#28802)
  • 56381e4 server : allow model downloads at model limit fix issue #26809 (#28530)
  • c8edceb ggml-cuda: hip add specific config table for AMD GCN (#27841)
  • e192abb server : add missing headers (#28795)
  • 718f7b4 vendor : update cpp-httplib to 0.56.0 (#28787)
  • 2a3005c syscl : Handle (fail gracefully) unsupported tq1_0 quants (#28681)
  • f3a33df rpc : fix linking when compiling with BUILD_SHARED_LIBS=OFF (#28492)
  • c069aa7 server: frame the router child state command as a whole line (#28747)
  • 8a56aed opencl: fix several bugs where the backend aborts (#27630)
  • 07fc977 opencl: add bin kernel kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin (#28677)
  • 3f5e94d webgpu: align tensor bindings to the type block size (#28382)
  • eafe15a hexagon: support for multi-device model split (aka row-split) (#28589)
  • d3146f2 ggml-webgpu: Update to a recent version of Dawn (#28683)
  • 82d6bb2 server: refactor subproc handling (#28555)
  • 8ea2902 cmake : skip PCH for llama-server PCH when using MSVC (#28763)
  • b78a39a ci : run test-backend-ops as a dedicated ci/run.sh test (#28740)
  • 982937a tests: extend test-quantize-fns to test nrc=2 (i8mm) kernels (#16234)
  • 8172e65 tests: tolerate a shared pool abort in test_completion_unified (#28759)
  • 43f3dda ggml: skip 0-sized ids tensor when offloading selected experts (#28739)
  • 5bda51b metal : skip the empty half of the mul_mm_id token tile (#28301)
  • 3bcfeb7 cmake : add PCH and unity build to improve build times (#28091)
  • 1dfe94e common : fix typo in speculative.cpp comment [no ci] (#28750)
  • a2878d3 metal : single-source fusion table + fusion debug rework (#28164)
  • aac8102 metal : fix idle threads in the remaining iq mul_mv kernels for ne00 < 1024 (#28692)
  • 5cdd3d1 model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (#28630)
  • b0dcb81 server: fix speculation after an image (#28715)
  • 16378d9 CUDA/HIP: Flash Attention tuning (gfx1201) (#28102)
  • 451b89b ci : key cache to sanitizer matrix (#28708)
  • 481c65f vulkan: fix data race and OOB access in argsort(large) (#28705)
  • df03399 opencl: add A8 Q4_0 mm binary kernel support (#28268)

Please review and merge if all checks pass.

github-actions Bot and others added 2 commits September 14, 2026 06:17
…atch for b10951

llama.cpp b10951 moved the specialized chat template parsers out of
common/chat.cpp into common/parsers/ (one file each) and added
common/json-schema.{h,cpp}, so the chat.cpp patch that added the
FunctionGemma parser no longer applied and the tree did not compile.

- sync-vendor.sh: export common/parsers and common/json-schema.*; prune
  parsers/sources.cmake like the other upstream build files
- rnllama-sources.cmake: glob common/parsers/*.cpp (the podspec already
  takes common/**)
- FunctionGemma parser becomes common/parsers/function-gemma.cpp with
  its declaration in parsers/parsers.h, following the upstream split, and
  uses common_chat_tool_parameters() since the common_schema refactor
  dropped common_grammar_builder::resolve_refs
- chat.cpp.patch keeps only the detection hook, content-part extra
  fields and template caps/variant helpers
- sync-vendor.sh: record the resolved commit before applying patches and
  drop .orig/.rej leftovers even when a patch fails, so a partial sync
  committed for fixing has a correct pin and no junk files
- drop the .orig/.rej files the failed CI sync committed and fix the
  stale LLAMA_CPP_COMMIT pin
@jhen0409
jhen0409 merged commit 4fd06f3 into main Sep 14, 2026
6 checks passed
@jhen0409
jhen0409 deleted the auto/sync-llama.cpp branch September 14, 2026 09:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant