Before you start
What happened
Observation:
- The NVFP4 variant works fine, proving FreeToken underlying llama.cpp does support qwen35moe architecture.
- The broken local‑imported Q4_K_M model shows
ctx: 0 in model list, while the working NVFP4 shows correct ctx: 262144.
- Both files are Qwen3.6‑35B‑A3B MoE (
qwen35moe).
To Reproduce
- Local‑import GGUF:
Qwen3.6‑35B‑A3B‑Uncensored‑HauhauCS‑Aggressive.Q4_K_M.gguf
- Click start button to launch model
- Engine popup:
引擎故障 ValueError: GGUF architecture 'qwen35moe' is not supported
Expected behavior
Should load the qwen35moe MoE model same as the official NVFP4 quantized version.
Screenshots
(paste your two screenshots here)
Environment
- OS: Windows
- FreeToken version: [fill your version]
- Working model:
Qwen3.6‑35B‑A3B NVFP4 (19.5GiB, MoE tag shown, ctx=262144)
- Broken model:
Qwen3.6‑35B‑A3B‑Uncensored‑HauhauCS‑Aggressive Q4_K_M (19.7GiB, local‑imported, ctx=0)
Additional context
Hypothesis:
- The secondary‑tuned GGUF file may have corrupted GGUF header metadata, even though
general.architecture="qwen35moe".
- FreeToken / backend parser somehow rejects this specific file, even though same‑architecture NVFP4 works.
- The
ctx:0 status indicates metadata fields are not correctly parsed from this local imported GGUF.
Maybe FreeToken’s GGUF metadata validator has strict checks that reject this specific file, while upstream llama.cpp can handle it.
Desktop app version
0.2.0 beta 17
OS
Windows 11
OS details
No response
GPU and driver
4070ti surper
CPU and system RAM
9950x 64G
Checkpoint
Qwen3.6‑35B‑A3B‑Uncensored‑HauhauCS‑Aggressive Q4_K_M
Model settings
No response
Engine log
Anything else
No response
Before you start
What happened
Observation:
ctx: 0in model list, while the working NVFP4 shows correctctx: 262144.qwen35moe).To Reproduce
Qwen3.6‑35B‑A3B‑Uncensored‑HauhauCS‑Aggressive.Q4_K_M.gguf引擎故障 ValueError: GGUF architecture 'qwen35moe' is not supportedExpected behavior
Should load the qwen35moe MoE model same as the official NVFP4 quantized version.
Screenshots
(paste your two screenshots here)
Environment
Qwen3.6‑35B‑A3B NVFP4(19.5GiB, MoE tag shown, ctx=262144)Qwen3.6‑35B‑A3B‑Uncensored‑HauhauCS‑Aggressive Q4_K_M(19.7GiB, local‑imported, ctx=0)Additional context
Hypothesis:
general.architecture="qwen35moe".ctx:0status indicates metadata fields are not correctly parsed from this local imported GGUF.Maybe FreeToken’s GGUF metadata validator has strict checks that reject this specific file, while upstream llama.cpp can handle it.
Desktop app version
0.2.0 beta 17
OS
Windows 11
OS details
No response
GPU and driver
4070ti surper
CPU and system RAM
9950x 64G
Checkpoint
Qwen3.6‑35B‑A3B‑Uncensored‑HauhauCS‑Aggressive Q4_K_M
Model settings
No response
Engine log
Anything else
No response