Skip to content

qwen4exp: load the MTP head's hc_head_norm as [n_embd, hc] like the trunk gammas - #219

Merged
danielhanchen merged 2 commits into
unslothai:mtp/qwen4exp-nextnfrom
LeoBorcherding:fix/qwen4exp-nextn-hc-head-norm
Sep 18, 2026
Merged

qwen4exp: load the MTP head's hc_head_norm as [n_embd, hc] like the trunk gammas#219
danielhanchen merged 2 commits into
unslothai:mtp/qwen4exp-nextnfrom
LeoBorcherding:fix/qwen4exp-nextn-hc-head-norm

qwen4exp: let the memory fit measure a borrowing draft head

fafa22f
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar