Mixture of Experts - #2

Open

dan-smith-tech wants to merge 9 commits into

EveNet-HEP:mainfrom

dan-smith-tech:main

Commits on Mar 31, 2026

copy files that are same
dan-smith-tech
committed
6606c03
add moe loss
dan-smith-tech
committed
a3b4c3d
Revert "add moe loss"
dan-smith-tech
committed
4a87ebd
Revert "copy files that are same"
dan-smith-tech
committed
dad72b6
Add MoE architecture to transformer, embedding, model, and loss

dan-smith-tech
and
Copilot
committed
fd88624

Commits on Apr 8, 2026

add extensive moe logging
dan-smith-tech
committed
eac4a9e

Commits on Apr 9, 2026

log expert usage distribution
dan-smith-tech
committed
ebf8e89
logging
dan-smith-tech
committed
96bffdd

Commits on Apr 10, 2026

fix logging
dan-smith-tech
committed
2f66c19