Thanks for building SonicMoE. the perf looks good; excited to try it out. Would you happen to have any guidance on how to use it in Megatron-LM?
Thanks for building SonicMoE. the perf looks good; excited to try it out.
Would you happen to have any guidance on how to use it in Megatron-LM?