Add MTP cuda graph support#2

santhnm2 wants to merge 3 commits into

ArEsKay3:rkirby/ultra_hacks_3_25ArEsKay3/Megatron-LM:rkirby/ultra_hacks_3_25from

santhnm2:ultra_hacks_mtp_perfsanthnm2/Megatron-LM:ultra_hacks_mtp_perfCopy head branch name to clipboard