fix(rl): reduce Megatron memory usage in selective_log_softmax, causal mask, and discarded logits - #283
Open
Wings-Of-Disaster wants to merge 3 commits into
Open
fix(rl): reduce Megatron memory usage in selective_log_softmax, causal mask, and discarded logits#283Wings-Of-Disaster wants to merge 3 commits into
Wings-Of-Disaster wants to merge 3 commits into
