Fold the sigmoid gate into the causal-attention reduce epilogue: operator -8.3% where it folds, +0.31% decode - #225

Fold the sigmoid gate into the causal-attention reduce epilogue: operator -8.3% where it folds, +0.31% decode#225

MichaelDementii wants to merge 3 commits into

Neroued:masterNeroued/ninfer:masterfrom

MichaelDementii:perf/attention-fused-sigmoid-gateMichaelDementii/ninfer:perf/attention-fused-sigmoid-gateCopy head branch name to clipboard