Swiglu? #14
Description
The paper mentions that you found swiglu to work better than gelu. But i dont see any mention of swiglu here
{{ message }}
The paper mentions that you found swiglu to work better than gelu. But i dont see any mention of swiglu here