could you offer an example of fp8 gemm with scale for SM90

[kousakawang]

I note in this https://github.com/Dao-AILab/quack/blob/main/benchmarks/benchmark_gemm_sm90.py,
Since most fp8 Gemm case, we need to do it with A/B's scale(column major scale). If possible, maybe we can add scale to FP8 Gemm case?

[tridao]

Cool, it’s not hard. Most of the pieces are there, eg colvec and rowvec can be loaded. You can just change the math to multiply w those vectors. Can you send a PR?

[kousakawang]

Cool, it’s not hard. Most of the pieces are there, eg colvec and rowvec can be loaded. You can just change the math to multiply w those vectors. Can you send a PR?

Sorry for this 🥹, Since I am not familiar with cuteDSL, I just look for your help (since we plan to replace our c++ cutlass gemm with cuteDSL gemm) But if you do not have time to do do this, I can try to do this.