Hi does this project support flash attention when using gpu? (the pytorch version seems to have flash attention support) thanks!
Hi does this project support flash attention when using gpu? (the pytorch version seems to have flash attention support)
thanks!