Skip to content

incorporate fa3 through kernels.#19

Open
sayakpaul wants to merge 1 commit into
jd-opensource:mainfrom
sayakpaul:fa3-kernels
Open

incorporate fa3 through kernels.#19
sayakpaul wants to merge 1 commit into
jd-opensource:mainfrom
sayakpaul:fa3-kernels

Conversation

@sayakpaul

Copy link
Copy Markdown

Fixes #18

@tangyanf

Copy link
Copy Markdown

Thanks for this contribution, Sayak! The kernels library integration is a great improvement — it removes the compilation burden for FA3 while keeping the source-build fallback path for edge cases. Really appreciate you taking the time to put this together.

@sayakpaul

Copy link
Copy Markdown
Author

No worries, happy to help. Let me know if there is anything on my end needed for the merge.

Would also encourage you to use the kernels lib in your other projects.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Consider using pre-built Flash Attention kernels via kernels

2 participants