[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py#6996

Merged

facebook-github-bot merged 22 commits into

gh/kimishpatel/144/basefrom

gh/kimishpatel/144/head

Dec 5, 2024

kimishpatel commented Nov 20, 2024 •

edited

Loading

Contributor

Stack from ghstack (oldest at bottom):

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: D66269486


          [Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py

0cd2c82

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

pytorch-bot Bot commented Nov 20, 2024 •

edited

Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6996

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit bad68c7 with merge base cd306d3 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

facebook-github-bot added the CLA Signed label

facebook-github-bot commented Nov 20, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486

facebook-github-bot added the fb-exported label

This was referenced Nov 20, 2024

[Executorch][quant] Optimize per channel dequantize #5670

Merged

Dont quantize the current token for attention #5715

Merged

[Executorch][llama] Rename update_quantized_cache to update_cache #6914

Merged

[Executorch] Add quantized kv cache to oss ci #6997

Merged

lucylq approved these changes

View reviewed changes


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

1527cdc

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 21, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

c8b2820

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 21, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

5493ae0

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 21, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

02e0608

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 22, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486

kimishpatel added the topic: not user facing label


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

91929a3

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 22, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

01dfaf1

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 22, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

863b55c

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 22, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

a2e5433

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 22, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

27dde5e

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 22, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486

kimishpatel mentioned this pull request

[Executorch][custom ops] Change lib loading logic to account for package dir #7038

Merged


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

7c6a16b

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 22, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

aed92cb

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 23, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

1248a85

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 23, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486

kimishpatel mentioned this pull request

[Executorch][CI] Fix qnn runner ci job scripts #7049

Closed


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

58518d7

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 23, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

78639d4

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 23, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

df394fd

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 27, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

a2b9b82

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 28, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

5460a5d

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Nov 29, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

1f91bde

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Dec 4, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

478978c

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Dec 4, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

bad68c7

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

facebook-github-bot commented Dec 5, 2024

Contributor

This pull request was exported from Phabricator. Differential Revision: D66269486

facebook-github-bot merged commit 5f82265 into gh/kimishpatel/144/base

facebook-github-bot deleted the gh/kimishpatel/144/head branch

December 5, 2024 21:20

facebook-github-bot temporarily deployed to cherry-pick-bot

December 5, 2024 21:20

— with

GitHub Actions Inactive

pytorchbot mentioned this pull request

[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py #7210

Merged

kimishpatel added a commit that referenced this pull request


          [Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py (#7210)

c15fab1

Pull Request resolved: #6996

Because now we have more than sdpa_with_kv_cache in it
ghstack-source-id: 256711931
@exported-using-ghexport

//oss complaining of internal lint failure, unit-test-arm broken in trunk
@bypass-github-export-checks
@exported-using-ghexport

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

Co-authored-by: Kimish Patel <kimishpatel@fb.com>

Jack-Khuu mentioned this pull request

Update import of sdpa_with_kv_cache to custom_ops pytorch/torchchat#1470

Merged

kedarnath03 pushed a commit to kedarnath03/executorch that referenced this pull request


          [Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py

68ca03c

Pull Request resolved: pytorch/executorch#6996

Because now we have more than sdpa_with_kv_cache in it
ghstack-source-id: 255055772
@exported-using-ghexport

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed fb-exported topic: not user facing