Skip to content

[Executorch][llm] Fix ring kv cache when used with quantized kv cache and sdpa #44865

[Executorch][llm] Fix ring kv cache when used with quantized kv cache and sdpa

[Executorch][llm] Fix ring kv cache when used with quantized kv cache and sdpa #44865

Job Run time
22m 30s
5m 39s
9m 24s
16m 35s
16m 20s
9m 0s
8m 52s
14m 51s
9m 12s
9m 46s
8m 16s
8m 13s
10m 13s
8m 31s
17m 9s
12m 51s
8m 21s
8m 14s
1h 30m 40s
30m 25s
8m 13s
8m 13s
8m 56s
9m 53s
8m 38s
10m 46s
1h 30m 37s
42m 6s
17m 4s
9m 17s
13m 17s
8m 43s
22m 15s
9m 57s
53m 58s
8m 31s
51m 19s
12m 54s
8m 23s
9m 8s
8m 7s
21m 32s
16m 5s
22m 49s
8m 40s
9m 45s
11m 55s
13m 35s
14m 15s
11m 52s
13m 49s
11m 55s
8m 3s
8m 12s
8m 3s
14m 51s
1h 1m 26s
5m 23s
9m 59s
8m 9s
54m 53s
40m 1s
1h 24m 5s
4m 54s
17m 21s
7m 30s
26m 0s
29m 43s
7m 58s
8m 43s
18m 7s
9m 50s
2m 44s
22h 17m 24s