Skip to content

[MLX] Reduce physical footprint memory in RingBufferKVCache for chunk… #26414

[MLX] Reduce physical footprint memory in RingBufferKVCache for chunk…

[MLX] Reduce physical footprint memory in RingBufferKVCache for chunk… #26414

Job Run time
7s
30s
4s
23m 19s
27m 48s
19m 44s
20m 49s
23m 23s
18m 1s
28m 28s
1h 14m 39s
26m 5s
12m 40s
14m 9s
14m 30s
9m 17s
15m 1s
8m 26s
14m 0s
32m 47s
13m 36s
15m 1s
13m 23s
12m 46s
13m 39s
13m 6s
13m 10s
12m 42s
12m 39s
28m 17s
16m 54s
17m 43s
14m 20s
14m 50s
19m 39s
1h 17m 4s
25m 6s
11m 4s
14m 0s
13m 44s
13m 57s
10m 56s
11m 31s
12m 52s
18m 41s
11m 59s
11m 25s
14m 45s
17m 5s
12m 59s
12m 10s
11m 35s
11m 20s
55m 26s
13m 32s
33m 42s
12m 4s
13m 29s
11m 16s
11m 27s
44m 10s
11m 35s
11m 44s
11m 30s
18m 1s
13m 18s
22m 0s
18m 49s
42m 59s
12m 38s
11m 35s
11m 22s
11m 38s
15m 2s
13m 33s
12m 40s
12m 27s
12m 45s
23m 28s
31m 31s
23m 22s
10m 19s
21m 15s
58m 14s
38m 8s
30m 18s
25m 15s
1h 8m 12s
13m 20s
13m 27s
14m 19s
12m 51s
14m 36s
13m 14s
14m 45s
13m 37s
13m 34s
14m 12s
13m 51s
33m 12s
12m 41s
37m 32s
58m 28s
1h 21m 27s
31m 39s
15m 13s
14m 43s
15m 36s
15m 13s
14m 56s
14m 44s
28m 8s
28m 0s
-1s
12m 15s
17m 26s
11m 17s
7m 51s
18m 34s
10m 25s
10m 52s
9m 46s
9m 19s
9m 19s
21m 48s
8m 5s
9m 52s
9m 16s
9m 53s
8m 25s
7m 56s
9m 47s
28m 18s
11m 41s
10m 8s
9m 42s
10m 12s
10m 9s
12m 27s
8m 15s
8m 26s
11m 8s
11m 22s
9m 31s
10m 48s
9m 18s
8m 1s
9m 15s
8m 51s
7m 16s
9m 19s
9m 18s
9m 36s
8m 7s
9m 43s
5m 21s
33m 26s
26m 59s
32m 12s
35m 48s
35m 23s
35m 2s
36m 27s
32m 48s
36m 3s
33m 22s
2d 2h 55m 34s