[MLX] Reduce physical footprint memory in RingBufferKVCache for chunk… #14105
| Job | Run time |
|---|---|
| 3s | |
| 32s | |
| 46m 21s | |
| 52m 36s | |
| 17m 41s | |
| 16m 12s | |
| 20m 9s | |
| 16m 56s | |
| 14m 7s | |
| 21m 37s | |
| 18m 14s | |
| 28m 49s | |
| 32m 34s | |
| 27m 20s | |
| 52m 53s | |
| 43m 41s | |
| 26m 56s | |
| 24m 48s | |
| 26m 9s | |
| 24m 22s | |
| 28m 54s | |
| 18m 43s | |
| 29m 14s | |
| 3s | |
| 19m 31s | |
| 21m 38s | |
| 19m 34s | |
| 13m 49s | |
| 14m 26s | |
| 9m 36s | |
| 25m 1s | |
| 24m 25s | |
| 8m 6s | |
| 9m 51s | |
| 8m 41s | |
| 26m 6s | |
| 24m 57s | |
| 10m 54s | |
| 9m 1s | |
| 9m 23s | |
| 10m 41s | |
| 10m 36s | |
| 14h 25m 10s |