Skip to content
MLX

[MLX] Reduce physical footprint memory in RingBufferKVCache for chunked prefill #1673

Sign in to view logs

[MLX] Reduce physical footprint memory in RingBufferKVCache for chunked prefill

[MLX] Reduce physical footprint memory in RingBufferKVCache for chunked prefill #1673

Run time

Learn about OS pricing on GitHub Actions
Job Run time
CI run decision / decide
32s
test-mlx-qwen35-moe / test-mlx-qwen35-moe
11m 19s
test-mlx-voxtral / test-mlx-voxtral
44m 19s
test-mlx / test-mlx
13m 11s
test-mlx-parakeet / test-mlx-parakeet
37m 22s
test-mlx-whisper / test-mlx-whisper
10m 6s
test-mlx-voxtral-realtime / test-mlx-voxtral-realtime
49m 40s
test-mlx-stories110m / test-mlx-stories110m
36m 45s
backend-tester (operators) / test-mlx-backend-operators
11m 48s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, true, nvfp4, macos-14-xlarge) / test-mlx-llm-qwen3-0.6b-custom-nvfp4
11m 6s
backend-tester (models) / test-mlx-backend-models
13m 7s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, false, nvfp4, macos-14-xlarge) / test-mlx-llm-qwen3-0.6b-nvfp4
11m 52s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, true, nvfp4, macos-14-xlarge) / test-mlx-llm-gemma3-1b-custom-nvfp4
12m 11s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, true, 4w, macos-14-xlarge) / test-mlx-llm-llama-1b-custom-4w
12m 38s
test-mlx-llm (google/gemma-4-E2B-it, gemma4-e2b, true, 4w, macos-15-xlarge) / test-mlx-llm-gemma4-e2b-custom-4w
17m 58s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, true, 4w, macos-14-xlarge) / test-mlx-llm-gemma3-1b-custom-4w
13m 21s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, true, nvfp4, macos-14-xlarge) / test-mlx-llm-llama-1b-custom-nvfp4
12m 26s
test-mlx-llm (google/gemma-4-E2B-it, gemma4-e2b, false, 4w, macos-15-xlarge) / test-mlx-llm-gemma4-e2b-4w
17m 54s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, false, 4w, macos-14-xlarge) / test-mlx-llm-llama-1b-4w
11m 6s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, false, nvfp4, macos-14-xlarge) / test-mlx-llm-llama-1b-nvfp4
10m 48s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, false, 4w, macos-14-xlarge) / test-mlx-llm-gemma3-1b-4w
11m 37s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, false, 4w, macos-14-xlarge) / test-mlx-llm-qwen3-0.6b-4w
11m 52s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, true, 4w, macos-14-xlarge) / test-mlx-llm-qwen3-0.6b-custom-4w
12m 4s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, false, nvfp4, macos-14-xlarge) / test-mlx-llm-gemma3-1b-nvfp4
11m 36s
6h 46m 38s