Skip to content
cuda-perf

[cuda] GGUF Q6_K real packed INT6 (W6A8 dp4a) + GGUF CI export #1354

Sign in to view logs

[cuda] GGUF Q6_K real packed INT6 (W6A8 dp4a) + GGUF CI export

[cuda] GGUF Q6_K real packed INT6 (W6A8 dp4a) + GGUF CI export #1354

Run time

Learn about OS pricing on GitHub Actions
Job Run time
CI run decision / decide
30s
Get changed files / get-changed-files
5s
set-parameters
12s
export-models (openai/whisper-medium, quantized-int4-weight-only, openai_whisper-medium, 50) / linux-job
18m 31s
export-models (openai/whisper-small, quantized-int4-tile-packed, openai_whisper-small, 50) / linux-job
18m 8s
export-models (openai/whisper-large-v3-turbo, non-quantized, openai_whisper-large-v3-turbo, 50) / linux-job
17m 14s
export-models (mistralai/Voxtral-Mini-3B-2507, quantized-int4-tile-packed, mistralai_Voxtral-Mini... / linux-job
25m 9s
export-models (nvidia/parakeet-tdt, non-quantized, nvidia_parakeet-tdt, 50) / linux-job
24m 49s
export-models (google/gemma-3-4b-it, non-quantized, google_gemma-3-4b-it, 50) / linux-job
28m 33s
export-models (openai/whisper-large-v3-turbo, quantized-int4-weight-only, openai_whisper-large-v3... / linux-job
17m 19s
export-models (openai/whisper-large-v3-turbo, quantized-int4-tile-packed, openai_whisper-large-v3... / linux-job
20m 15s
export-models (mistralai/Voxtral-Mini-3B-2507, quantized-int4-weight-only, mistralai_Voxtral-Mini... / linux-job
26m 58s
export-models (openai/whisper-medium, quantized-int4-tile-packed, openai_whisper-medium, 50) / linux-job
22m 17s
export-models (nvidia/parakeet-tdt, quantized-int4-tile-packed, nvidia_parakeet-tdt, 50) / linux-job
24m 33s
export-models (nvidia/parakeet-tdt, quantized-int4-weight-only, nvidia_parakeet-tdt, 50) / linux-job
25m 14s
export-models (SocialLocalMobile/Qwen3.5-35B-A3B-HQQ-INT4, quantized-int4-tile-packed, SocialLoca... / linux-job
43m 35s
export-models (google/gemma-3-4b-it, quantized-int4-weight-only, google_gemma-3-4b-it, 50) / linux-job
29m 45s
export-models (google/gemma-3-4b-it, quantized-int4-tile-packed, google_gemma-3-4b-it, 50) / linux-job
27m 54s
export-models (openai/whisper-small, quantized-int4-weight-only, openai_whisper-small, 50) / linux-job
19m 4s
export-models (openai/whisper-medium, non-quantized, openai_whisper-medium, 50) / linux-job
20m 7s
export-models (mistralai/Voxtral-Mini-3B-2507, non-quantized, mistralai_Voxtral-Mini-3B-2507, 50) / linux-job
24m 18s
export-models (openai/whisper-small, non-quantized, openai_whisper-small, 50) / linux-job
18m 48s
benchmark-cuda (openai/whisper-large-v3-turbo, non-quantized, openai_whisper-large-v3-turbo, 50) / linux-job
26m 51s
benchmark-cuda (SocialLocalMobile/Qwen3.5-35B-A3B-HQQ-INT4, quantized-int4-tile-packed, SocialLoc... / linux-job
38m 24s
benchmark-cuda (google/gemma-3-4b-it, non-quantized, google_gemma-3-4b-it, 50) / linux-job
24m 24s
benchmark-cuda (openai/whisper-small, quantized-int4-weight-only, openai_whisper-small, 50) / linux-job
26m 16s
benchmark-cuda (nvidia/parakeet-tdt, quantized-int4-tile-packed, nvidia_parakeet-tdt, 50) / linux-job
9m 12s
benchmark-cuda (nvidia/parakeet-tdt, non-quantized, nvidia_parakeet-tdt, 50) / linux-job
10m 38s
benchmark-cuda (openai/whisper-small, quantized-int4-tile-packed, openai_whisper-small, 50) / linux-job
28m 40s
benchmark-cuda (openai/whisper-large-v3-turbo, quantized-int4-tile-packed, openai_whisper-large-v... / linux-job
25m 36s
benchmark-cuda (openai/whisper-medium, quantized-int4-tile-packed, openai_whisper-medium, 50) / linux-job
27m 9s
benchmark-cuda (openai/whisper-large-v3-turbo, quantized-int4-weight-only, openai_whisper-large-v... / linux-job
26m 34s
benchmark-cuda (openai/whisper-small, non-quantized, openai_whisper-small, 50) / linux-job
25m 49s
benchmark-cuda (nvidia/parakeet-tdt, quantized-int4-weight-only, nvidia_parakeet-tdt, 50) / linux-job
9m 27s
benchmark-cuda (mistralai/Voxtral-Mini-3B-2507, quantized-int4-tile-packed, mistralai_Voxtral-Min... / linux-job
12m 40s
benchmark-cuda (google/gemma-3-4b-it, quantized-int4-tile-packed, google_gemma-3-4b-it, 50) / linux-job
20m 34s
benchmark-cuda (openai/whisper-medium, quantized-int4-weight-only, openai_whisper-medium, 50) / linux-job
29m 9s
benchmark-cuda (openai/whisper-medium, non-quantized, openai_whisper-medium, 50) / linux-job
27m 29s
benchmark-cuda (google/gemma-3-4b-it, quantized-int4-weight-only, google_gemma-3-4b-it, 50) / linux-job
26m 51s
benchmark-cuda (mistralai/Voxtral-Mini-3B-2507, non-quantized, mistralai_Voxtral-Mini-3B-2507, 50) / linux-job
17m 50s
benchmark-cuda (mistralai/Voxtral-Mini-3B-2507, quantized-int4-weight-only, mistralai_Voxtral-Min... / linux-job
15m 26s
upload-benchmark-results
38s
14h 42m 55s