Skip to content
pull

[Executorch][llm] Enable leveraging ring kv cache via module swap #39802

Sign in to view logs

[Executorch][llm] Enable leveraging ring kv cache via module swap

[Executorch][llm] Enable leveraging ring kv cache via module swap #39802

Run time

Learn about OS pricing on GitHub Actions
Job Run time
test-setup-linux-gcc / linux-job
7m 38s
test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job
14m 50s
test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job
13m 43s
test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job
9m 46s
test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job
7m 37s
test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job
9m 9s
test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job
7m 40s
test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job
7m 35s
test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job
8m 20s
test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job
8m 1s
test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job
8m 44s
test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job
14m 29s
test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job
24m 20s
test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job
8m 54s
test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job
7m 18s
test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job
9m 9s
test-models-linux (resnet18, portable, linux.2xlarge) / linux-job
8m 56s
test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job
36m 56s
test-models-linux (add_mul, portable, linux.2xlarge) / linux-job
7m 33s
test-models-linux (linear, portable, linux.2xlarge) / linux-job
7m 36s
test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
7m 54s
test-models-linux (ic3, portable, linux.2xlarge) / linux-job
10m 40s
test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job
9m 13s
test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job
8m 18s
test-models-linux (add, portable, linux.2xlarge) / linux-job
7m 32s
test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job
51m 27s
test-models-linux (resnet50, portable, linux.2xlarge) / linux-job
12m 46s
test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
8m 14s
test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
7m 39s
test-models-linux (mv2, portable, linux.2xlarge) / linux-job
8m 5s
test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job
30m 47s
test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
11m 0s
test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
12m 17s
test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
7m 48s
test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
7m 42s
test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job
8m 34s
test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
8m 1s
test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job
7m 51s
test-custom-ops-linux / linux-job
7m 19s
test-quantized-aot-lib-linux / linux-job
7m 18s
test-binary-size-linux-gcc / linux-job
5m 27s
android / build-llm-demo / linux-job
20m 13s
unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job
26m 31s
unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job
30m 15s
test-llava-runner-linux / linux-job
1h 19m 19s
test-selective-build-linux / linux-job
7m 44s
unittest-editable / linux / linux-job
21m 24s
unittest-editable / macos / macos-job
13m 26s
unittest-buck / linux / linux-job
8m 22s
unittest-buck / macos / macos-job
5m 43s
unittest / linux / linux-job
22m 19s
test-binary-size-linux / linux-job
5m 34s
test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job
15m 16s
test-pybind-build-linux / linux-job
6m 46s
test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job
15m 28s
unittest / macos / macos-job
13m 18s
test-llama-runner-linux-android / linux-job
14m 25s
test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job
15m 8s
test-moshi-linux / linux-job
12m 18s
test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job
12m 14s
test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job
12m 59s
test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job
8m 57s
test-qnn-models-linux / linux-job
5m 5s
test-phi-3-mini-runner-linux / linux-job
19m 50s
test-mediatek-models-linux / linux-job
7m 8s
test-static-llama-qnn-linux / linux-job
1h 17m 20s
test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job
34m 48s
test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job
26m 1s
test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job
12m 34s
test-eval_llama-mmlu-linux / linux-job
8m 35s
test-openvino-linux / linux-job
16m 15s
test-eval_llama-wikitext-linux / linux-job
8m 5s
test-llama_runner_eager-linux / linux-job
7m 30s
android / run-emulator
2m 40s
17h 47m 36s