d-flex flex-column width-full">

TransformerBlock: support attention skips (#14826)

976b081

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Sign in for the full log view

Check Labels on: pull_request_target

Check labels

Meta CLA

Meta CLA Check

Build Presets on: pull_request

apple (macos) / build

apple (ios) / build

apple (ios-simulator) / build

apple (pybind) / build

apple (profiling) / build

apple (llm) / build

zephyr (zephyr) / build

linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

windows (pybind) / build

windows (windows) / build

periodic on: pull_request

gather-models

test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job

test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job

test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job

test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job

test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job

test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job

Build documentation on: pull_request

build (buck2) / Build doc

upload-gh-pages

Test CUDA Builds on: pull_request 1

test-executorch-cuda-build-12.6 / linux-job

test-executorch-cuda-build-12.8 / linux-job

test-executorch-cuda-build-13.0 / linux-job

test-models-cuda (linear) / linux-job

test-models-cuda (add) / linux-job

test-models-cuda (add_mul) / linux-job

test-models-cuda (resnet18) / linux-job

test-voxtral-cuda-e2e / linux-job

check-all-cuda-builds

pull on: pull_request 6

test-qnn-wheel-packages-linux (3.10) / linux-job

test-qnn-wheel-packages-linux (3.11) / linux-job

test-qnn-wheel-packages-linux (3.12) / linux-job

test-setup-linux-gcc / linux-job

test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job

test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job

test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job

test-models-linux (linear, portable, linux.2xlarge) / linux-job

test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (add, portable, linux.2xlarge) / linux-job

test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (add_mul, portable, linux.2xlarge) / linux-job

test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (ic3, portable, linux.2xlarge) / linux-job

test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (mv2, portable, linux.2xlarge) / linux-job

test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (resnet18, portable, linux.2xlarge) / linux-job

test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (resnet50, portable, linux.2xlarge) / linux-job

test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job

test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job

test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job

test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job

test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job

test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job

test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job

test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job

test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job

test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job

test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux-android / linux-job

test-custom-ops-linux / linux-job

test-selective-build-linux / linux-job

test-multimodal-linux

test-moshi-linux / linux-job

test-quantized-aot-lib-linux / linux-job

test-binary-size-linux-gcc / linux-job

test-binary-size-linux / linux-job

android / build-llm-demo / linux-job

android / run-emulator

unittest / linux / linux-job

unittest / macos / macos-job

unittest / windows / windows-job

unittest-editable / linux / linux-job

unittest-editable / macos / macos-job

unittest-editable / windows / windows-job

unittest-buck / linux / linux-job

unittest-buck / macos / macos-job

unittest-buck / windows

unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job

unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job

test-static-llama-qnn-linux / linux-job

test-qnn-models-linux / linux-job

test-phi-3-mini-runner-linux / linux-job

test-eval_llama-wikitext-linux / linux-job

test-llama_runner_eager-linux / linux-job

test-llama-lora-linux / linux-job

test-mediatek-models-linux / linux-job

test-openvino-linux / linux-job

test-build-wasm-linux / linux-job

unittest-wasm-bindings / linux-job

unittest-wasm-bindings (--enable-etdump) / linux-job

unittest-nxp-neutron / linux-job

test-samsung-models-linux / linux-job

test-vulkan-models-linux / linux-job

test-vulkan-operators-linux / linux-job

nxp-build-test / linux-job

Build Windows Wheels on: pull_request

generate-matrix / generate

pytorch/executorch / build-wheel-py3_10-cpu

pytorch/executorch / upload / upload-wheel-py3_10-cpu

Lint on: pull_request

Get changed files / get-changed-files

link-check / lint-urls / linux-job

link-check / lint-xrefs / linux-job

link-check / lint-file-size / linux-job

android-java-format / linux-job

lintrunner-mypy / linux-job

lintrunner / linux-job

Meta CodeSync

Export Status

Meta Import Checks

Meta Internal-Only Changes Check

Apple on: push 3

set-version

build-demo-ios / macos-job

build-benchmark-app / macos-job

build-frameworks-ios / macos-job

upload-demo-ios

upload-frameworks-ios

test-demo-ios

trunk on: push 32

test-models-macos-cpu (emformer_join, xnnpack-quantization-delegation) / macos-job

test-models-macos-cpu (ic4, xnnpack-quantization-delegation) / macos-job

test-models-macos-cpu (llama2, xnnpack-quantization-delegation) / macos-job

test-models-macos-cpu (mobilebert, xnnpack-quantization-delegation) / macos-job

test-models-macos-cpu (mv3, xnnpack-quantization-delegation) / macos-job

test-models-macos-cpu (resnet50, xnnpack-quantization-delegation) / macos-job

test-models-macos-cpu (vit, xnnpack-quantization-delegation) / macos-job

test-models-macos-cpu (w2l, xnnpack-quantization-delegation) / macos-job

test-models-macos-cpu (efficient_sam, portable) / macos-job

test-models-macos-cpu (llama, portable) / macos-job

test-models-macos-cpu (llama3_2_vision_encoder, portable) / macos-job

test-models-macos-cpu (mv3, portable) / macos-job

test-models-linux-aarch64 (linear, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (linear, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (add, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (add, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (add_mul, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (add_mul, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (ic3, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (ic3, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (ic4, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (ic4, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mv2, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mv2, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mv3, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mv3, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (resnet18, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (resnet18, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (resnet50, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (resnet50, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (vit, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (vit, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (w2l, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (w2l, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mobilebert, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mobilebert, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (emformer_join, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (emformer_join, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (emformer_transcribe, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (emformer_transcribe, xnnpack-quantization-delegation, linux.arm64.2xla... / linux-job

test-models-linux-aarch64 (lstm, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mul, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (softmax, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (phi_4_mini, portable, linux.arm64.m7g.4xlarge) / linux-job

test-models-linux-aarch64 (qwen2_5_1_5b, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (llama3_2_vision_encoder, portable, linux.arm64.2xlarge) / linux-job

test-custom-ops-macos (cmake) / macos-job

test-selective-build-macos (cmake) / macos-job

test-demo-backend-delegation (buck2) / linux-job

test-demo-backend-delegation (cmake) / linux-job

test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job

test-arm-backend (test_pytest_models_ethosu_fvp) / linux-job

test-arm-backend (test_run_ethosu_fvp) / linux-job

test-arm-backend (test_models_tosa) / linux-job

test-arm-backend (test_models_ethos-u55) / linux-job

test-arm-backend (test_models_ethos-u85) / linux-job

test-arm-backend (test_smaller_stories_llama) / linux-job

test-arm-backend (test_memory_allocation) / linux-job

test-arm-cortex-m-size-test (bare_metal) / linux-job

test-arm-cortex-m-size-test (zephyr-preset) / linux-job

test-arm-ootb-linux / linux-job

test-coreml-delegate / macos-job

test-static-llama-ane / macos-job

test-llama-torchao-lowbit / macos-job

test-llama-runner-linux (fp32, portable, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, portable, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job

test-llama-runner-linux (bf16, portable, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (bf16, portable, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job

test-llama-runner-linux (bf16, custom, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job

test-llama-runner-mac (fp32, mps) / macos-job

test-llama-runner-mac (fp32, coreml) / macos-job

test-llama-runner-mac (fp32, xnnpack+custom+quantize_kv) / macos-job

test-torchao-huggingface-checkpoints (qwen3_4b, linux.2xlarge, executorch-ubuntu-22.04-clang12, x... / linux-job

test-torchao-huggingface-checkpoints (phi_4_mini, linux.2xlarge, executorch-ubuntu-22.04-clang12,... / linux-job

test-torchao-huggingface-checkpoints (qwen3_4b, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc1... / linux-job

test-torchao-huggingface-checkpoints (phi_4_mini, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job

test-multimodal-macos (gemma3-4b) / macos-job

test-qnn-model (fp32, dl3) / linux-job

test-qnn-model (fp32, mv3) / linux-job

test-qnn-model (fp32, mv2) / linux-job

test-qnn-model (fp32, ic4) / linux-job

test-qnn-model (fp32, ic3) / linux-job

test-qnn-model (fp32, vit) / linux-job

test-qnn-model (fp32, mb) / linux-job

test-qnn-model (fp32, w2l) / linux-job

test-qnn-model (fp32, conv_former) / linux-job

test-qnn-optimum-model (fp32, cvt) / linux-job

test-qnn-optimum-model (fp32, dit) / linux-job

test-qnn-optimum-model (fp32, efficientnet) / linux-job

test-qnn-optimum-model (fp32, focalnet) / linux-job

test-qnn-optimum-model (fp32, mobilevit_v1) / linux-job

test-qnn-optimum-model (fp32, mobilevit_v2) / linux-job

test-qnn-optimum-model (fp32, pvt) / linux-job

test-qnn-optimum-model (fp32, swin) / linux-job

test-qnn-optimum-model (fp32, albert) / linux-job

test-qnn-optimum-model (fp32, bert) / linux-job

test-qnn-optimum-model (fp32, distilbert) / linux-job

test-qnn-optimum-model (fp32, roberta) / linux-job

test-models-macos-coreml (dl3) / macos-job

test-models-macos-coreml (edsr) / macos-job

test-models-macos-coreml (efficient_sam) / macos-job

test-models-macos-coreml (emformer_join) / macos-job

test-models-macos-coreml (emformer_transcribe) / macos-job

test-models-macos-coreml (ic3) / macos-job

test-models-macos-coreml (ic4) / macos-job

test-models-macos-coreml (mobilebert) / macos-job

test-models-macos-coreml (mv2) / macos-job

test-models-macos-coreml (mv3) / macos-job

test-models-macos-coreml (resnet50) / macos-job

test-models-macos-coreml (vit) / macos-job

test-models-macos-coreml (w2l) / macos-job

test-models-macos-mps / macos-job

test-huggingface-transformers-xnnpack (llama3.2-1b|xnnpack|--quantize) / linux-job

test-huggingface-transformers-xnnpack (qwen3-0.6b|xnnpack|--quantize) / linux-job

test-huggingface-transformers-xnnpack (qwen3-1.7b|xnnpack|--quantize) / linux-job

test-huggingface-transformers-xnnpack (gemma3-1b|xnnpack|--quantize) / linux-job

test-huggingface-transformers-xnnpack (phi4-mini|xnnpack|--quantize) / linux-job

test-huggingface-transformers-xnnpack (smollm2-135m|xnnpack|--quantize) / linux-job

test-huggingface-transformers-xnnpack (smollm3-3b|xnnpack|--quantize) / linux-job

test-huggingface-transformers-macos (llama3.2-1b|coreml_fp32_gpu|--quantize) / macos-job

test-huggingface-transformers-macos (qwen3-0.6b|coreml_fp32_gpu|--quantize) / macos-job

test-huggingface-transformers-macos (smollm2-135m|coreml_fp32_gpu|--quantize) / macos-job

test-huggingface-transformers-macos (olmo-1b|coreml_fp32_gpu|--quantize) / macos-job

test-huggingface-transformers-macos (bert|coreml_fp32_gpu|--quantize) / macos-job

test-huggingface-transformers-macos (distilbert|coreml_fp32_gpu|--quantize) / macos-job

test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job

changes

unittest-release / linux / linux-job

unittest-release / macos / macos-job

unittest-release / windows / windows-job

test-mcu-models (cmake) / linux-job

test-models-windows (mv3, portable) / windows-job

test-models-windows (mv3, xnnpack-q8) / windows-job

test-models-windows (resnet50, portable) / windows-job

test-models-windows (resnet50, xnnpack-q8) / windows-job

test-models-windows (vit, portable) / windows-job

test-models-windows (vit, xnnpack-q8) / windows-job

test-models-windows (mobilebert, portable) / windows-job

test-models-windows (mobilebert, xnnpack-q8) / windows-job

test-models-windows (emformer_transcribe, portable) / windows-job

test-models-windows (emformer_transcribe, xnnpack-q8) / windows-job

test-static-llama-qnn-eval-linux (baseline, 62) / linux-job

PyTorch Bot

Dr.CI

Facebook GitHub Tools

Facebook Internal - Linter

Facebook Internal - Builds & Tests

The logs for this run have expired and are no longer available.

Loading

Re-running jobs...