⚠️ Warning: While this project is being used in production across numerous companies/projects, we are still building out some components and its behavior may change, especially around some of the configuration options (sanitizers, PIE and other link modes, etc.)
- Hermetic cross-compiling
cc_toolchainWe assemble LLVM with Bazeled runtimes/libc stacks to provide a zero-sysroot, hermetic C/C++ cross toolchain for many exec/target combinations (Linux glibc/musl, Windows MinGW/MSVC targets, macOS, wasm; more coming). - Bazeled LLVM targets
We expose Bazel targets for LLVM binaries and libraries. Some come from the upstream
@llvm-projectBazel overlay, and we also provide missing coverage with our own BUILD files, includingcompiler-rt,libc++,libc++abi,libunwind, and sanitizer runtimes. - WIP crossenv package targets for outside-Bazel use We expose Bazel targets that package the same toolchain pieces as portable artifacts, so the ecosystem can be leveraged outside Bazel too (work in progress).
Add this to your MODULE.bazel:
bazel_dep(name = "llvm", version = "0.7.3")
register_toolchains("@llvm//toolchain:all")See https://github.com/hermeticbuild/hermetic-llvm/releases/latest
This registers all toolchains declared by this module for all supported targets.
This module sets bazel_compatibility to 7.7+ so it can be imported for constraints, but it is highly recommended to use Bazel 8.5+ for full functionality.
This toolchain brings a zero-sysroot, fully hermetic C/C++ cross-compilation flow to Bazel based on LLVM.
Cross-compilation works out of the box, including with sanitizers, and requires no additional configuration.
Remote execution also works out of the box since the toolchain is fully hermetic.
Cross-compilation usually requires two main components:
- A cross-compiler and cross-linker capable of generating and linking binaries for the target platform.
- Target-specific headers and libraries such as CRT files, libc (glibc, musl, etc.), C++ standard library, compiler runtimes, and optional components like sanitizers.
Usually, this is done by providing a sysroot per target platform.
This ecosystem simplifies the process by cross-compiling all target-specific components from source, then compiling/linking user programs against those components in Bazel.
Use the toolchain module extension:
toolchain = use_extension("@llvm//extensions:toolchain.bzl", "toolchain")
toolchain.exec(arch = "x86_64", os = "linux")
toolchain.exec(arch = "aarch64", os = "linux")
toolchain.target(arch = "x86_64", os = "linux")
toolchain.target(arch = "aarch64", os = "linux")
toolchain.target(arch = "riscv64", os = "linux")
use_repo(toolchain, "llvm_toolchains")
register_toolchains("@llvm_toolchains//:all")This registers the cross-product of the specified exec and target platforms.
If you need finer control, register individual toolchain targets. You can list them with:
bazel query 'kind(toolchain, @llvm//toolchain:all)'To make the vanilla Go compiler work with a fully hermetic toolchain, we had to send some patches upstream. Only versions of Go >= 1.27 are supported out of the box.
To use this toolchain with earlier versions of Go, the compiler must be built from source with our patches. Luckily rules_go supports this.
bazel_dep(name = "rules_go", version = "0.61.0")
go_sdk = use_extension("@io_bazel_rules_go//go:extensions.bzl", "go_sdk")
go_sdk.from_file(
name = "go_sdk",
experimental_build_compiler_from_source = True,
go_mod = "//:go.mod",
patch_strip = 1,
patches = [":go_compiler_flags.patch"],
)
use_repo(go_sdk, "go_sdk")
e2e/wasm has an example of a fully working Cgo setup.
The first segment of the output directory (bazel-out/<cpu>-<compilation_mode>/...) is the value of --cpu, which defaults to the auto-detected host CPU and does not follow --platforms. The same --platforms therefore gives darwin_arm64-<compilation_mode> on a macOS arm64 host and aarch64-<compilation_mode> on a Linux arm64 host.
This leaks into artifacts. Bazel-generated .go sources are compiled from their output path, and the Go linker records source paths in the pclntab, so the directory name ends up inside the binary and the same target built on two hosts gives two different binaries. Cgo packages are affected too: they record cgo_ldflag directives in the compiled .a, and those flags contain these same output paths, so every cgo .a differs across hosts as well. The linker consumes those as arguments rather than embedding them, so they do not change the binary, but they do prevent cross-host cache hits.
Deriving the name from the platform label instead makes it host-independent, at the cost of a one-time full cache miss:
--experimental_platform_in_output_dirIdentical constraint_values still do not guarantee identical paths. The name comes from the platform's target name, so a differently named copy, or even an alias() to the same platform, gets its own directory and its own binary. Adding --experimental_use_platforms_in_output_dir_legacy_heuristic=false switches to a hash of the label, which stops same-named platforms in different packages from colliding but is still label-derived.
We highly recommend using rules_rs to seamlessly interop the Rust and CC toolchains. It is best to use the toolchains and platforms defined by that ruleset to configure everything properly.
If you wish to setup things manually, you will likely require a few flags:
- Rust passes
-lgcc_swhen linking, so make sure you have not set--@llvm//config:experimental_stub_libgcc_s=False. - Rust
cc-rscrate does not properly account for$ARand$ARFLAGSenv vars, so it does not work whenllvm-libtool-darwinis used as the archiver. You will want to set--@rules_cc//cc/toolchains/args/archiver_flags:use_libtool_on_macos=Falseto avoid failure in build scripts usingcc-rs. - Rust forces
-no-piewhen linking musl targets, while we default to-static-pie, which are incompatible. You can configure your platform with the@llvm//constraints/pie:offconstraint_value to harmonize the link flags.
✅ Currently supports cross-compilation between all combinations of the following platforms:
| To ↓ / From → | macOS aarch64 | macOS x86_64 | Linux aarch64 | Linux x86_64 | Windows x86_64 | Windows aarch64 |
|---|---|---|---|---|---|---|
| aarch64-apple-darwin | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| x86_64-apple-darwin | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| aarch64-linux-gnu ¹ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| x86_64-linux-gnu ¹ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| riscv64-linux-gnu ¹ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| s390x-linux-gnu ¹ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| armv7-linux-gnueabihf ¹ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| aarch64-linux-musl | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| x86_64-linux-musl | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| riscv64-linux-musl | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| s390x-linux-musl | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| armv7-linux-musleabihf | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| aarch64-windows-gnu ² | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| x86_64-windows-gnu ² | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| aarch64-windows-msvc ³ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| x86_64-windows-msvc ³ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| bpfeb | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| bpfel | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| wasm32-unknown-unknown | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| wasm64-unknown-unknown | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
¹ See "GNU C Library" section for glibc version selection.
² See "Windows" section.
³ Native Windows Stage 0 execution uses the published GNU/MinGW-built LLVM prebuilt; clang-cl still emits the MSVC target ABI. Source-built bootstrap stages also support native Windows execution. See "Windows" section.
Only static linking against the latest version of musl is supported for now.
To target musl:
--platforms @llvm//platforms:linux_aarch64_musl
By default, binaries are fully statically linked (no dynamic linker at all).
Compiling and linking dynamically against specific glibc versions is supported. By default, the earliest glibc version that supports your target is used (2.28 in most cases).
To target a specific version, use:
--platforms @llvm//platforms:linux_x86_64_gnu.2.28
Behind the scenes, code is compiled with headers for the selected glibc and linked against compatible stubs.
This ensures your program runs on systems with that glibc version or newer without using newer symbols.
Both libc++ and libstdc++ are supported. libc++ is selected by default.
To select libstdc++ for a Linux glibc target, add a
@llvm//constraints/cxxstdlib:libstdcxx.<version> constraint to the target
platform. Supported versions are the entries declared by
GCC_VERSIONS in @llvm//3rd_party/gcc:version.bzl; the default selected
libstdc++ source is the latest declared version.
platform(
name = "linux_x86_64_gnu_2_28_libstdcxx_17_0_0",
constraint_values = [
"@platforms//os:linux",
"@platforms//cpu:x86_64",
"@llvm//constraints/libc:gnu.2.28",
"@llvm//constraints/cxxstdlib:libstdcxx.17.0.0",
],
)Then build with that platform:
bazel build --platforms=//:linux_x86_64_gnu_2_28_libstdcxx_17_0_0 //:applibstdc++ is currently supported as a dynamic C++ runtime, so C++ binaries
using it must set linkstatic = False:
cc_binary(
name = "app",
srcs = ["main.cc"],
linkstatic = False,
)With Bazel's default dynamic mode, cc_binary defaults linkstatic to True,
which selects the toolchain's static C++ runtime path. For libstdc++ that would
make static libstdc++ the default, which is not what most Linux users expect,
and this toolchain intentionally supports libstdc++ through the dynamic runtime
path. --dynamic_mode=off also forces the static runtime path, even when
linkstatic = False, so it cannot be combined with libstdc++ support.
At the moment, libstdc++ support is limited to Linux glibc targets. Additional targets can be added based on demand; musl + libstdc++ is feasible too, even if it is an uncommon configuration.
armv7 targets default to NEON. Cores without NEON (e.g. Cortex-A7 with
vfpv4-d16) can be selected by adding the @llvm//constraints/fpu:vfpv4-d16
constraint to the target platform.
The FPU constraint lives here for now and will be migrated to bazel-contrib/platforms_contrib once its shape is defined upstream. Tracking issue: bazel-contrib/platforms_contrib#4.
Windows targets support both the GNU and native MSVC ABIs. MinGW-w64 targets use
UCRT by default; MSVCRT can be selected by adding the
@llvm//constraints/windows/crt:msvcrt constraint to the target platform. This
CRT constraint selects a MinGW-w64 runtime flavor; it does not select the MSVC
target ABI.
Repository-provided Windows platforms use the
@llvm//constraints/windows/abi:gnu ABI. User-defined Windows platforms that
omit this toolchain-specific constraint retain the same MinGW behavior. The
gnullvm value is accepted for Rust compatibility and uses Clang's GNU Windows
target environment.
The native MSVC ABI is available through
@llvm//platforms:windows_x86_64_msvc and
@llvm//platforms:windows_aarch64_msvc. These target toolchains use clang-cl,
lld-link, the Microsoft Visual C++ runtime and Windows SDK, and a statically
linked libc++. Their compile and link actions support macOS, Linux and native
Windows execution platforms at every bootstrap stage. Stage 0 native Windows
execution selects the published GNU/MinGW-built LLVM prebuilt and uses its
clang-cl/lld-link tools. Later bootstrap stages build their GNU/MinGW-compatible
Windows LLVM tools from source. An MSVC-built LLVM execution prebuilt is not
required. Using the Microsoft inputs requires explicit acceptance of both
licenses:
bazel build \
--platforms=@llvm//platforms:windows_x86_64_msvc \
--repo_env=BAZEL_MSVC_RUNTIME_VISUAL_STUDIO_EULA=1 \
--repo_env=BAZEL_WINDOWS_SDK_EULA=1 \
//:appMSVC targets default to the retail dynamic CRT (/MD). Select the retail static
CRT (/MT) with
--features=-dynamic_link_msvcrt,static_link_msvcrt. Debug CRT modes (/MDd
and /MTd) are not supported. Sanitizers, coverage/FDO, header parsing, module
maps, and layering checks are also not yet supported for MSVC targets; requests
for unsupported features fail during analysis rather than being ignored.
Cross-compiling to macOS from any host is supported.
By default, the official macOS SDK is downloaded from Apple CDN and used hermetically.
We use a cross-platform reimplementation of pkgutil to unpack SDK packages, which works on all hosts.
To use the non-hermetic macOS SDK installed locally use:
osx = use_extension("@llvm//extensions:osx.bzl", "osx")
osx.from_host()For now, RISC-V support is limited to Linux and currently hard-wired to the rv64gc ISA and lp64d ABI while we work out a clean way to configure freestanding targets and ISA matrices.
In theory, this toolchain can target all LLVM-supported targets. We prioritize adding support based on demand.
This module allows choosing a specific LLVM version for both the compiler and the runtimes.
To select another LLVM release (for example 22.1.0), configure the llvm extension before use_repo(...):
llvm = use_extension("@llvm//extensions:llvm.bzl", "llvm")
llvm.version(llvm_version = "22.1.0")Important: Since this module uses prebuilt compiler archives by default. If you set llvm.version(...) to another version, use:
--@llvm//toolchain:bootstrap_stage=stage1_from_source
This builds the compiler from source with the stage0 prebuilt seed, which is required when prebuilts for your exact version are not available.
The @llvm-project repository exposes LLVM version variables:
load("@llvm-project//:vars.bzl", "LLVM_VERSION", "llvm_vars")This module exposes LLVM and runtime projects as first-class Bazel packages, so you can depend on them directly.
Add this to your MODULE.bazel:
bazel_dep(name = "llvm", version = "0.3.1")
llvm = use_extension("@llvm//extensions:llvm.bzl", "llvm")
use_repo(llvm, "llvm-project")Then consume LLVM and runtime targets from @llvm-project in BUILD files:
cc_binary(
name = "llvm_driver",
data = ["@llvm-project//llvm:llvm.stripped"],
)
cc_shared_library(
name = "clang",
deps = ["@llvm-project//clang:libclang"],
visibility = ["//visibility:public"],
)
cc_library(
name = "runtime_bundle",
deps = [
"@llvm-project//compiler-rt:clang_rt.builtins.static",
"@llvm-project//compiler-rt:asan.static",
"@llvm-project//libcxx:libcxx.static",
"@llvm-project//libcxxabi:libcxxabi.static",
"@llvm-project//libunwind:libunwind.static",
],
)This is actively in progress. The goal is to produce working crossenv packages that mirror the Bazel toolchain contents so they can be reused by other build systems outside Bazel.
Current packaging targets include:
//prebuilt/llvm:for_linux_amd64_musl//prebuilt/llvm:for_linux_arm64_musl//prebuilt/llvm:for_macos_amd64//prebuilt/llvm:for_macos_arm64//prebuilt/llvm:for_windows_amd64//prebuilt/llvm:for_windows_arm64//prebuilt/llvm:for_windows_amd64_msvc//prebuilt/llvm:for_windows_arm64_msvc
These targets are what release workflows use to produce .tar.zst artifacts today. The final crossenv UX and packaging layout are still being refined.
The MSVC archives use source-backed ThinLTO but intentionally do not use FDO:
the available Linux profile-training executables record Itanium C++ names,
which cannot profile the Microsoft-mangled C++ functions in the Windows LLVM
binaries.
See https://github.com/hermeticbuild/hermetic-llvm/milestone/1
- OpenAI
- LLVM
- Aspect
- ZML
- rules_py
- rules_scala_native
- JetBrains
- Nativelink
- formatjs
- Etsy
- Patagia
- OpenROAD
- kepler-formal
- Xybrid
- Google XLS
- Drake
- Internet Computer
https://andrewkelley.me/post/zig-cc-powerful-drop-in-replacement-gcc-clang.html We were heavily inspired by (and rely on) the work of Andrew Kelley on the zig programming language compiler.
https://github.com/llvm/llvm-project which provides Bazel build definitions for many LLVM targets and the multicall/busybox machinery that is key to our small download sizes.
https://github.com/bazel-contrib/toolchains_llvm which provides a cross-compilation toolchain based on user-provided sysroot.
https://github.com/uber/hermetic_cc_toolchain which provides a Bazel cross-compilation toolchain built around the zig binary and its cc subcommand.
https://github.com/dzbarsky/static-clang which provides stripped subsets of LLVM binaries for lighter dependencies, as well as a starting point for missing LLVM target BUILD file authoring (compiler-rt, etc.).
None of this would have been possible without the support of zml.ai for whom this toolchain was initially created. They are building a high performance inference suite.
A particular thank you to @steeve, the founder of zml.ai for planting the idea and providing guidance and support.
Special mention for @dzbarsky, @fmeum, @keith, @armandomontanez and others for their contributions, as well as @trybka and the rest of the bazelbuild/rules_cc team at Google for being supportive and reactive.
This project is dedicated to the memory of Corentin's beloved cat "Koutchi" aka "Garçon" who was everything to him. To his little star dust <3
