Offloadr Base Images

This repository builds reusable hardware/runtime base images for downstream application images.

Published images

The public image contract is:

• ghcr.io/offloadr/base/cpu-core
• ghcr.io/offloadr/base/amd-core
• ghcr.io/offloadr/base/nvidia-core
• ghcr.io/offloadr/base/nvidia-full

Default tags

The default immutable tags built by this repository are:

• cpu-core:py3.12-torch2.10.0-cpu
• amd-core:py3.12-torch2.10.0-rocm7.1
• nvidia-core:py3.12-torch2.10.0-cuda13.0.2
• nvidia-full:py3.12-torch2.10.0-cuda13.0.2

Runtime contract

All published runtime images are expected to provide:

• WORKDIR /workspace
• system python
• uv
• base Python dependencies installed into the system Python environment

Downstream images that want their own virtual environment can layer one on top of the base image while still inheriting the preinstalled packages:

RUN uv venv /opt/venv --system-site-packages
ENV PATH="/opt/venv/bin:${PATH}"

NVIDIA variants

nvidia-core contains CUDA, Python, uv, PyTorch, and the shared Python dependencies needed by the optional accelerator wheels.

nvidia-full adds:

• xFormers
• FlashAttention 3
• SageAttention2++
• Nunchaku

Building

Build everything locally:

docker buildx bake

Build a specific image:

docker buildx bake nvidia-full