sm120a

memra is a Rust + CUDA inference engine built for NVIDIA RTX PRO 6000 Blackwell and RTX 5090. It serves GGUF models over an OpenAI-compatible API, and every default it ships was measured on those two cards — both Blackwell sm_120a, with a separately compile-gated Hopper/H100 (sm_90a) lane alongside.

Build your own AI companion. GPU-native avatar generation, Substance-Painter cognitive layers, holographic progressive memory, iDream 3D world engine, three-model cognitive hierarchy. Runs entirely on consumer GPUs. No cloud.

Windows NVIDIA-only Triton 3.7.0 build pipeline for RTX 5090 / Blackwell sm_120a, with FP8 tl.dot validation and peak benchmark results.

llama.cpp super-fork: NVFP4 OMMA.SF.16864 tensor core path for consumer Blackwell (RTX 5070 Ti). NVFP4 KV cache lossless at 64k (KLD=0). MoE expert offloading. .den native format.