NVFP4 LLM inference tuned for consumer Blackwell GPUs. Auto-detects your GPU, downloads the model, serves an OpenAI-compatible API — benchmarked and quality-certified.
-
Updated
Oct 10, 2026 - Shell
#
agentic-inference
Here are 4 public repositories matching this topic...
Beyond token-by-token agents. JevSpawn enables parallel action exploration through adaptive action spaces, without additional training.
structured-prediction efficient-inference action-space constrained-decoding training-free llm-agents agentic-inference jev jevspawn
-
Updated
Oct 2, 2026 - Python
Inductive Latent Context Persistence (ILCP) for Agentic AI. This infrastructure persists, routes, and reuses LLM latent context across multi-agent DAGs. By eliminating redundant prefix-prefill compute and optimizing bare-metal VRAM allocation, ILCP drastically lowers tail-latency for parallel agent inference in compute-constrained setups.
-
Updated
Jun 19, 2026 - Python
Sovereign Speculative Tool Execution & Persistent Radix KV-Cache Engine for NVIDIA TensorRT-LLM, NIM & Blackwell Clusters with Cloudflare Clef, Hermes Paperclip, and Enterprise AI Control Plane
zero-dependency control-plane kv-cache integration-platform speculative-decoding tensorrt-llm nvidia-nim ai-infrastructure blackwell-gpu ai-ran agentic-inference nvidia-inception cloudflare-clef nvidia-aerial 6g-developer-program hermes-paperclip
-
Updated
Oct 10, 2026 - Python
Add this topic to your repo
To associate your repository with the agentic-inference topic, visit your repo's landing page and select "manage topics."