A universal OpenCode plugin for dynamic model discovery with flexible configuration for OpenAI-compatible providers.
Terraform setup for deploying a private coding LLM on Vast.ai with vLLM, Qwen3 Coder, and OpenCode.
Enterprise-grade Sovereign AI Stack optimized for NVIDIA Blackwell (sm_120) & vLLM. Features 256K context window, 5.8k tok/s prefill, and integrated observability via Langfuse.
The control plane for self-hosted AI inference. Warm-state GPU routing, multi-runtime orchestration across Ollama, vLLM, llama.cpp, and TGI. Single Go binary. Apache-2.0.
A platform-agnostic format + method for sizing local-LLM hardware from your real agent sessions, calibrated with capability-oracle runs.
Windows utility for using Codex Desktop GUI with Ollama and other local/self-hosted LLM backends via profiles.
Alternatively prompt, an LLM-based plugin for the IntelliJ product family. Answer questions and generate code with self-hosted models.
Air-gapped pre-deployment network change validation against a real containerlab digital twin, with sealed PCI/SOC2/NIST evidence. Zero egress.
Self-hosted vLLM inference stack with an OpenAI-compatible API, Docker Compose templates, Caddy reverse proxy, and NVIDIA GPU thermal guard.
KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets. Route requests using model quality, latency, cost, policy, and live GPU state.
convert instagram reels to markdown recipe using self hosted LLMs on VLLM
AI-powered herbal remedies chatbot based on "The Little Handbook of Natural Remedies" by Michael Martin. RAG system for natural medicine research.
A custom AI agent that gives real-time weather-based outfit advice, built with a self-hosted vLLM model. Features persistent memory, a manual ReAct loop, and layered guardrails — with annotated source code explaining every design decision.
A curated collection of applications built using [LangChain](https://docs.langchain.com/) and related frameworks. This repository serves as a **monorepo** showcasing different use cases, integrations, and patterns for agentic AI development.
One-command PowerShell deployment of Ollama running gpt-oss:20b (or any Ollama model) on Azure Container Apps serverless GPU — nginx API-key auth proxy, scale-to-zero billing.
Run Claude Code backed by a self-hosted open-weight model (Qwen 3.5-35B) on AWS g6e — full setup guide, SSH tunnel, and benchmark scripts
Add a description, image, and links to the self-hosted-llm topic page so that developers can more easily learn about it.
To associate your repository with the self-hosted-llm topic, visit your repo's landing page and select "manage topics."