llm-deployment

Learning to make self-hosted LLMs go brrrrrr.

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
bench		bench
logs		logs
profiling		profiling
.dockerignore		.dockerignore
.gitignore		.gitignore
.python-version		.python-version
README.md		README.md
pyproject.toml		pyproject.toml
quantize_gptq_w4a16.py		quantize_gptq_w4a16.py
uv.lock		uv.lock

Provide feedback