-
Notifications
You must be signed in to change notification settings - Fork 0
Home
Run AI on any device. No PC. No subscription. No struggle.
llamdrop is a free, open-source terminal tool that lets anyone run a local AI model on their existing hardware — an Android phone, an old laptop, a Raspberry Pi, a budget PC, or an SBC — without needing a powerful machine, a cloud subscription, or technical expertise.
It scans your hardware automatically — reads your exact chip (translating codes like MT6853V into "Dimensity 800U"), total and available RAM, CPU core layout, instruction set flags, GPU vendor, and storage free — then makes every decision for you: which inference backend to install (llama.cpp CPU, ROCm for AMD, Vulkan for Intel/AMD desktop, or Ollama), which thread count to use based on your big cores only (skipping the slow little cores on phone chips), how large a context window your RAM can safely hold, whether to enable flash attention and memory locking, and which model quantization will actually fit in your available RAM right now. You don't need to know what any of that means.
llamdrop is GPL v3 licensed. It cannot be sold. Ever.
| 📦 Installation | Get llamdrop running in two commands |
| 🚀 Getting Started | First run walkthrough |
| 🤖 Model Catalog | Verified models across tiers with RAM requirements |
| 🔧 How It Works | Architecture, modules, and design decisions |
| 📱 Device Compatibility | Confirmed working devices |
| 🗺️ Roadmap | What's built, what's next |
| 🤝 Contributing | How to help — no coding required |
| ❓ FAQ & Troubleshooting | Common issues and fixes |
- Android phone users — runs in Termux, no PC needed
- Old laptop owners — that 2012 machine collecting dust can run AI
- Raspberry Pi and SBC users — Pi 4, Pi 5, Orange Pi, and more
- Linux users — desktop or laptop, with automatic Ollama backend support
- Students and learners in regions where $20/month is not a small amount
- Anyone who has tried running local AI and given up due to crashes, incompatibility, or confusion
v0.10.0 — Active development. See Roadmap for full status.
Platform support: Android (Termux) · Linux · Raspberry Pi · Chromebook (Linux mode) · Any ARM64 or x86_64 Linux environment.
This project started because one developer spent hours trying to run local AI on an Oppo F19 Pro+ with no PC and no budget. Dozens of crashes. Models that were incompatible. RAM errors with no explanation. When it finally worked — a tiny 1.5B model running in Termux — the thought was: nobody should have to go through all of that just to get started.
llamdrop is the tool that should have existed already.
Built by @DeVenLucaz and contributors.
LLAMdrop v0.10.0 • Built by @DeVenLucaz • Free & Open Source
Empowering low-spec devices with local AI.