Suitest Cloud collaboration is Coming Soon. The current product is the free, self-hosted platform. Every supported model provider unlocks the same features.
Manage test cases. Run them automatically. Analyze with AI.
Your data stays yours — no subscription fees.
&color=4ade80)
&color=4ade80)
Suitest is a free, self-hostable software testing platform.
Here's what that means: You have a website or app. You want to make sure all its features work correctly — buttons are clickable, forms can be filled, data is saved properly. In the old days, you'd use spreadsheets to track test cases and run each one manually. Suitest replaces all of that with a single application.
| What you need | Suitest solution |
|---|---|
| 📝 Keep all test cases in one place | ✅ Test Case Management — create, edit, organize test cases and suites |
| 🤖 Run tests automatically | ✅ Automated Runner — test browser, API, database automatically |
| 📸 Get screenshot & video evidence | ✅ Evidence Capture — every test produces screenshots and videos |
| 🐛 Track bugs from failed tests | ✅ Defect Tracking — bugs are logged automatically when tests fail |
| 📊 See testing reports | ✅ Dashboard & Analytics — pass rate, coverage, readiness at a glance |
| 🔗 Link requirements ↔ tests ↔ bugs | ✅ Traceability — every test connects to requirements and bugs |
| 🔌 Integrate with CI/CD | ✅ Webhooks — GitHub, GitLab, Jira, Slack |
| 🤖 Use AI to generate tests | ✅ AI (optional) — generate tests from PRDs, auto-diagnosis |
| Profile | Needs | How Suitest helps |
|---|---|---|
| 👩💻 QA Engineer | Manage test cases, run automatically, track defects | TCM, MCP runner, evidence, defects |
| 👨💻 Developer | Ensure PRs are safe to merge, cross-cutting tests | CI workflows and mixed-target tests |
| 📋 Product Manager | See release readiness before deploy | Readiness, analytics, and traceability |
| 🏦 IT / Infrastructure | Self-host for compliance | BYO infrastructure, model, and data |
| 🚀 Startup / Indie Dev | Avoid subscriptions and vendor lock-in | Free self-hosted platform with BYO LLM |
TestRail is paid ($30/user/month) and has no automated runner. Suitest combines TCM, an automated runner, and MCP plugins in one free self-hosted platform.
Playwright can only test browsers. Suitest uses Playwright as one of many plugins + adds TCM layer + traceability + multi-target (not just browsers).
TestSprite has vendor lock-in (their LLM, their cloud). Suitest: BYO LLM, self-host, universal MCP plugin (test API/DB/Infra/Mobile, not just browsers).
What you need:
- Node.js version 18 or higher (download from nodejs.org)
- uv — Python package manager (install with:
pip install uv)
Check if you have them installed:
Open a terminal (Command Prompt / PowerShell / Terminal) and type:
node --version # must be v18 or higher
uv --version # must be installedInstall Suitest:
npx @suiflex/suitest onboard💡 What is
npx? It's part of Node.js that lets you run programs without manual installation.npx @suiflex/suitest onboarddownloads and runs Suitest automatically.
After installation, Suitest will give you a web address (usually http://localhost:4000). Open it in your browser.
First-time login:
- Email: the one you entered during onboard
- Password: the one you entered during onboard
💡 Tip: If you forgot your password, run
suitest settingsin the terminal to regenerate your API key.
- Log in to the dashboard
- Click "+ New Project" → give it a name
- Click "+ New Suite" → give it a name (a collection of test cases)
- Click "+ New Case" → create your first test case
- Add steps — each step has an action (click a button, fill a form, etc.)
- Open Settings → LLM, save a provider, and click Test connection
- Click "Run" → the test will run automatically
💡 First time? Check out the interactive demo after running
make demo— it comes with pre-built test cases ready to go.
npx @suiflex/suitest onboardWhat this command does:
Downloads and installs all required components.
Managing Suitest after installation:
| Want to... | Command |
|---|---|
| Start Suitest | suitest up |
| Stop Suitest | suitest down |
| Generate/refresh API key | suitest settings |
| Change port | suitest onboard --port 5000 |
If you only need the MCP server for IDEs (Claude Code, Cursor, Codex):
npx -y @suiflex/suitest-mcp💡 What is MCP? MCP (Model Context Protocol) is a standard that lets AI agents (like Claude Code) run tests. With the MCP server, you can generate tests from your code repo.
Example configuration for Claude Code / Cursor (.mcp.json):
{
"mcpServers": {
"suitest": {
"command": "npx",
"args": ["-y", "@suiflex/suitest-mcp"],
"env": {
"SUITEST_API_URL": "http://localhost:4000",
"SUITEST_API_KEY": "sk_suitest_..."
}
}
}
}💡
SUITEST_API_URLandSUITEST_API_KEYare required. MCP startup verifies the key and stops until the workspace LLM has been validated in Settings. Provider credentials stay on the Suitest server.
If you want to run all components (API, web, runner, database, Redis, MinIO):
git clone https://github.com/suiflex/suitest && cd suitest
cp .env.example .envEdit .env — set a super-admin:
SUITEST_AUTH_SECRET=<32-char-random-hex> # generate: openssl rand -hex 32
SUITEST_SUPERADMIN_EMAIL=admin@example.com
SUITEST_SUPERADMIN_PASSWORD=<strong-password>Run it:
make docker-up # pull images and boot the stack
open http://localhost:3000💡 What is Docker Compose? Docker runs apps in "containers" (isolated environments). Docker Compose makes it easy to run multiple containers together. If you don't have Docker, install it from docker.com.
For deploying to a Kubernetes cluster:
helm install suitest infra/helm/suitest -f infra/helm/suitest/values.yaml💡 Requires: Kubernetes cluster + Helm + PostgreSQL/Redis/object storage as external services.
If you want to contribute to Suitest:
# Requires: Python 3.12 + uv, Node 20 + pnpm, PostgreSQL/Redis/MinIO
make setup # copy .env → install deps → run migrations → seed DB
make dev # start API (:4000) + web (:3000) + runner togetherOther useful commands:
| Command | What it does |
|---|---|
make dev-api |
Start API only |
make dev-web |
Start web only |
make dev-runner |
Start runner only |
make migrate |
Run database migration |
make seed |
Load demo data |
make ci |
Lint + typecheck + tests (same as CI) |
make help |
See all commands |
Suitest is one free, self-hosted product. Login, workspace management, LLM Settings, and manual Test Case Management work before an LLM is connected.
MCP execution, test runs, and AI features start after an administrator saves and validates a workspace LLM in Settings → LLM. Ollama, llama.cpp, vLLM, LM Studio, Anthropic, OpenAI, Gemini, Groq, OpenRouter, and custom OpenAI-compatible endpoints all unlock the same product features.
Suitest Cloud is the future Suitest-hosted collaboration service. It is Coming Soon and is separate from the model provider you connect.
From a fresh install, you can bootstrap and run a real browser test:
- Log in and create a project, suite, and manual test case.
- Open Settings → LLM, save a provider, and run Test connection.
- Add executable steps targeting an MCP provider such as
playwright-mcp. - Click "Run" — the runner executes each step through MCP.
- Review live status, evidence, and defects on the run detail page.
💡 This entire journey is tested with a real Playwright suite —
make e2e-real
LLMs are configured per workspace from the web UI — Settings → LLM — not via env files.
How to activate:
- Go to Settings → LLM
- Choose a provider (Anthropic, OpenAI, Gemini, Groq, Ollama, etc.)
- Enter your API key (encrypted with AES-GCM, never shown again)
- Click Test connection; successful validation enables MCP, runs, and AI
Supported providers:
| Provider type | Providers |
|---|---|
| Hosted API | Anthropic, OpenAI, Gemini, Groq, OpenRouter, DeepSeek, etc. (100+ via LiteLLM) |
| Self-hosted model | Ollama, llama.cpp, vLLM, LM Studio |
| Custom | Any OpenAI-compatible URL (gateways, routers, proxies) |
No LLM call is made until a workspace explicitly configures a provider.
suitest/
├── README.md ← you are here
├── CLAUDE.md ← coding rules for AI agents
├── Makefile ← all dev commands (make help)
│
├── apps/
│ ├── web/ ← Frontend (Vite + React 19)
│ ├── api/ ← Backend (FastAPI Python)
│ └── runner/ ← Worker that runs tests via MCP
│
├── packages/
│ ├── agent/ ← AI agent (LiteLLM + LangGraph)
│ ├── db/ ← Database (SQLAlchemy + Alembic)
│ ├── mcp/ ← MCP client + registry + bundled providers
│ ├── lifecycle/ ← MCP server: analyze→generate→run→publish
│ ├── mcp-npx/ ← @suiflex/suitest-mcp (npm launcher)
│ ├── suitest-npx/ ← @suiflex/suitest (one-command launcher)
│ ├── shared/ ← Shared Pydantic schemas
│ └── core/ ← Capability resolver, autonomy, crypto
│
├── sdk/
│ ├── python/ ← Python SDK (REST client)
│ └── typescript/ ← TypeScript SDK
│
├── infra/
│ ├── docker/ ← Dockerfile per service
│ └── helm/suitest/ ← Helm chart
│
└── docs/ ← Full documentation
Start at docs/ROADMAP.md — the single entry point for all features.
| Document | Topic | Who is it for? |
|---|---|---|
| ROADMAP.md | Milestones M0 → M15 + build status | Developers who want to contribute |
| PRODUCT.md | Vision, personas, user journeys | Product Managers, QA Leads |
| ARCHITECTURE.md | Stack, services, topology | Developers, DevOps |
| DATA_MODEL.md | Database schema + entity diagram | Backend Developers |
| API.md | REST + WebSocket contract | Frontend Developers, API consumers |
| UI_SPEC.md | Per-screen component spec | Frontend Developers, Designers |
| MCP_PLUGINS.md | MCP registry + routing + security | Developers, DevOps |
| GENERATORS.md | Generator design (deterministic + LLM) | QA Engineers, Developers |
| AUTONOMY.md | Per-workspace autonomy dial | Admins, QA Leads |
| AI_AGENT.md | Prompts + LangGraph + tool registry | AI/ML Engineers |
| BLACKBOX_UI_TESTING.md | Blackbox DOM engine | QA Engineers (test from URL only) |
| DESKTOP_TESTING.md | Desktop targets (computer-use, Electron, Slint) | QA Engineers (test desktop apps) |
| DEPLOYMENT.md | Compose / Helm / air-gapped | DevOps, SRE |
| TROUBLESHOOTING.md | Technical FAQ & common fixes | Everyone |
Yes. Suitest is open-source (Apache 2.0 License). No subscription fees. You can self-host without limits.
No. Create and manage test cases from the web dashboard. Executing them requires a validated workspace LLM and MCP provider.
For manual TCM, no. MCP execution, test runs, and AI features require a validated workspace LLM.
See Get Started in 3 Steps above. Just one command: npx @suiflex/suitest onboard
Yes. Suitest is self-hosted — your data never leaves your server. API keys are encrypted with AES-GCM. No mandatory telemetry.
Yes. Suitest can test: browsers (Playwright), APIs (HTTP/GraphQL/gRPC), databases (Postgres/Mongo/MySQL), mobile (Appium), desktop (Slint, Tauri), infrastructure (Kubernetes), and other MCP servers.
Check docs/TROUBLESHOOTING.md or open an issue at GitHub Issues.
Read CONTRIBUTING.md. In short:
- Read CLAUDE.md — coding rules
- Pick an unchecked item in ROADMAP.md
- Branch:
feat/<scope>-<short-desc> - Commits: conventional commits (
feat(api): ...) - Make sure
make cipasses before pushing
Yes. Run make demo → open http://localhost:3000 → login demo@suitest.dev / demo1234
Use the --port flag: npx @suiflex/suitest onboard --port 5000
Yes. Suitest supports Windows, macOS, and Linux. Make sure Node.js ≥ 18 and uv are installed.
| Feature | TestRail | Playwright | TestSprite | Suitest |
|---|---|---|---|---|
| Manual Test Case Management | ✅ | ❌ | Partial | ✅ |
| Automated Runner | ❌ | ✅ | ✅ | ✅ |
| Universal MCP Plugin Layer | ❌ | ❌ | Partial | ✅ |
| AI Generation / Diagnosis | ❌ | ❌ | ✅ | ✅ |
| Self-host | ✅ | ✅ | ❌ | ✅ |
| BYO LLM (100+ providers) | n/a | n/a | ❌ Locked | ✅ |
| Air-gapped | ✅ | ✅ | ❌ | ✅ (self-hosted model) |
| Open Source | ❌ | Runner only | ❌ | ✅ |
The whole workspace shares one version and ships on one vX.Y.Z tag. The two
packages you install directly:
| Package | What it carries | Update with |
|---|---|---|
@suiflex/suitest (launcher) |
Local platform: web dashboard + all Python wheels | npx @suiflex/suitest@latest onboard |
@suiflex/suitest-mcp (MCP server) |
IDE tools + lifecycle engine | npx -y @suiflex/suitest-mcp@latest |
Release notes: suitest.suiflex.dev/docs/changelog
- Read CLAUDE.md — coding conventions (also applies to AI coding agents)
- Pick the next unchecked item in docs/ROADMAP.md — one PR = one acceptance criterion
- Branch:
feat/<scope>-<short-desc>. Commits: conventional commits (feat(api): ...) - Before pushing:
make cimust pass (ruff + mypy strict, tsc strict + ESLint, pytest async + vitest)
See also CONTRIBUTING.md, CODE_OF_CONDUCT.md, and SECURITY.md.
Apache License 2.0. See LICENSE.
Built on Model Context Protocol (Anthropic), LiteLLM (BerriAI), LangGraph (LangChain), @ai-sdk/react + assistant-ui (Vercel), shadcn/ui, TanStack, and the FastAPI / SQLAlchemy / Pydantic ecosystems.
Suitest is a Suiflex project — powered by Suiflex.