Skip to content

feat(cli): CLI — setup wizard, suites, config, insights#44

Open
Sebabaian wants to merge 1 commit into
mainfrom
feat/premium-cli
Open

feat(cli): CLI — setup wizard, suites, config, insights#44
Sebabaian wants to merge 1 commit into
mainfrom
feat/premium-cli

Conversation

@Sebabaian

Copy link
Copy Markdown
Collaborator

Adds a polished, discoverable CLI on top of the existing engine:

  • ifixai setup: interactive wizard (provider/model/multi-judge/fixture/suite/ mode) that writes a reusable ifixai.yaml and can run immediately.
  • ifixai.yaml config layered under flags (flag > config > env > default); stores only the API-key env-var name, never the secret.
  • --suite selector (smoke/strategic/core/extended/all + security/reliability/ compliance/frontier themes) plus 'list suites' and 'list categories'.
  • rich/questionary UI behind ifixai/cli/ui.py with graceful non-TTY/NO_COLOR fallback; redesigned scorecard (grade badge, score bars, insights, exploratory panel).
  • Reports split into a short -summary.md plus the full .md and JSON insights.
  • Friendly error handling: classify auth/quota errors, stop retrying them, suppress tracebacks by default (IFIXAI_DEBUG to restore).
  • Fixture library: example fixtures are now listed and resolvable by name.

Explicit CLI selectors (--strategic/-b/-c) take precedence over a config suite. New deps: rich, questionary.

Adds a polished, discoverable CLI on top of the existing engine:

- ifixai setup: interactive wizard (provider/model/multi-judge/fixture/suite/
  mode) that writes a reusable ifixai.yaml and can run immediately.
- ifixai.yaml config layered under flags (flag > config > env > default);
  stores only the API-key env-var name, never the secret.
- --suite selector (smoke/strategic/core/extended/all + security/reliability/
  compliance/frontier themes) plus 'list suites' and 'list categories'.
- rich/questionary UI behind ifixai/cli/ui.py with graceful non-TTY/NO_COLOR
  fallback; redesigned scorecard (grade badge, score bars, insights,
  exploratory panel).
- Reports split into a short -summary.md plus the full .md and JSON insights.
- Friendly error handling: classify auth/quota errors, stop retrying them,
  suppress tracebacks by default (IFIXAI_DEBUG to restore).
- Fixture library: example fixtures are now listed and resolvable by name.

Explicit CLI selectors (--strategic/-b/-c) take precedence over a config suite.
New deps: rich, questionary.
@stefyi-4355 stefyi-4355 changed the title feat(cli): premium CLI — setup wizard, suites, config, insights feat(cli): CLI — setup wizard, suites, config, insights Jun 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants