Skip to content

CI/CD audit: 60+ suites, brittle string guards, solo-maintainer overhead #714

Description

@BaseInfinity

Problem

CI runs 60+ test suites. Two failed on v1.100.0 due to brittle string matching (stale version in SDLC.md, overly strict 95% grep in test-self-update.sh) — neither was a real regression.

For a solo-maintainer repo where all tests run locally, the cost/benefit is questionable:

  • Keeps: branch protection gate, Linux/macOS env parity
  • Costs: brittle guards false-fail on content changes, block releases for test-grep fixes

Options

  1. Gut it — keep only structural tests (version parity, file existence, hook wiring), drop content greps
  2. Tier it — fast gate (structural) blocks merge, slow suite (content) is advisory
  3. Keep as-is — accept the overhead, fix greps as they break

Context

v1.100.0 release: 2 CI failures, both test-string issues, 0 real regressions. The release ran all tests locally first.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestlane:frontierFrontier lane — Opus 5 + GPT-5.6 Sol + Fable on @frontierlane:reliableReliable lane — Opus 4.6[1m] + GPT-5.5 + Fable on @latest

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions