Skip to content

feat: Contribution validation pipeline#8

Merged
scthornton merged 2 commits into
mainfrom
feature/contribution-validation
Mar 30, 2026
Merged

feat: Contribution validation pipeline#8
scthornton merged 2 commits into
mainfrom
feature/contribution-validation

Conversation

@scthornton

Copy link
Copy Markdown
Owner

Summary

  • Validation engine (validate.py) checks prompt submissions for quality, format, and duplicates
  • CLI command prompt-db validate <file> with --check-dupes flag
  • GitHub Actions workflow auto-validates when PRs touch submissions/ or *.jsonl files
  • Posts validation summary comment on PRs
  • submissions/ directory with JSONL template for contributors

Validation checks

Check Threshold
Minimum content 10+ characters
Maximum content 50,000 characters
Attack patterns 60+ regex patterns
Quality score 15+ / 100
Duplicate detection SHA256 content hash

Test plan

  • 45/45 tests passing
  • Lint + format clean
  • Valid attack prompts pass validation
  • Empty/short/non-attack content rejected
  • Duplicates detected against existing DB
  • JSONL and plain text file validation works

- `prompt-db validate <file>` — validate prompt submissions for quality, format, and duplicates
- Validation engine checks: min length, attack patterns, quality score, dedup
- GitHub Actions workflow auto-validates submissions/* on PRs
- Posts validation summary comment on PRs with submission files
- submissions/ directory with JSONL template for contributors
- 8 new tests covering valid/invalid/duplicate/file validation (45 total)
@scthornton scthornton merged commit 2ea5b96 into main Mar 30, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant