Skip to content

Build Adversarial Prompt Security Test Suite #105

@coderabbitai

Description

@coderabbitai

🔐 Security Regression Testing

Description

Since TENET is designed to detect prompt injection and jailbreak attempts, build a dedicated adversarial test suite to validate detection quality and prevent regressions.

Tasks

  • Curate a known jailbreak dataset (documented real-world examples)
  • Build an injection payload dataset covering various attack vectors
  • Implement regression testing against the detection engine
  • Track detection scores per category and version
  • Integrate the test suite into the CI pipeline
  • Document how to add new adversarial test cases

Difficulty: 🔴 Hard

Labels: security enhancement production-ready SSoC26

Core to TENET's mission — ensuring the detection engine stays sharp as the codebase evolves!

Metadata

Metadata

Assignees

No one assigned

    Labels

    Hard40 ptsSSoC26Social Summer of Code 2026 S5enhancementNew feature or requestproduction-readyProduction readinesssecuritySecurity related

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions