Skip to content

[Classification] Implement environment, network, workflow-configuration, and unknown rule families #23

Description

@Dyu20705

Problem statement

Infrastructure, permissions, workflow configuration, and unsupported evidence must be separated conservatively from application-code failures. The engine needs explicit unknown behavior when evidence is weak, contradictory, or outside the support boundary.

Categories

  • environment_permissions
  • network_rate_limit
  • workflow_configuration
  • unknown

Checklist

  • Define stable rule ids, versions, descriptions, and priority metadata
  • Implement missing environment variable, permission, secret/configuration, disk/resource, and runner setup signatures
  • Implement network, registry, DNS, timeout, transient service, and API rate-limit signatures
  • Implement malformed workflow, invalid expression/matrix, missing workflow input, invalid action configuration, and unsupported action/runtime signatures
  • Distinguish workflow configuration from dependency and application-code failures
  • Implement unknown for unsupported, insufficient, contradictory, and no-evidence cases
  • Keep temporal assessment separate; do not confirm flaky behavior from one failure
  • Require evidence references and documented rule-strength inputs
  • Add safe recommended actions that do not expose secret values
  • Add positive, negative, ambiguous, multi-signal, and adversarial fixtures

Acceptance criteria

Dependencies

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:classificationFailure classification, confidence, and explanation signalsarea:securityAuthentication, permissions, secret safety, and secure behaviorarea:testingFixtures, automated tests, QA, and validationpriority:criticalCritical path or release-blocking worktype:featureUser-facing product capability

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions