Skip to content

v0.3-T6 — ahc coverage (rule coverage + budget utilization) #126

Description

@sv-pro

Summary

Implement ahc coverage <manifest> <benchmark-result> — annotate which manifest rules were exercised vs. never triggered by the benchmark, and which budget buckets were hit vs. unreachable.

Depends on: #124 (simulate), #125 (diff)

Scope

  • Parse benchmark result traces; match each decision to the manifest rule that produced it
  • Report: exercised rules (green), untriggered rules (yellow/dead), unreachable escalations (red)
  • Budget utilization: which budget buckets were hit, which are unreachable given the scenario set
  • Must identify at least one dead rule in the workspace manifest (acceptance criterion)

Key Files

  • src/agent_hypervisor/compiler/cli.py — add coverage command
  • tests/compiler/test_coverage.py — new test file

Acceptance Criteria

  • ahc coverage manifests/workspace_v2.yaml research/benchmarks/ outputs rule coverage report
  • At least one dead manifest rule identified in workspace manifest
  • Budget utilization section shows which budget buckets were exercised
  • pytest tests/compiler/test_coverage.py -v passes

Milestone

v0.3

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions