Skip to content

Add preregistered uv public-project validation - #5

Merged
Evostructs merged 2 commits into
mainfrom
agent/uv-public-pilot-main
Aug 18, 2026
Merged

Add preregistered uv public-project validation#5
Evostructs merged 2 commits into
mainfrom
agent/uv-public-pilot-main

Conversation

@Evostructs

Copy link
Copy Markdown
Owner

What changed

  • add a frozen, attributed uv public-project corpus with 14 preregistered decision cases
  • extend the Codex profile benchmark with an explicit uv-public-pilot scenario set
  • publish the complete sanitized 84-call report and document the result
  • bump the package to 0.2.0a2

Why

The earlier result used denser-owned workloads. This checks whether the same text-only capability profile transfers to rules derived from a real public project without changing expected decisions.

Result

  • issue triage: 24/24 in each profile; full input per call reduced 10.50%
  • workflow failure: 18/18 in each profile; full input per call reduced 10.74%
  • 84 total authenticated calls; zero operational errors; zero transport fallbacks

The cases and success rule were committed before the run. This is an external-project corpus run by denser maintainers, not an independent reproduction or Astral endorsement.

Validation

  • ruff check .
  • ruff format --check .
  • mypy denser
  • pytest -q (182 passed, 2 deselected)
  • package build and wheel-content smoke check
  • independent call-count, result, source-hash, and sensitive-shape checks

@Evostructs
Evostructs merged commit a8b31b1 into main Aug 18, 2026
5 checks passed
@Evostructs
Evostructs deleted the agent/uv-public-pilot-main branch August 18, 2026 05:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant