Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 26 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,32 @@ All notable changes to this project are documented here. The format follows [Kee

## [Unreleased]

## [0.2.0-alpha.1] — 2026-08-18

### Added — context behavior audit
- Added `denser audit` and the `audit_context` Python interface for comparing a
baseline with any rewritten, selectively loaded, or externally compacted
textual context snapshot.
- A positive verdict now requires exact covered-case parity plus a detected
regression in a caller-supplied known-bad negative control. Equal scores
without a sensitive control are reported as inconclusive.
- Audit reports separate local asset-length estimates from provider-reported
full input usage, so file compression is not presented as end-to-end savings.
- Added an explicit Codex CLI `text-only` capability profile for pre-bundled
tasks that need no tools, files, network, plugins, apps, skills, or memory.
A seeded, randomized, three-trial audit completed all 84 paired-profile calls
without operational errors or transport fallbacks. Both profiles passed all
covered cases while `text-only` reduced provider-reported input per call by
10.55% and 10.60% across the two workloads.
- Added a reproducible capability-profile benchmark and a public per-call
evidence report. An initial strict run exposed one missing output-contract
behavior; `text-only/v1` fixes that boundary and the full audit was rerun.

### Changed — behavior-fidelity pivot
- Repositioned denser from a compression-first tool to an evidence layer for
context changes. Existing compression and density commands remain available
as experimental candidate-generation tools.

### Added — deterministic behavior replay
- Added `denser replay` and a Python replay API that run instruction assets as
system instructions against explicit workload prompts.
Expand Down
10 changes: 5 additions & 5 deletions CITATION.cff
Original file line number Diff line number Diff line change
Expand Up @@ -4,14 +4,14 @@ authors:
- family-names: Wang
given-names: Bill
alias: BillWang
title: "denser: Evidence-Guided Refactoring for LLM Instructions"
version: 0.1.0
date-released: 2026-04-14
title: "denser: Behavior-Fidelity Audits for Version-Controlled LLM Context"
version: 0.2.0-alpha.1
date-released: 2026-08-18
url: "https://github.com/Evostructs/denser"
license: Apache-2.0
keywords:
- large-language-models
- prompt-engineering
- prompt-compression
- context-optimization
- regression-testing
- agents
- behavior-evaluation
201 changes: 145 additions & 56 deletions README.md

Large diffs are not rendered by default.

18 changes: 18 additions & 0 deletions benchmarks/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,24 @@ Runs the small bundled example corpus for development. This is not yet a
publishable behavior benchmark: the default fixtures are structural checks and
the corpus has eight worked examples.

## Paired Codex capability-profile audit

The repository's strongest end-to-end token claim is reproduced by running the
same frozen behavior cases under Codex CLI `standard` and `text-only` profiles.
Calls are submitted in a seeded randomized order, with three trials per case by
default. The script refuses to overwrite an existing report.

```bash
python benchmarks/codex_profile_audit.py \
--trials 3 --workers 8 --seed 20260817 --respect-system-proxy \
--output build/codex-profile-audit.json
```

This performs 84 authenticated Codex calls. Use `text-only` only for workloads
that need no files, commands, network, plugins, apps, skills, or memory. The
published run and exact interpretation are documented in
[`docs/CODEX_TEXT_ONLY_CASE_STUDY.md`](../docs/CODEX_TEXT_ONLY_CASE_STUDY.md).

## What it does

1. Iterates over all curated example pairs in `examples/`
Expand Down
Loading