VALUE-01D — Execute and retain the representative real-device run

[daniele21]

Goal

Close VALUE-01 with one retained REAL_ENVIRONMENT execution after the deterministic/browser/evidence tooling is integrated.

Depends on

• VALUE-01A (VALUE-01A — Real browser loop against Local LLM Server #117) real browser loop integrated;
• VALUE-01B (VALUE-01B — Verify real evidence completeness and portability #118) evidence verifier integrated;
• VALUE-01C (VALUE-01C — One-command real-run readiness and retained manifest #119) bounded real-run entry point integrated;
• current applicable PRE_REAL/Built Product readiness still PASS on the exact implementation head.

Target environment

Representative device + daniele21/local-llm-server + one real resident model. This cannot be replaced by hosted CI or a fake endpoint.

Acceptance

• /v1/models discovery succeeds for the selected real model;
• local-llm-identity-v1 is required and retained in the frozen execution fingerprint;
• /status is sampled with explicit runtime provenance;
• the built Performance Lab browser path completes Test a model against real inference;
• Run Detail and at least one Sample Evidence view are inspected and retained through bounded screenshot/trace evidence;
• canonical store contains the completed immutable Run;
• .plab.zip is exported and VALUE-01B verifier reports PASS against the real artifacts;
• exact config, source revision, run id, device/runtime/model identity and evidence paths are retained;
• missing/unavailable evidence remains explicit;
• no Performance Lab-owned process/listener residue remains after completion.

Completion

On PASS:

• mark EVID-001 DONE;
• mark VALUE-01 DONE and VALUE-02 READY;
• update docs/current-state.md and the active delivery workstream with only the durable state transition;
• do not infer repeatability, thermal, multi-model or regression claims from this single run.

[daniele21]

VALUE-01D readiness — exact-head PRE_REAL retained

Software convergence is complete and the representative-device gate is READY.

Integrated implementation

• dev: 796dc110ca13ce84d9ed726ed85cac8ba6aeda63
• VALUE-01A / VALUE-01A — Real browser loop against Local LLM Server #117: DONE
• VALUE-01B / VALUE-01B — Verify real evidence completeness and portability #118: DONE
• VALUE-01C / VALUE-01C — One-command real-run readiness and retained manifest #119: DONE

PRE_REAL evidence

Validation-only PR #127 completed all four repository-owned workflows successfully and was closed without merge.

Built Product run: 33661537205
Artifact: pre-real-e2e-33661537205-1
Artifact digest: sha256:a715ab0af47e33342b765e52dfdfd71c54244af005b87f2bbe482969655aa27f
Manifest: PRE_REAL_E2E = PASS, ready_for_real_environment = true.

The PR workflow checkout records synthetic merge revision 1ee1b27edcb21db78669dc8d81518134ea5f20d4. Its tree is byte-for-byte equivalent to integrated dev (GitHub compare reports zero changed files). To preserve exact-head semantics after PR #127 closure, that commit is retained as:

evidence/value-01d-pre-real-796dc110

The representative run must execute from that exact evidence branch/commit so #119's source-revision guard remains valid.

Representative Mac execution

With Local LLM Server running at http://127.0.0.1:1235 and resident model nemotron-nano-4b-q8:

git fetch origin evidence/value-01d-pre-real-796dc110
git checkout --detach 1ee1b27edcb21db78669dc8d81518134ea5f20d4

# Restore the retained exact-head PRE_REAL artifact.
rm -rf build/pre-real-e2e
gh run download 33661537205 \
  -n pre-real-e2e-33661537205-1 \
  -D build/pre-real-e2e

# Repository setup/build required by the real-browser launcher.
uv python install 3.12
uv sync --extra dev --locked
corepack enable
corepack install --global pnpm@11.24.0
pnpm --dir frontend install --frozen-lockfile
pnpm --dir frontend exec playwright install chromium
pnpm --dir frontend run build

# Bounded canonical real run + store/bundle/manifest.
uv run --extra dev --locked python tests/real_runtime/smoke_local_llm_server.py \
  --base-url http://127.0.0.1:1235 \
  --model nemotron-nano-4b-q8 \
  --output-dir .performance-lab/value01-real \
  --pre-real-manifest build/pre-real-e2e/manifest.json

# Built-browser Test a model -> Run Detail -> Sample Evidence path.
uv run --extra dev --locked python tests/real_runtime/browser_local_llm_server.py \
  --base-url http://127.0.0.1:1235 \
  --model nemotron-nano-4b-q8 \
  --output-dir .performance-lab/value01-real-browser

After the first command prints its PASS manifest, use its run_id, store_path and bundle_path with:

uv run --extra dev --locked python tests/real_runtime/verify_value01_evidence.py \
  --store <store_path> \
  --bundle <bundle_path> \
  --run-id <run_id> \
  --output .performance-lab/value01-real/value01b-verification.json

VALUE-01 may be marked DONE only if the real run, real browser journey and VALUE-01B verifier all PASS. This execution cannot be substituted by GitHub-hosted CI because RUNTIME-1 explicitly requires real-runtime-device / target-environment evidence.

[daniele21]

VALUE-01D freshness recheck — 2026-09-02

The representative-device handoff is still valid and has not been invalidated by repository movement.

• dev is still exactly 796dc110ca13ce84d9ed726ed85cac8ba6aeda63.
• Evidence branch evidence/value-01d-pre-real-796dc110 still exists at 1ee1b27edcb21db78669dc8d81518134ea5f20d4.
• The evidence commit and current dev share the same tree SHA: 67d6ac4090e9c7a8f28009947b72a4bedf931224.
• PRE_REAL artifact pre-real-e2e-33661537205-1 is still available and unexpired.
• Retained artifact digest remains sha256:a715ab0af47e33342b765e52dfdfd71c54244af005b87f2bbe482969655aa27f.
• GitHub retention currently expires that artifact on 2026-09-09T17:35:24Z.
• No representative real-run result has been posted yet.

No source change is being made while this gate is pending, because moving dev would invalidate the exact-head PRE_REAL handoff. The next valid action remains the documented REAL_ENVIRONMENT run on the representative Mac, followed by the VALUE-01B verifier.

[daniele21]

VALUE-01D readiness refreshed after source-revision drift — 2026-09-03

The previous PRE_REAL handoff based on dev@796dc110ca13ce84d9ed726ed85cac8ba6aeda63 is superseded. A README-only commit moved dev, which is enough to invalidate the exact source-revision guard even though executable product code did not change.

Current exact product identity

• current dev: 98a32f4f123df8355589768174da81757f592839
• current tree: 0b2576c1a0dcc66a8a54a620be70e257bd1b9469
• preserved validation revision: daf5cfd8a756e22e1cc3c59b3690292a5a0a384e
• preserved branch: evidence/value-01d-pre-real-98a32f4f
• GitHub compare dev -> preserved branch: zero changed files; both resolve to the same product tree.

Fresh repository-owned validation

Validation-only PR #142 completed on the exact product tree:

• Repository Health: PASS
• Repository Validation: PASS
• Browser Acceptance: PASS
• Built Product: PASS

Built Product run: 33738861938
PRE_REAL artifact: pre-real-e2e-33738861938-1
Artifact digest: sha256:abdf448b9f85b87c43262047239b35e9c11d47186dd411a0f411439acb1fb6b0
Artifact expiry: 2026-09-10T09:28:42Z

The retained manifest.json reports:

• gate_id = PRE_REAL_E2E
• status = PASS
• browser J0-J9 layer = PASS
• packaged J0/J1/J8/J9 layer = PASS
• source_revision = daf5cfd8a756e22e1cc3c59b3690292a5a0a384e
• ready_for_real_environment = true
• residual gate = RUNTIME-1 (real external runtime/model/device; physical telemetry/thermal claims remain unproven).

Representative Mac execution — current handoff

With Local LLM Server running at http://127.0.0.1:1235 and resident model nemotron-nano-4b-q8:

git fetch origin evidence/value-01d-pre-real-98a32f4f
git checkout --detach daf5cfd8a756e22e1cc3c59b3690292a5a0a384e

rm -rf build/pre-real-e2e
gh run download 33738861938 \
  -n pre-real-e2e-33738861938-1 \
  -D build/pre-real-e2e

uv python install 3.12
uv sync --extra dev --locked
corepack enable
corepack install --global pnpm@11.24.0
pnpm --dir frontend install --frozen-lockfile
pnpm --dir frontend exec playwright install chromium
pnpm --dir frontend run build

uv run --extra dev --locked python tests/real_runtime/smoke_local_llm_server.py \
  --base-url http://127.0.0.1:1235 \
  --model nemotron-nano-4b-q8 \
  --output-dir .performance-lab/value01-real \
  --pre-real-manifest build/pre-real-e2e/manifest.json

uv run --extra dev --locked python tests/real_runtime/browser_local_llm_server.py \
  --base-url http://127.0.0.1:1235 \
  --model nemotron-nano-4b-q8 \
  --output-dir .performance-lab/value01-real-browser

After the smoke command reports PASS, run the retained-evidence verifier with the emitted run_id, store_path and bundle_path:

uv run --extra dev --locked python tests/real_runtime/verify_value01_evidence.py \
  --store <store_path> \
  --bundle <bundle_path> \
  --run-id <run_id> \
  --output .performance-lab/value01-real/value01b-verification.json

VALUE-01D remains READY / REAL_ENVIRONMENT, not DONE. Do not infer multi-model/repeatability/thermal claims from this run. Any later movement of dev before execution invalidates this source-revision handoff again and requires a fresh PRE_REAL.

[daniele21]

Operator handoff — single copy/paste REAL_ENVIRONMENT run

Current repository identity rechecked before this handoff:

• dev = 98a32f4f123df8355589768174da81757f592839
• retained validation revision = daf5cfd8a756e22e1cc3c59b3690292a5a0a384e
• retained branch = evidence/value-01d-pre-real-98a32f4f
• PRE_REAL run = 33738861938
• PRE_REAL artifact = pre-real-e2e-33738861938-1

No representative real-run result is present yet. Run the following from the Performance Lab checkout on the representative Mac while Local LLM Server is already serving nemotron-nano-4b-q8 at http://127.0.0.1:1235.

set -euo pipefail

BASE_URL="http://127.0.0.1:1235"
MODEL="nemotron-nano-4b-q8"
REV="daf5cfd8a756e22e1cc3c59b3690292a5a0a384e"
OUT=".performance-lab/value01-real"
BROWSER_OUT=".performance-lab/value01-real-browser"
RUN_ID="value01-real-$(date -u +%Y%m%dT%H%M%SZ)"
MANIFEST="$OUT/$RUN_ID.manifest.json"
VERIFY_OUT="$OUT/value01b-verification.json"

# Fail fast if the real Local LLM Server is not reachable.
curl -fsS "$BASE_URL/v1/models" >/dev/null

# Exact retained source/evidence identity.
git fetch origin evidence/value-01d-pre-real-98a32f4f
git checkout --detach "$REV"
test "$(git rev-parse HEAD)" = "$REV"

rm -rf build/pre-real-e2e
mkdir -p "$OUT" "$BROWSER_OUT"
gh run download 33738861938 \
  -n pre-real-e2e-33738861938-1 \
  -D build/pre-real-e2e

# Repository setup/build required by the real-browser launcher.
uv python install 3.12
uv sync --extra dev --locked
corepack enable
corepack install --global pnpm@11.24.0
pnpm --dir frontend install --frozen-lockfile
pnpm --dir frontend exec playwright install chromium
pnpm --dir frontend run build

# 1) Canonical real inference run with required LLS identity + /status telemetry.
uv run --extra dev --locked python tests/real_runtime/smoke_local_llm_server.py \
  --base-url "$BASE_URL" \
  --model "$MODEL" \
  --run-id "$RUN_ID" \
  --manifest "$MANIFEST" \
  --output-dir "$OUT" \
  --pre-real-manifest build/pre-real-e2e/manifest.json

# Resolve the bundle retained by the smoke manifest without relying on jq.
BUNDLE="$(uv run --extra dev --locked python -c 'import json,sys; print(json.load(open(sys.argv[1], encoding="utf-8"))["bundle_path"])' "$MANIFEST")"

# 2) Built-browser Test a model -> Run Detail -> Sample Evidence against the real LLS.
uv run --extra dev --locked python tests/real_runtime/browser_local_llm_server.py \
  --base-url "$BASE_URL" \
  --model "$MODEL" \
  --output-dir "$BROWSER_OUT"

# 3) Retained evidence verifier.
uv run --extra dev --locked python tests/real_runtime/verify_value01_evidence.py \
  --store "$OUT/runs.sqlite3" \
  --bundle "$BUNDLE" \
  --run-id "$RUN_ID" \
  --output "$VERIFY_OUT"

# Final operator-visible verdict and evidence locations.
echo "SOURCE_REVISION=$(git rev-parse HEAD)"
echo "RUN_ID=$RUN_ID"
echo "SMOKE_MANIFEST=$MANIFEST"
echo "STORE=$OUT/runs.sqlite3"
echo "BUNDLE=$BUNDLE"
echo "VERIFIER=$VERIFY_OUT"
echo "BROWSER_EVIDENCE=$BROWSER_OUT"
cat "$VERIFY_OUT"

PASS handling

Do not mark VALUE-01 complete from command exit alone. Retain/post:

1. the smoke manifest ($MANIFEST);
2. value01b-verification.json;
3. the .plab.zip path/artifact;
4. browser report.json plus its retained Playwright screenshots/trace/video evidence;
5. source revision + run id + LLS/model/device identity.

Only when smoke + browser + verifier are all PASS should #120 transition EVID-001 / VALUE-01 to DONE and unblock VALUE-02 integration. Any failure should be classified at the owning boundary rather than bypassed.

[daniele21]

VALUE-01D handoff refreshed under repo-template-sw 0.9.1 — 2026-09-03

dev moved to aad1c4d66cb12b299dacb47c82e373cb96f4227c when PR #139 adopted repo-template-sw 0.9.1. The previous daf5cfd8... PRE_REAL handoff is therefore superseded for the current tree.

No extra validation-only PR is required: #139 already produced FULL integration evidence on d13c44efb0f6e082e199a0d64c755a8da936a8c9, and the repository's 0.9.1 post-merge reuse contract applies exactly:

• validated source revision: d13c44efb0f6e082e199a0d64c755a8da936a8c9
• validated source tree: 6cfbe249b8797a226a47c80450c1b46de29f50da
• validated target/base: 98a32f4f123df8355589768174da81757f592839
• current dev: aad1c4d66cb12b299dacb47c82e373cb96f4227c
• current dev tree: 6cfbe249b8797a226a47c80450c1b46de29f50da
• current merge parent: 98a32f4f123df8355589768174da81757f592839
• therefore the current dev tree is content-equivalent to the validated source tree with the same validated target/base.

The VALUE-01C runner still intentionally requires exact source_revision equality with the PRE_REAL manifest, so the representative run must execute from the preserved validated revision, not directly from the squash-merge SHA. That revision is now retained as:

evidence/value-01d-pre-real-aad1c4d6

Fresh PRE_REAL evidence from #139

Repository Validation run: 33741945996
Built Product job: PASS
Artifact: pre-real-e2e-33741945996-1
Artifact digest: sha256:5f9a97810ed343a7c8c20b64718073e9825531d4f859cee763bcd22e5a143dd4
Artifact expiry: 2026-09-10T10:02:31Z
Manifest: PRE_REAL_E2E = PASS, ready_for_real_environment = true, browser source_revision = d13c44efb0f6e082e199a0d64c755a8da936a8c9.

Current representative Mac command

With Local LLM Server at http://127.0.0.1:1235 and resident model nemotron-nano-4b-q8:

git fetch origin evidence/value-01d-pre-real-aad1c4d6
git checkout --detach d13c44efb0f6e082e199a0d64c755a8da936a8c9

rm -rf build/pre-real-e2e
gh run download 33741945996 \
  -n pre-real-e2e-33741945996-1 \
  -D build/pre-real-e2e

uv python install 3.12
uv sync --extra dev --locked
corepack enable
corepack install --global pnpm@11.24.0
pnpm --dir frontend install --frozen-lockfile
pnpm --dir frontend exec playwright install chromium
pnpm --dir frontend run build

uv run --extra dev --locked python tests/real_runtime/smoke_local_llm_server.py \
  --base-url http://127.0.0.1:1235 \
  --model nemotron-nano-4b-q8 \
  --output-dir .performance-lab/value01-real \
  --pre-real-manifest build/pre-real-e2e/manifest.json

uv run --extra dev --locked python tests/real_runtime/browser_local_llm_server.py \
  --base-url http://127.0.0.1:1235 \
  --model nemotron-nano-4b-q8 \
  --output-dir .performance-lab/value01-real-browser

Then run tests/real_runtime/verify_value01_evidence.py against the printed run_id, store_path and bundle_path as already documented above.

This is still only READY_FOR_REAL_ENVIRONMENT. #120 remains open until the real Mac smoke + browser journey + VALUE-01B verifier all PASS.

[daniele21]

Integration state changed intentionally for manual testing — 2026-09-03

The previous VALUE-01D PRE_REAL handoff is no longer the current dev identity.

Per explicit product-owner direction to integrate the completed VALUE-02 software and test the product end-to-end, PR #141 was promoted through the repository's 0.9.1 INTEGRATION / STRONG validation and merged to dev.

Current dev:

• commit: 0b9c376f2dbcbb167f8df8488374c1b0c5d0ace2
• tree: 9ca93c223950cf44c2d235ea3ce8cb62148aa66b
• merged change: VALUE-02A/B/C multi-model decision software

Therefore the previously retained VALUE-01 PRE_REAL artifacts remain historical evidence only and must not be used as exact-revision readiness evidence for current dev.

The next representative-device evidence should be generated/tested against the current integrated tree. No claim of VALUE-01D PASS is made by this merge.

[daniele21]

VALUE-01D exact-tree PRE_REAL refreshed — 2026-09-03

The current integrated dev tree is now READY_FOR_REAL_ENVIRONMENT for the representative VALUE-01D run.

Exact product identity

• current dev: f07232aaf92ea4f90d0da88290c9b7db97f3145e
• validation-only commit: 001fcd33ab2686032f6062a8b4c2351f77e0a6bb
• shared tree: 29757436d4fa81b87f2a277cc310544be4a25f8b
• evidence branch: evidence/value01-value02-pre-real-f07232aa
• GitHub compare: one empty commit ahead, zero changed files

Repository-owned validation

Validation-only PR #151 deliberately resolved an empty diff, so the 0.9.1 selector failed safe to INTEGRATION / FULL with repository guards, Python, frontend, product E2E, browser E2E and Built Product required.

• Repository Health run 33774603136: PASS
• Repository Validation run 33774603131: PASS
• Python 3.12: PASS
• Python 3.13: PASS
• Built Product: PASS
• browser PRE_REAL J0-J9: PASS
• packaged J0/J1/J8/J9: PASS
• final PRE_REAL_E2E: PASS
• ready_for_real_environment: true

PRE_REAL artifact:

• pre-real-e2e-33774603131-1
• artifact id 9901114524
• digest sha256:9ab4819deac767a81c2c491c3f3cbe7bb45056028ccc5b6f4f9ed71a830a7adf
• expires 2026-09-10T15:48:33Z

The manifest correctly retains only these residual gaps: external real inference runtime/model, representative target hardware, and real thermal/device telemetry. Hosted CI does not satisfy them.

Representative Mac handoff

With Local LLM Server running on the representative Mac and the desired resident model available from /v1/models:

git fetch origin evidence/value01-value02-pre-real-f07232aa
git checkout --detach 001fcd33ab2686032f6062a8b4c2351f77e0a6bb

rm -rf build/pre-real-e2e
gh run download 33774603131 \
  -n pre-real-e2e-33774603131-1 \
  -D build/pre-real-e2e

uv python install 3.12
uv sync --extra dev --locked
corepack enable
corepack install --global pnpm@11.24.0
pnpm --dir frontend install --frozen-lockfile
pnpm --dir frontend exec playwright install chromium
pnpm --dir frontend run build

uv run --extra dev --locked python tests/real_runtime/smoke_local_llm_server.py \
  --base-url http://127.0.0.1:1235 \
  --model <runtime-key-or-model-id> \
  --output-dir .performance-lab/value01-real \
  --pre-real-manifest build/pre-real-e2e/manifest.json

uv run --extra dev --locked python tests/real_runtime/browser_local_llm_server.py \
  --base-url http://127.0.0.1:1235 \
  --model <runtime-key-or-model-id> \
  --output-dir .performance-lab/value01-real-browser

Then run the verifier with the run_id, store_path and bundle_path printed by the smoke manifest:

uv run --extra dev --locked python tests/real_runtime/verify_value01_evidence.py \
  --store <store_path> \
  --bundle <bundle_path> \
  --run-id <run_id> \
  --output .performance-lab/value01-real/value01b-verification.json

VALUE-01 may be marked DONE only when the real smoke, real browser journey and VALUE-01B verifier all PASS. After that, VALUE-02D #132 becomes the next representative convergence gate.