Skip to content

feat(optimization): adopt official GEPA and SkillOpt engines#616

Merged
drewstone merged 20 commits into
mainfrom
feat/official-optimizer-runtime
Jul 24, 2026
Merged

feat(optimization): adopt official GEPA and SkillOpt engines#616
drewstone merged 20 commits into
mainfrom
feat/official-optimizer-runtime

Conversation

@drewstone

Copy link
Copy Markdown
Contributor

Summary

  • Route profile improvement through official GEPA, GEPA Omni, and Microsoft SkillOpt implementations supplied by @tangle-network/agent-eval@0.126.6.
  • Use one OptimizationMethod contract across prompt, skill, code, retrieval, knowledge, and memory candidate surfaces while keeping final-test scenarios outside optimizer input.
  • Authorize each exact candidate before execution and retain exact optimizer source, model, cost, resume, and activation evidence.
  • Isolate concurrent SWE candidates in independent Git worktrees and bind resume identity to the full Runtime, Bench, incumbent, and installed SWE judge implementations.
  • Remove retired local prompt, profile-diff, campaign OTLP, and record-only optimizer APIs; migrate Runtime, Bench, examples, skills, and docs.

Releases

  • @tangle-network/agent-runtime@0.105.0
  • @tangle-network/agent-bench@0.4.0
  • Requires @tangle-network/agent-eval@0.126.6 and @tangle-network/agent-knowledge@5.0.1.

Verification

  • pnpm test: 1,770 passed, 6 environment-only skipped.
  • pnpm typecheck; pnpm lint; pnpm verify:package; pnpm docs:freshness: passed.
  • pnpm verify:bench: 61/61 TypeScript files plus Pier bridge and packed TypeScript 5.9.3/6.0.3 consumers passed.
  • Packed wheel GEPA: 4 evaluations; resume cost remained $0.000037.
  • Packed Microsoft SkillOpt at 61735e3922efc2b90c6d6cab561e62e98452ca90: 3 evaluations.
  • Packed source GEPA Omni at f919db0a622e2e9f9204779b81fe00cc1b2d808f: 9 evaluations and 2 model requests.
  • Mutation checks proved exact candidate authorization, cost accounting, redaction, concurrent isolation, and implementation-bound resume identity.

drewstone added 20 commits July 24, 2026 01:24
…er-runtime

# Conflicts:
#	bench/package.json
#	docs/api/primitive-catalog.md
#	docs/canonical-api.md
#	package.json
#	pnpm-lock.yaml
…er-runtime

# Conflicts:
#	CHANGELOG.md
#	bench/src/benchmarks/humaneval.test.mts
#	docs/api/primitive-catalog.md
#	docs/canonical-api.md
#	pnpm-lock.yaml
…er-runtime

# Conflicts:
#	docs/architecture.md
#	docs/canonical-api.md
…er-runtime

# Conflicts:
#	bench/package.json

@tangletools tangletools left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Auto-approved drewstone PR — 970c1dd8

This PR was opened by the trusted drewstone account.
The full PR reviewer audit still runs separately and will publish findings if it detects issues.

tangletools · auto-approval · reason: drewstone_author · 2026-07-24T22:44:45Z

@drewstone
drewstone merged commit 7d6899a into main Jul 24, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants