feat: add adaptive context productivity evaluation - #99
Merged
Merged
Conversation
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Validation
python -m pytest tests/ -q --ignore=tests/test_hosted_evidence.py --ignore=tests/test_hosted_ledger.py --ignore=tests/test_hosted_luna.pypython -m pytest tests/test_adaptive_context.py tests/test_productivity_eval.py tests/test_receipts.py -qruff check engraphis/core/__init__.py engraphis/core/adaptive_context.py engraphis/core/engine.py engraphis/core/grounded.py engraphis/core/store.py engraphis/service.py eval/productivity.py tests/test_adaptive_context.py tests/test_productivity_eval.pypython -m eval.productivity --dataset eval/datasets/codemem.jsonl --max-context-tokens 512 --retrieval-token-budget 256Unrelated, untracked private-evaluation work remains intentionally excluded from this PR.