feat: test infrastructure + tutorial dataset system#253
Merged
pgierz merged 18 commits intoprep-releasefrom Mar 31, 2026
Merged
feat: test infrastructure + tutorial dataset system#253pgierz merged 18 commits intoprep-releasefrom
pgierz merged 18 commits intoprep-releasefrom
Conversation
4 tasks
pgierz
force-pushed
the
future/feat/test-infrastructure
branch
from
d8fc40b to
ff7450b
Compare
pgierz
changed the title
This was referenced Mar 30, 2026
pgierz
force-pushed
the
future/feat/test-infrastructure
branch
from
820ac5f to
2b85427
Compare
- Rewrite conftest.py with dynamic model fixture discovery via entry points - Add tests/contrib/models/awicm_recom/ as built-in model fixture - Add .github/scripts/discover_models.py for CI matrix generation - Refactor h5py threadsafe tests to use fixtures - Add data_fetcher.py and test_data_registry.yaml for centralized data management - Add generic model tests and integration test harness - Remove old hardcoded integration tests
- Add tutorial loader with entry-point model discovery - Add stub data generator from YAML manifests - Add data fetcher with pooch-based caching - Add AWICM-RECOM as built-in tutorial dataset - Add tutorial unit tests - Add documentation for model fixture development
"FESOM" is not a registered source_id in the CMIP6 CV, causing KeyError during global attribute generation. Changed to AWI-ESM-1-1-LR in all test configs and sample rules.
…r test - Remove @main pin from pycmor-test-data-fesom to pick up latest commits - Use model_run_instance.configs dict instead of config_path_cmip6/cmip7 properties (external packages override configs but not the base paths)
pgierz
force-pushed
the
future/feat/test-infrastructure
branch
from
2bff720 to
081502e
Compare
When tarball extraction logic changes (e.g., fixing double nesting), the cached extracted directories become stale. Set PYCMOR_FORCE_REEXTRACT=1 to force re-extraction on the next run. Also cleans up imports (moves sys, tarfile, shutil to top-level).
… versions - Revert single-test debug run back to full integration suite - Remove debug logging from get_variable - Add PYCMOR_FORCE_REEXTRACT=1 to all 4 integration test jobs to clear stale cached extractions from previous double-nesting bug
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Combines test infrastructure modernization (#253) and tutorial dataset system (#254) -- they have circular dependencies and must ship together.
Test Infrastructure
conftest.pywith dynamic model fixture discovery via entry pointstests/contrib/models/awicm_recom/as built-in model fixture.github/scripts/discover_models.pyfor CI matrix generationdata_fetcher.pyandtest_data_registry.yamlfor centralized data managementTutorial Dataset System
pycmor.tutorial.open_dataset())Test plan
🤖 Generated with Claude Code