[DX-2788] split CRE system tests into more buckets to balance execution time #21128
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.




TL;DR:
Integration test are faster by up to 10 minutes.
Before

After

This pull request introduces a new bucketing system for both the EVM read tests and the legacy V2 suite scenarios in the CRE system tests, enabling better runtime balancing and parallelization. It refactors the test suite structure to use these buckets, updates test runner logic accordingly, and ensures that each test case or scenario is assigned to exactly one bucket with validation. Additionally, some minor workflow and test cleanup changes are included.
Test suite bucketing and refactoring:
bucketing.gofiles inevm/evmread/configandv2suite/configto define and manage buckets for EVM read test cases and legacy V2 suite scenarios, including validation logic to ensure all cases are assigned exactly once.cre_suite_test.goto replace monolithic test functions with new bucket-based test runners:Test_CRE_V2_Suite_Bucket_A,Test_CRE_V2_Suite_Bucket_B,Test_CRE_V2_Suite_Bucket_Cfor legacy V2 suite scenarios, andTest_CRE_V2_EVM_Read_HeavyCalls,Test_CRE_V2_EVM_Read_StateQueries,Test_CRE_V2_EVM_Read_TxArtifactsfor EVM read tests.ExecuteEVMReadTestForCasesfunction.Workflow and test configuration updates:
.github/workflows/cre-system-tests.yamlto align with new bucket naming conventions and removed a deprecated topology.HTTPActionFailureTestto streamline test execution.Imports and dependency management:
Added new import statements for the bucketing configuration packages in
cre_suite_test.goto support the new structure.Single DON topology no longer used in the CI.