[4.19] Remove obsolete install overhead tests#4683
[4.19] Remove obsolete install overhead tests#4683hmeir wants to merge 1 commit intoRedHatQE:cnv-4.19from
Conversation
Remove the following tests that caused excessive false failures due to their brittle design based on resource comparison before/after installation: - test_cnv_resources_installed_cluster_scoped: Compared cluster-scoped resources before/after CNV installation. This test was unreliable because cluster resources change dynamically from other operators. - test_cnv_resources_installed_namespace_scoped: Compared namespaced resources before/after CNV installation. This test repeatedly failed due to ephemeral resources (Pods, ReplicaSets, PodMetrics, Jobs) created by the cluster that were not expected. The allowlist approach could never account for all dynamic resource variations across different cluster configurations. Also removed: - get_all_resources() utility function and related constants (only used by the removed tests) - Resource comparison allowlists that were specific to these tests - Unused fixtures: installation_data_dir, before_installation_all_resources, after_installation_all_resources The remaining tests (test_cnv_installation, test_cnv_installation_alert_cleanup, test_cnv_installation_without_hco_cr_alert, test_cnv_installation_without_hco_cr_metrics, test_default_storage_class_set) provide sufficient coverage for CNV installation validation without the brittleness of resource comparison tests. Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com> Signed-off-by: Harel Meir <hmeir@redhat.com>
|
Report bugs in Issues Welcome! 🎉This pull request will be automatically processed with the following features: 🔄 Automatic Actions
📋 Available CommandsPR Status Management
Review & Approval
Testing & Validation
Container Operations
Cherry-pick Operations
Label Management
✅ Merge RequirementsThis PR will be automatically approved when the following conditions are met:
📊 Review ProcessApprovers and ReviewersApprovers:
Reviewers:
Available Labels
AI Features
💡 Tips
For more information, please refer to the project documentation or contact the maintainers. |
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
/approve |
|
/verified |
Test execution plan request detailsCRITICAL: You MUST post an inline review comment on the first changed line of the first file. As an expert software testing engineer, analyze all modified files in this PR and create a targeted test execution plan. Analysis Requirements:
Your deliverable: Test Execution Plan
Guidelines:
Hardware-Related Checks (SR-IOV, GPU, DPDK): When PR modifies fixtures for hardware-specific resources:
CRITICAL WORKFLOW COMPLETION RULES: When responding to this test execution plan request, you MUST follow these rules EXACTLY:
ABSOLUTE PROHIBITIONS (violating these creates empty/meaningless reviews):
Remember: The pull request review is visible to users. Additional comments are redundant noise. CRITICAL: Before setting "Run smoke tests: True", you MUST use shell scripts to: |
|
Tip For best results, initiate chat on the files or code changes. 🧩 Analysis chain🏁 Script executed: Length of output: 16892 🏁 Script executed: Length of output: 641 🏁 Script executed: Length of output: 1463 🏁 Script executed: Length of output: 1735 |
|
/check-can-merge |
Short description:
Cherry-pick from #4652
More details:
What this PR does / why we need it:
Which issue(s) this PR fixes:
Special notes for reviewer:
jira-ticket:
https://redhat.atlassian.net/browse/CNV-86091