Skip to content

Skip CLI tests in Memleak - #995

Merged
st0012 merged 1 commit into
mainfrom
codex/skip-cli-tests-from-memleak
Aug 7, 2026
Merged

Skip CLI tests in Memleak#995
st0012 merged 1 commit into
mainfrom
codex/skip-cli-tests-from-memleak

Conversation

@st0012

@st0012 st0012 commented Aug 7, 2026

Copy link
Copy Markdown
Member

The CLI suite adds substantial time to the Memleak job as it grows. This change excludes test/cli_test.rb from ruby_test:valgrind and keeps it in the regular ruby_test task.

Date Daily median
Jul 24 36m
Jul 27–31 35m
Aug 3 37m
Aug 4 41m
Aug 5 57m
Aug 6 65m
Aug 7 65m

Assisted-By: devx/348380ff-5362-4e75-b229-8f6db00a32f6
@st0012
st0012 requested a review from a team as a code owner August 7, 2026 21:30

@alexcrocha alexcrocha left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we know what exactly in the cli tests is making memleak jobs so slow?

@st0012

st0012 commented Aug 7, 2026

Copy link
Copy Markdown
Member Author

I know which individual CLI tests dominate yet. RubyMemcheck runs the test process under Valgrind, so tests that perform more work generally add more time. And in cli tests, we run several full index cycles, which can be the reason.

@st0012
st0012 merged commit 34d641b into main Aug 7, 2026
30 checks passed
@st0012
st0012 deleted the codex/skip-cli-tests-from-memleak branch August 7, 2026 21:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants