Skip to content

[X-3975] Avoid "datafusion-testing" submodule update - #81

Draft
MassivePizza wants to merge 9 commits into
branch-55from
no-test-data-submodule
Draft

MassivePizza wants to merge 9 commits into
branch-55from
no-test-data-submodule

Conversation

@MassivePizza

@MassivePizza MassivePizza commented Sep 29, 2026 •

Copy link
Copy Markdown

Which issue does this PR close?

N/A

Rationale for this change

Reduces ~/.cargo/git/checkouts/arrow-datafusion-<hash>/<commit> checkout size from 1.44GB to 261MB.
It also avoids downloading roughly 324MB (809M unpacked) of submodules.

This primarily helps CI, and could save from 5s to 120s (depends on runner, save/restore become faster) and ~300MB per cache.

What changes are included in this PR?

.gitmodules changed to not update on init.

What is the testing strategy for this PR?

None.

Are there any user-facing changes?

No.
For devs, a manual submodule update is required when running tests that need said data.

@MassivePizza
MassivePizza marked this pull request as ready for review September 30, 2026 11:44
@MassivePizza
MassivePizza force-pushed the branch-55 branch 2 times, most recently from dd12f45 to 1e82195 Compare September 30, 2026 16:42
@MassivePizza
MassivePizza marked this pull request as draft October 1, 2026 13:55
@MassivePizza

Copy link
Copy Markdown
Author

Blocked on update to DF 55.1 or later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant