Repository navigation
[CI] Reduce GitHub Actions usage #50169
Description
Describe the enhancement requested
See also: https://lists.apache.org/thread/drf0o5kzg1zfmok7gc09k8qz8hh9ymvh
We can use https://infra-reports.apache.org/#ghactions to see statistics.
Component(s)
Continuous Integration
Activity
kou commentedon Jun 14, 2026
https://infra-reports.apache.org/#ghactions&project=arrow&hours=168&limit=15&group=name shows that the "Package Linux" takes most hours (594 hours) in our workflows. Let's optimize the workflow as the first step.
rok commentedon Jun 15, 2026
This seems like a lot especially after #50047 brought down our run times significantly.
raulcd commentedon Jun 15, 2026
I see Python is the second most used workflow. I'll investigate whether it can also be reduced. Maybe some of the CI jobs could be moved to nightlies instead of per PR reducing the matrix.
pitrou commentedon Jun 15, 2026
That PR only addressed the C++ builds, though, not the Python or packaging builds.
kou commentedon Jun 16, 2026
We've reduced usages of top 2 workflows ("Package Linux" and "Python").
Let's revisit after a week.
Current numbers at https://infra-reports.apache.org/#ghactions&project=arrow&hours=168&limit=15&group=name :
kou commentedon Jun 24, 2026
Current numbers:
pitrou commentedon Jun 25, 2026
It seems the C/GLib/Ruby and R builds still use
actions/cache, should we migrate them too?pitrou commentedon Jun 25, 2026
Oh, and Integration too.
pitrou commentedon Jun 30, 2026
Homebrew installs are often very slow (several minutes), can they be sped up with caching?
kou commentedon Jul 1, 2026
I think that we can speed up Homebrew installs by removing
brew update:arrow/.github/workflows/cpp.yml
Lines 242 to 244 in f349102