Skip to content

CI: update pyarrow-nightly pixi env before installing to avoid stale locked wheel - #67059

Merged
jorisvandenbossche merged 5 commits into
pandas-dev:mainfrom
jorisvandenbossche:ci-pixi-pyarrow-nightly
Sep 1, 2026
Merged

jorisvandenbossche merged 5 commits into
pandas-dev:mainfrom
jorisvandenbossche:ci-pixi-pyarrow-nightly

Conversation

@jorisvandenbossche

Copy link
Copy Markdown
Member

Based on the suggestion at prefix-dev/pixi#6186 (comment), trying to fix #65690 (comment)

@jorisvandenbossche jorisvandenbossche added the CI Continuous Integration label Aug 28, 2026
@jorisvandenbossche

Copy link
Copy Markdown
Member Author

This seems to work (the env gets set up here, while on main and in other PRs it is currently failing again as it is the end of the week).
Small disadvantage of having the setup-pixi action twice (although updating the version pins gets automated anyway), but trying to combine it in one step became a bit unreadable (the cache and environments keys can not be specified for run-install: false)

@jorisvandenbossche

Copy link
Copy Markdown
Member Author

@mroeschke what do you think here?

@mroeschke mroeschke left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure I'm OK with this solution.

(For context, my push a few months ago on pyarrow's abi3 support (apache/arrow#50409) was an attempt to help the wheel expiry issue in the nightly index)

Comment on lines 17 to 18
cache: true
cache-write: ${{ github.event_name == 'push' && github.ref_name == 'main' }}

@mroeschke mroeschke Sep 1, 2026 •

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we make these fields (and run-install) dependent on a variant of ${{ inputs.environment != 'pyarrow-nightly' }} to avoid duplicating the prefix-dev/setup-pixi?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I mentioned it in the comment above, but so I initially tried this but I found it got too complicated:

Small disadvantage of having the setup-pixi action twice (although updating the version pins gets automated anyway), but trying to combine it in one step became a bit unreadable (the cache and environments keys can not be specified for run-install: false)

The cache cannot be set to True (that can still be set to False with a form of if / else expression), and environments should not be set (I didn't try if setting it to an empty string works, as that would also be possible with and if/else expression).
But even if possible, it became quite unreadable IMO

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah gotcha (sorry I missed that)

@jorisvandenbossche
jorisvandenbossche marked this pull request as ready for review September 1, 2026 20:46
@jorisvandenbossche

Copy link
Copy Markdown
Member Author

(For context, my push a few months ago on pyarrow's abi3 support (apache/arrow#50409) was an attempt to help the wheel expiry issue in the nightly index)

Ah, yes, when that lands and if that causes the wheels to be kept longer, we can consider cleaning this up again.

@jorisvandenbossche
jorisvandenbossche merged commit d6535b3 into pandas-dev:main Sep 1, 2026
52 checks passed
@jorisvandenbossche
jorisvandenbossche deleted the ci-pixi-pyarrow-nightly branch September 1, 2026 20:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI Continuous Integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

BUG: pyarrow-nightly CI fails during Pixi install due to stale locked nightly wheel

2 participants