Skip to content

fix(tsfile): install tsfile only in py3.14 CI and add Hub example#4

Merged
JackieTien97 merged 1 commit into
ly/tsfile-per-device-widefrom
ly/tsfile-fix
May 30, 2026
Merged

fix(tsfile): install tsfile only in py3.14 CI and add Hub example#4
JackieTien97 merged 1 commit into
ly/tsfile-per-device-widefrom
ly/tsfile-fix

Conversation

@Young-Leo
Copy link
Copy Markdown
Collaborator

Addresses @lhoestq's review on huggingface#8160.

tsfile requires pyarrow<20 for python<3.14, which conflicts with
datasets' pyarrow>=21.0.0. So:

  • Remove tsfile>=2.3.0 from the tests extra in setup.py.
  • Install tsfile only in the test_py314 CI job.
  • Guard tests/packaged_modules/test_tsfile.py with pytest.importorskip("tsfile")
    so the module is skipped at collection time when tsfile is not installed.

Also adds a Hub example (tsfile/lotsa_data) to the TsFile loading guide,
as requested. Verified locally: load_dataset("tsfile/lotsa_data") loads
91 device rows.

Self-tested locally (python 3.12)

  • With tsfile available: 50 passed
  • With tsfile missing (simulated): cleanly skipped, no warnings
  • ruff check + ruff format --check: passed

tsfile requires pyarrow<20 for python<3.14, which conflicts with datasets'
pyarrow>=21.0.0. Remove tsfile from the 'tests' extra in setup.py and install
it only in the test_py314 CI job. Guard test_tsfile.py with pytest.importorskip
so the module is skipped (at collection time) when tsfile is not installed.

Also add a Hub example (tsfile/lotsa_data) to the TsFile loading guide.
@JackieTien97 JackieTien97 merged commit 2be64bb into ly/tsfile-per-device-wide May 30, 2026
1 of 2 checks passed
@JackieTien97 JackieTien97 deleted the ly/tsfile-fix branch May 30, 2026 11:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants