Skip to content

ci: compatibility sweep against public OME-Zarr datasets - #27

Closed
MPanknin wants to merge 3 commits into
mainfrom
feat/compat-sweep
Closed

MPanknin wants to merge 3 commits into
mainfrom
feat/compat-sweep

Conversation

@MPanknin

@MPanknin MPanknin commented Oct 1, 2026

Copy link
Copy Markdown
Owner

A compatibility sweep: how much of the public OME-Zarr data opens in Kiln, and why the rest doesn't.

  • What it checks: the viewer's own code (metadata parsing, validation, pyramid fallback, level limit), then fetches and decodes one chunk per dataset. It also checks CORS and, for HCS plates, whether the first field opens on its own. Nothing is rendered.
  • Datasets: up to 15 per list, sampled evenly, from the OME-NGFF Challenge 2024 lists, the IDR OME-NGFF samples, the OME-Zarr Open SciVis collection and the Kiln gallery. 336 datasets, about 3.5 minutes.
  • Runs: from the Actions tab (Compatibility sweep → Run workflow, with an optional sample size) and on pushes that change the sweep.
  • Results: REPORT.md and results.csv on the compat-sweep branch, one commit per run, plus the job summary.
  • Code: scripts/compat-sweep/ only. The Zarr provider's Vite worker import resolves to a stub under bun, so no library code changes.

First run: 159 of 336 open (47%). HCS plates are 44% of the sample, and 75% of the volumes that open store one z-slice per chunk.

Checked locally against test stores covering each outcome: v0.4/v0.5, sharded, uint32, plate, time series, 6 channels, bioformats2raw, labels, no CORS, 404, URL without .zarr.


Generated by Claude Code

MPanknin and others added 3 commits October 1, 2026 11:38
Runs the viewer's own dataset checks (metadata parsing, validation, pyramid
fallback, level limit) plus a chunk decode against samples from the OME-NGFF
Challenge, IDR, Open SciVis and the gallery, and publishes REPORT.md and
results.csv to the compat-sweep branch.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The viewer now reads any URL that isn't Kiln's sharded format as Zarr.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@MPanknin MPanknin closed this Oct 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant