Skip to content

ci: replace MinIO with RustFS in S3 tests - #962

Merged
kevinjqliu merged 3 commits into
apache:mainfrom
smaheshwar-pltr:ci/rustfs-tests
Sep 25, 2026
Merged

kevinjqliu merged 3 commits into
apache:mainfrom
smaheshwar-pltr:ci/rustfs-tests

Conversation

@smaheshwar-pltr

@smaheshwar-pltr smaheshwar-pltr commented Sep 24, 2026 •

Copy link
Copy Markdown
Contributor

Replace the MinIO S3 test fixture with RustFS 1.0.0, following apache/iceberg#18247 and apache/iceberg#18246. This removes the remaining MinIO server and client downloads from AWS test setup.

Use Docker on Linux and pinned native release binaries when Docker is unavailable on macOS ARM64 or Windows. The fixture waits for readiness and creates its test bucket with the AWS CLI already available on GitHub runners.

Validated shell syntax, ShellCheck, workflow syntax, and native release archive contents. The AWS integration jobs passed on Ubuntu with both bundled and system AWS SDKs, and on macOS ARM64.

AI disclosure: Assisted by Codex (GPT-6).

Use RustFS 1.0.0 for Docker and native test fixtures, and initialize the S3 bucket with the AWS CLI.

Generated-by: Codex
@smaheshwar-pltr
smaheshwar-pltr marked this pull request as ready for review September 24, 2026 19:50
Expose server logs, retry bucket initialization, verify native downloads, and disable the unused console.

Generated-by: Codex
- Rename the CI step to "Start Object Store"
- Enable shell tracing in start_object_store.sh
- Print the native server log only when it was started natively
- Replace MinIO-specific wording in S3 comments

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

@kevinjqliu kevinjqliu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

I pushed a commit to remove a few more references of minio from the codebase

@kevinjqliu
kevinjqliu merged commit 450863e into apache:main Sep 25, 2026
19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants