Skip to content

ci: standardize RustFS setup across Iceberg repos - #3279

Merged
kevinjqliu merged 2 commits into
apache:mainfrom
kevinjqliu:kevinjqliu-rustfs-setup-cleanup
Oct 26, 2026
Merged

kevinjqliu merged 2 commits into
apache:mainfrom
kevinjqliu:kevinjqliu-rustfs-setup-cleanup

Conversation

@kevinjqliu

@kevinjqliu kevinjqliu commented Sep 25, 2026 •

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

What changes are included in this PR?

Standardizes the RustFS setup across the Iceberg repos. Same change in:

The setup:

  • rustfs/rustfs:1.0.3, the latest stable.
  • Healthcheck on /health/ready. /health is just liveness and can pass before storage and IAM are ready, so bucket creation can race it.
  • RUSTFS_OBS_LOG_STDOUT_ENABLED=true. Otherwise docker logs is empty.
  • RUSTFS_CONSOLE_ENABLE=false and no port 9001. Nothing uses the console.
  • Nothing else. The rest are defaults.

Are these changes tested?

Ran docker compose config and started rustfs/rustfs:1.0.3 with the new config: /health/ready returns 200 and logs show up in docker logs.

AI Disclosure

Implemented with GitHub Copilot.

Set RUSTFS_OBS_LOG_STDOUT_ENABLED=true on the object-store service so that
docker logs shows RustFS output, aligning with the canonical RustFS 1.0.0
setup used across Apache Iceberg repos.

Generated-by: GitHub Copilot
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI lite review requested due to automatic review settings September 25, 2026 04:08

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟢 Approval recommended

No unresolved review comments; the change is focused and low risk.

Review effort: Lite
Findings: None

What changed in this PR

Enables RustFS stdout logging in the shared Docker Compose fixture to improve CI failure diagnostics.

Changes:

  • Adds RUSTFS_OBS_LOG_STDOUT_ENABLED=true to the RustFS service.
File Summary
dev/​docker-compose.yaml Enables RustFS stdout logging.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@kevinjqliu
kevinjqliu marked this pull request as draft September 25, 2026 04:17

@comphead comphead left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @kevinjqliu this is good observation

Bump rustfs/rustfs to 1.0.3 for both object-store and create-buckets,
set RUSTFS_CONSOLE_ENABLE=false, and stop publishing port 9001, aligning
with the RustFS setup used across Apache Iceberg repos.

Generated-by: GitHub Copilot
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Comment thread dev/docker-compose.yaml
environment:
- RUSTFS_ACCESS_KEY=admin
- RUSTFS_SECRET_KEY=password
- RUSTFS_OBS_LOG_STDOUT_ENABLED=true

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

show logs in CI

Comment thread dev/docker-compose.yaml
- RUSTFS_ACCESS_KEY=admin
- RUSTFS_SECRET_KEY=password
- RUSTFS_OBS_LOG_STDOUT_ENABLED=true
- RUSTFS_CONSOLE_ENABLE=false

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removes console port 9001, we dont need it

@kevinjqliu
kevinjqliu marked this pull request as ready for review October 20, 2026 18:20
@kevinjqliu
kevinjqliu requested review from CTTY and blackmwk October 24, 2026 04:25

@blackmwk blackmwk left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @kevinjqliu for this pr!

@blackmwk
blackmwk added this pull request to the merge queue Oct 26, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Oct 26, 2026
@kevinjqliu
kevinjqliu added this pull request to the merge queue Oct 26, 2026
Merged via the queue into apache:main with commit cf71520 Oct 26, 2026
26 checks passed
@kevinjqliu
kevinjqliu deleted the kevinjqliu-rustfs-setup-cleanup branch October 26, 2026 18:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants