[lake] Support partition mark-done for lakehouse tiering (processing-time)

[beryllw]

…time)

Purpose

Linked issue: close #3314

Brief change log

Tests

API and Format

Documentation

[Copilot]

Pull request overview

This PR adds partition mark-done support for Paimon lakehouse tiering in the Fluss tiering service, including the ability to run a “maintenance” round when a tiering cycle produces no data, and to persist mark-done tracking state in Paimon snapshot properties.

Changes:

• Implement Paimon partition mark-done logic (state model + trigger + action execution) and persist state via snapshot properties.
• Extend the Flink tiering pipeline to emit an empty “skip-round” split and commit mark-done maintenance on empty rounds when enabled.
• Add UT/IT coverage for the mark-done lifecycle, cold start backfill, and late-data behavior.

Reviewed changes

Copilot reviewed 13 out of 13 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
fluss-lake/fluss-lake-paimon/src/test/java/org/apache/fluss/lake/paimon/tiering/PaimonTieringITCase.java	Adds an IT case validating end-to-end partition mark-done behavior (including _SUCCESS and snapshot properties).
fluss-lake/fluss-lake-paimon/src/test/java/org/apache/fluss/lake/paimon/tiering/PaimonPartitionMarkDoneTest.java	New UT covering mark-done state lifecycle, cold start backfill, end-time guarding, and JSON serde behavior.
fluss-lake/fluss-lake-paimon/src/main/java/org/apache/fluss/lake/paimon/tiering/PartitionMarkDoneTrigger.java	New trigger (adapted from Paimon) to decide which partitions are idle enough to be marked done.
fluss-lake/fluss-lake-paimon/src/main/java/org/apache/fluss/lake/paimon/tiering/PaimonPartitionMarkDone.java	New core implementation that tracks tiered partitions, performs idle judgment, and runs Paimon mark-done actions.
fluss-lake/fluss-lake-paimon/src/main/java/org/apache/fluss/lake/paimon/tiering/PaimonLakeTieringFactory.java	Declares Paimon supports mark-done via the new capability interface.
fluss-lake/fluss-lake-paimon/src/main/java/org/apache/fluss/lake/paimon/tiering/PaimonLakeCommitter.java	Runs mark-done on data commits and implements maintenance commits for empty rounds via properties-only snapshots.
fluss-lake/fluss-lake-paimon/src/main/java/org/apache/fluss/lake/paimon/tiering/MarkDoneStateJsonSerde.java	New JSON serde for persisted mark-done state in snapshot properties.
fluss-lake/fluss-lake-paimon/src/main/java/org/apache/fluss/lake/paimon/tiering/MarkDoneState.java	New state model representing cold-start initialization and pending partitions.
fluss-flink/fluss-flink-common/src/main/java/org/apache/fluss/flink/tiering/source/enumerator/TieringSourceEnumerator.java	Emits a skip-round split for fully caught-up tables when mark-done is enabled.
fluss-flink/fluss-flink-common/src/main/java/org/apache/fluss/flink/tiering/committer/TieringCommitOperator.java	Runs mark-done maintenance and commits the resulting snapshot to Fluss when a round has no data.
fluss-common/src/main/java/org/apache/fluss/utils/PartitionUtils.java	Exposes partition time-format logic needed for auto-partition end-time derivation.
fluss-common/src/main/java/org/apache/fluss/lake/writer/PartitionMarkDoneEnabler.java	New optional capability interface for lake factories to signal mark-done support/enabling.
fluss-common/src/main/java/org/apache/fluss/lake/committer/PartitionMarkDoneMaintainer.java	New optional capability interface for lake committers to perform empty-round mark-done maintenance.

---

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.