JunRuiLee opened a new pull request, #7918:
URL: https://github.com/apache/paimon/pull/7918
## Purpose
Add pypaimon support for expiring partitions based on table options and
CLI overrides, matching the Java partition expiration behavior for
`values-time` and `update-time` strategies.
This includes:
- Partition expiration orchestration for `FileStoreTable`.
- Partition entry discovery from manifest metadata.
- Time extraction from partition values.
- Java `DateTimeFormatter`-style timestamp formatter support.
- `table expire-partitions` CLI command.
- Partition expiration options in Python `CoreOptions`.
- Null partition handling via `partition.default-name`.
- Default `partition.expiration-max-num=100`.
## Tests
Added `paimon-python/pypaimon/tests/partition_expire_test.py` covering:
- Extracting partition time from simple date and timestamp values.
- Extracting time with timestamp patterns across multiple partition fields.
- Java formatter conversion cases like `yyyyMMdd`.
- Selecting expired partitions with `values-time`.
- Selecting expired partitions with `update-time`.
- Skipping unparseable partition values.
- Respecting expiration check interval.
- Respecting max expire count.
- Empty partition lists.
- Unconfigured expiration.
- Non-partitioned tables.
- Duration parsing for days, hours, minutes, seconds, milliseconds, and
combined durations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
