lasdf1234 opened a new pull request, #14223: URL: https://github.com/apache/gravitino/pull/14223
### What changes were proposed in this pull request? Stacked A2 and the remaining B-track slices onto `branch-tms-scheduler`, with one commit per subtask: | Commit | Subtask | | --- | --- | | Before/after metrics and finish REST | #14205 | | Nearest-policy resolver and expand enumerator | #13984 | | Policy-expand pipeline into cron-job enqueue API | #14215 | | Build enqueue-time jobConf specs for cron | #14216 | | Relational cron-job enqueue with snapshot batches | #14217 | | Cron-pool submit pipeline | #14020 | | Commit-chain collection and auth consistency | #14218 | | Enqueue commit-job specs from IRC updates | #14219 | | Document enqueue-time commit-job specs | #14220 | | Built-in Iceberg maintenance Spark job | #14221 | | Rename `plugins/tms` → `plugins/maintenance` + plugin ITs (incl. expand→cron / IRC→commit BaseITs) | #14222 | ### Why are the changes needed? The in-job path needs metrics/finish callbacks. Expand must pick a nearest policy and enqueue cron work. Commit-chain maintenance needs IRC-driven enqueue. Spark needs a built-in TMS Iceberg maintenance job that reports metrics and releases soft slots. Fix: #14205 Fix: #13984 Fix: #14215 Fix: #14216 Fix: #14217 Fix: #14020 Fix: #14218 Fix: #14219 Fix: #14220 Fix: #14221 Fix: #14222 Part of #13760. ### Does this PR introduce _any_ user-facing change? Yes: - Maintenance action REST: `metrics/before`, `metrics/after`, and `finish` - Expand / cron / commit scheduling in `plugins/maintenance` - Built-in Iceberg maintenance Spark job template and related jobConf shape ### How was this patch tested? - Private-fork integration PR: https://github.com/lasdf1234/gravitino/pull/82 - Path-filtered workflow `TMS Test`; cron suite `tms` - Local: `./gradlew :plugins:maintenance:test -PskipITs` / BaseITs under `integration.test` Made with [Cursor](https://cursor.com) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
