nsivabalan commented on issue #17081: URL: https://github.com/apache/hudi/issues/17081#issuecomment-4800758365
The explicit acceptance criterion — *All actions in all state on timeline easily queryable from Spark SQL* — appears to be satisfied on current `master`: - `show_timeline` Spark procedure: commit [`421924ce`](https://github.com/apache/hudi/commit/421924ce046363bf46b5ae0a03b47ba1e9131570) (PR #14261, HUDI-9766) — exposes commits/deltacommits/compaction/clustering/clean/rollback in REQUESTED/INFLIGHT/COMPLETED states, with `startTime`/`endTime`, `showArchived`, and SQL `filter` support. See `hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/ShowTimelineProcedure.scala`. - Per-action procedures for cleans: HUDI-9653 (PR #13719, commit `e11ee976`). - LSM timeline compaction trigger procedure: PR #18659 (commit `f8d70cb5`). If the `<more to be added>` portion of the acceptance criteria covers further debugging procedures (e.g., file-group/log-block introspection, MDT partition queries, lock-state probes), it would help to enumerate them as separate sub-tasks so this umbrella issue can be closed. Otherwise this looks ready to close. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
