vamshikrishnakyatham opened a new issue, #14036: URL: https://github.com/apache/hudi/issues/14036
### Bug Description **What happened:** Filtering for Hudi incremental queries on tables with version >= 6 depends on commit completion time which is not present in the output for the users. Filtering with requested times (currently outputted) gives inconsistent and wrong results. It is difficult for the users to give proper times as part of the filter if it is not outputted. **What you expected:** Implement a completion time virtual column (_hoodie_commit_completion_time) for Hudi incremental queries on tables with version >= 6. This virtual column is dynamically added during query execution and provides completion time semantics for filtering and display. **Steps to reproduce:** 1. Create a Hudi Table with incremental query support 2. Performing Incremental Query with requested times (which is outputted currently) gives inconsistent and wrong results. ### Environment **Hudi version:** 1.1 **Query engine:** (Spark/Flink/Trino etc) **Relevant configs:** ### Logs and Stack Trace _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
