Zouxxyy opened a new pull request, #8895:
URL: https://github.com/apache/paimon/pull/8895

   ### Purpose
   
   Improve Spark SQL UI observability for postpone merge-on-read.
   
   - Rename the merge operator to `PaimonPostponeMergeScan <table>`.
   - Show the original real-table scan description and metrics on the merge 
scan.
   - Keep the input `BatchScan` focused on postpone files and records, and 
remove its misleading split count.
   - Add metrics for postpone files and records, real scan files and splits, 
partition size, read time, manifests, and output rows.
   
   ### Tests
   
   - `PostponeBucketTableTest` (21 tests passed)
   - Local Spark 3.5.2 fixed-bucket write, postpone write, and merge-on-read 
scenario


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to