[GitHub] [iceberg] wypoon opened a new pull request #4395: Spark: Add custom metric for number of files read by a SparkScan

[GitBox]

wypoon opened a new pull request #4395:
URL: https://github.com/apache/iceberg/pull/4395


   Spark 3.2 added support for custom `SQLMetric`s which are shown in the Spark 
UI.
   Here we add a custom metric for the number of files read by a SparkScan.
   
   Attached are screenshots of the Spark UI for a query after this change.
   <img width="799" alt="Screen Shot 2022-03-24 at 2 36 44 PM" 
src="https://user-images.githubusercontent.com/3925490/160015585-313b40f3-c3bb-4b6b-8b61-8c5d879af024.png";><img
 width="1010" alt="Screen Shot 2022-03-24 at 2 37 11 PM" 
src="https://user-images.githubusercontent.com/3925490/160015654-e5a6ce58-aade-412f-9a1f-51934ed74757.png";>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org