juliuszsompolski opened a new pull request #23551: [SPARK-26622] Revise SQL 
Metrics labels
URL: https://github.com/apache/spark/pull/23551
 
 
   ## What changes were proposed in this pull request?
   
   Try to make labels more obvious
   "avg hash probe"     avg hash collisions per lookup
   "partition pruning time (ms)"        dynamic partition pruning time
   "total number of files in the table" file count
   "number of files that would be returned by partition pruning alone"  file 
count after partition pruning
   "total size of files in the table"   file size
   "size of files that would be returned by partition pruning alone"    file 
size after partition pruning
   "metadata time (ms)" metadata time
   "aggregate time"     time in aggregation build
   "aggregate time"     time in aggregation build
   "time to construct rdd bc"   time to build
   "total time to remove rows"  time to remove
   "total time to update rows"  time to update
   "bytes of written output"    written output - createSizeMetric
   
   ## How is this patch tested?
   
   Existing tests.
   
   Author: Stacy Kerkela <[email protected]>
   Signed-off-by: Juliusz Sompolski <[email protected]>

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to