caican00 opened a new pull request #35867:
URL: https://github.com/apache/spark/pull/35867


   ### What changes were proposed in this pull request?
   Display the number of empty partitions on spark ui when demoting join from 
broadcast-hash to smj.
   
   Before updated the ui:
   
![image](https://user-images.githubusercontent.com/94670132/158509404-2feacfbd-0c40-405a-8097-586befc95d74.png)
   After updated the ui, display the number of empty partitions:
   
![image](https://user-images.githubusercontent.com/94670132/158509432-4f0a4adf-e8d3-4f40-8f31-89e0340bccf0.png)
   
   
   ### Why are the changes needed?
   When demoting join from broadcast-hash to smj, i think it is necessary to 
display the number of empty partitions on spark ui.
   Otherwise, users might wonder why SMJ is used when joining a small table. 
Displaying the number of empty partitions is useful for users to understand 
changes to the execution plan.
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   existing tests.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to