[GitHub] [spark] xingchaozh opened a new pull request, #40312: [SPARK-42695][SQL] Skew join handling in stream side of broadcast hash join

[via GitHub]

xingchaozh opened a new pull request, #40312:
URL: https://github.com/apache/spark/pull/40312

   ### What changes were proposed in this pull request?
   We could handle the steam side skew of BroadcastHashJoin to improve the join 
performance
   
   Before | After
   -- | --
   <img 
src="https://user-images.githubusercontent.com/7522130/223371603-c83da69a-cf2c-445f-b937-2af92c5f0953.png";
 width="400" height="450"> | <img 
src="https://user-images.githubusercontent.com/7522130/223371590-56d4fd20-0c32-4806-967e-bb6e47851f29.png";
 width="400" height="450">
   
   
   ### Why are the changes needed?
   We can extend the OptimizeSkewedJoin to handle this case
   
   ### Does this PR introduce _any_ user-facing change?
   NO
   
   
   ### How was this patch tested?
   UT


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org