maryannxue opened a new pull request #25471: [SPARK-28753][SQL] Dynamically 
reuse subqueries in AQE
URL: https://github.com/apache/spark/pull/25471
 
 
   ### What changes were proposed in this pull request?
   This PR changes subquery reuse in Adaptive Query Execution from compile-time 
static reuse to execution-time dynamic reuse. This PR adds a 
`ReuseAdaptiveSubquery` rule that applies to a query stage after it is created 
and before it is executed. The new dynamic reuse enables subqueries to be 
reused across all different subquery levels.
   
   ### Why are the changes needed?
   This is an improvement to the current subquery reuse in Adaptive Query 
Execution, which allows subquery reuse to happen in a lazy fashion as well as 
at different subquery levels.
   
   ### Does this PR introduce any user-facing change?
   No.
   
   ### How was this patch tested?
   Passed existing tests.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to