mhatipog commented on code in PR #59445:
URL: https://github.com/apache/spark/pull/59445#discussion_r4283083771
##########
sql/core/src/test/scala/org/apache/spark/sql/SubquerySuite.scala:
##########
@@ -78,6 +78,42 @@ class SubquerySuite extends SharedSparkSession
assert(joins.size == numJoins)
}
+ test("preserve sorted LIMIT and OFFSET with correlated subqueries") {
Review Comment:
Thanks for the detailed review. Addressed in 2be9b37 :
- Added deterministic plan-level regression tests covering all three
optimizer branches.
- Narrowed the guard to correlated subqueries and IN subqueries, preserving
pushdown for safe uncorrelated scalar/EXISTS subqueries.
- The Catalyst suite and original SQL regression test passed locally. Full
CI validation is pending.
I've also updated the PR description. The Spark JIRA account request is
awaiting approval; I'll link the ticket once available.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
