[
https://issues.apache.org/jira/browse/SPARK-59153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18123713#comment-18123713
]
Peter Toth commented on SPARK-59153:
------------------------------------
This is fixed by SPARK-59050 (https://github.com/apache/spark/pull/58339).
{{KeyedPartitioning.keysSatisfy}} lets a layout that may hold out-of-set keys
claim a global ordering only when it has a single partition. Its test
"SPARK-59050: SPJ: a global ORDER BY over an unknown-keyed layout must
range-partition" covers this case: a right outer join preserves an out-of-set
key, and an {{ORDER BY}} follows.
The fix and the test are on master, branch-4.x, branch-4.3, branch-4.2,
branch-4.1 and branch-4.0. Resolving this as a duplicate of SPARK-59050.
> SPJ one-side shuffle with out-of-set keys must not satisfy a global sort
> ------------------------------------------------------------------------
>
> Key: SPARK-59153
> URL: https://issues.apache.org/jira/browse/SPARK-59153
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 5.0.0
> Reporter: Dongjoon Hyun
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
