[
https://issues.apache.org/jira/browse/SPARK-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2726:
-------------------------------
Description:
SPARK-2125 introduced a SortOrder in ShuffleDependency and HashShuffleReader.
However, the key ordering already includes the SortOrder information since an
Ordering can be reversed easily. This is similar to Java's Comparator
interface. Rarely does an API accept both a Comparator as well as a SortOrder.
We should remove the SortOrder.
was:
SPARK-2125 introduced a SortOrder in ShuffleDependency and HashShuffleReader.
However, the key ordering already includes the SortOrder information since an
Ordering can be reversed easily. This is similar to Java's Comparator
interface. Rarely does an API accept both a Comparator as well as an SortOrder.
We should remove the SortOrder.
> Remove SortOrder in ShuffleDependency and HashShuffleReader
> -----------------------------------------------------------
>
> Key: SPARK-2726
> URL: https://issues.apache.org/jira/browse/SPARK-2726
> Project: Spark
> Issue Type: Bug
> Reporter: Reynold Xin
> Assignee: Reynold Xin
>
> SPARK-2125 introduced a SortOrder in ShuffleDependency and HashShuffleReader.
> However, the key ordering already includes the SortOrder information since an
> Ordering can be reversed easily. This is similar to Java's Comparator
> interface. Rarely does an API accept both a Comparator as well as a SortOrder.
> We should remove the SortOrder.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
