[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006161#comment-14006161
]
Madhu Siddalingaiah commented on SPARK-983:
-------------------------------------------
Can someone comment on the scope of this feature?
My specific interest is to sort each partition in an RDD given a comparison
function.
This can be done now if all partitions fit in memory, but I don't see an easy
way to do it if partitions are larger than available memory.
> External hashing & sorting support
> ----------------------------------
>
> Key: SPARK-983
> URL: https://issues.apache.org/jira/browse/SPARK-983
> Project: Spark
> Issue Type: New Feature
> Affects Versions: 0.9.0
> Reporter: Reynold Xin
> Assignee: Aaron Davidson
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
