[
https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237254#comment-14237254
]
koert kuipers commented on SPARK-3655:
--------------------------------------
i also dont like the signature
def groupByKeyAndSortValues(valueOrdering: Ordering[V], partitioner:
Partitioner): RDD[(K, Iterable[V])]
i doubt it can be implemented efficiently
i would much prefer
def groupByKeyAndSortValues(valueOrdering: Ordering[V], partitioner:
Partitioner): RDD[(K, TraversableOnce[V])]
but that is inconsistent with groupByKey (which i guess has Iterable in it's
return type for historical reasons.. used to be Seq)
> Support sorting of values in addition to keys (i.e. secondary sort)
> -------------------------------------------------------------------
>
> Key: SPARK-3655
> URL: https://issues.apache.org/jira/browse/SPARK-3655
> Project: Spark
> Issue Type: New Feature
> Components: Spark Core
> Affects Versions: 1.1.0
> Reporter: koert kuipers
> Assignee: Koert Kuipers
> Priority: Minor
>
> Now that spark has a sort based shuffle, can we expect a secondary sort soon?
> There are some use cases where getting a sorted iterator of values per key is
> helpful.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
