[
https://issues.apache.org/jira/browse/SPARK-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14060735#comment-14060735
]
Hans Uhlig commented on SPARK-2278:
-----------------------------------
I think I am understanding my confusion. I was looking for something that would
parallel the existing Mapreduce reduce function which receives a Key and the
associated iterable list of values. The documentation doesn't actually describe
the behavior of each method, the expected behavior of the referenced function
nor contain a description of the transformation particularly well. It looks as
though you need to chain groupByKey then flatMapValues to accomplish what I am
looking for. Still being able to specify a comparator or custom equality
operator would be good.
> groupBy & groupByKey should support custom comparator
> -----------------------------------------------------
>
> Key: SPARK-2278
> URL: https://issues.apache.org/jira/browse/SPARK-2278
> Project: Spark
> Issue Type: New Feature
> Components: Java API
> Affects Versions: 1.0.0
> Reporter: Hans Uhlig
>
> To maintain parity with MapReduce you should be able to specify a custom key
> equality function in groupBy/groupByKey similar to sortByKey.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
