holdenk created SPARK-3312:
------------------------------
Summary: Add a groupByKey which returns a special GroupBy object
like in pandas
Key: SPARK-3312
URL: https://issues.apache.org/jira/browse/SPARK-3312
Project: Spark
Issue Type: Improvement
Components: Spark Core
Reporter: holdenk
Priority: Minor
A common pattern which causes problems for new Spark users is using groupByKey
followed by a reduce. I'd like to make a special version of groupByKey which
returns a groupBy object (like the Panda's groupby object). The resulting class
would have a number of functions (min,max, stats, reduce) which could all be
implemented efficiently.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
