[
https://issues.apache.org/jira/browse/METRON-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16578366#comment-16578366
]
ASF GitHub Bot commented on METRON-1707:
----------------------------------------
Github user nickwallen commented on the issue:
https://github.com/apache/metron/pull/1150
> @simonellistonball: Do we have to use groupByKey in the spark
implementation, is it not possible to use reduceByKey to build the profiles...
I had in the back of my mind that groupByKey might not be the most
performance option, but I just didn't focus any energy on that for the first
pass.
I will take a look and see if we can't use your advice. Thanks for the
pointer @simonellistonball !
> Port Profiler to Spark
> ----------------------
>
> Key: METRON-1707
> URL: https://issues.apache.org/jira/browse/METRON-1707
> Project: Metron
> Issue Type: Sub-task
> Reporter: Nick Allen
> Assignee: Nick Allen
> Priority: Major
>
> Create a port of the Profiler that runs in Spark.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
