[
https://issues.apache.org/jira/browse/MAHOUT-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879014#comment-15879014
]
Saikat Kanjilal edited comment on MAHOUT-1894 at 2/22/17 7:35 PM:
------------------------------------------------------------------
[~rawkintrevo] I think we should author a set of mscala scripts that will: 1)
certify each build versus various spark backends 2) spit out a report that
outlines typical SLA's from various operations before and after upgrading to a
new version of a tech stack 3) adds any zeppelin visualizations to the report
as necessary. I was wondering if we should come up with a candidate list of
expensive operations that we want to test based on the , any ideas what these
would be in the samsara world, maybe we can have a perf test suite that
iterates over a set of algorithms in samsara for this. The
SparseSparseDrmTimer can be the starting point for this.
Thoughts?
was (Author: kanjilal):
[~rawkintrevo] I think we should author a set of mscala scripts that will: 1)
certify each build versus various spark backends 2) spit out a report that
outlines typical SLA's from various operations before and after upgrading to a
new version of a tech stack 3) adds any zeppelin visualizations to the report
as necessary. I was wondering if we should come up with a candidate list of
expensive operations that we want to test based on the , any ideas what these
would be in the samsara world, maybe we can have a perf test suite that
iterates over a set of algorithms in samsara for this.
Thoughts?
> Add support for Spark 2x backend
> --------------------------------
>
> Key: MAHOUT-1894
> URL: https://issues.apache.org/jira/browse/MAHOUT-1894
> Project: Mahout
> Issue Type: Task
> Components: spark
> Affects Versions: 0.13.0
> Reporter: Suneel Marthi
> Assignee: Trevor Grant
> Priority: Critical
> Fix For: 1.0.0, 0.13.0, 0.14.0
>
>
> add support for Spark 2.x as backend execution engine.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
