[
https://issues.apache.org/jira/browse/MAHOUT-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897625#comment-15897625
]
Pat Ferrel commented on MAHOUT-1951:
------------------------------------
[~rawkintrevo] added the use of spark-submit to the Mahout script for launching
the drivers, this potentially has some side effects since much of the work of
spark-submit was done in the drivers and I am not sure if there is a way to
pass params through to spark-submit. In other words the driver may no permit
unrecognized params on the command line. Therefor we will leave the drivers as
they are, doing more work than they should but mark this as deprecated and
remove in a future release.
> Drivers don't run with remote Spark
> -----------------------------------
>
> Key: MAHOUT-1951
> URL: https://issues.apache.org/jira/browse/MAHOUT-1951
> Project: Mahout
> Issue Type: Bug
> Components: CLI
> Affects Versions: 0.13.0
> Environment: The command line drivers spark-itemsimilarity and
> spark-naivebayes using a remote or pseudo-clustered Spark
> Reporter: Pat Ferrel
> Assignee: Pat Ferrel
> Priority: Blocker
> Fix For: 0.13.0
>
>
> Missing classes when running these jobs because the dependencies-reduced jar,
> passed to Spark for serialization purposes, does not contain all needed
> classes.
> Found by a user.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
