[
https://issues.apache.org/jira/browse/MAHOUT-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13968820#comment-13968820
]
Pat Ferrel edited comment on MAHOUT-1464 at 4/14/14 9:02 PM:
-------------------------------------------------------------
Getting input from: hdfs://occam4.local/user/pat/xrsj the job seems able to
complete up to the point where it tries to write the output. Then running
inside IDEA I am unable to connect to the cluster HDFS master to write.
I've never been able to have code write to HDFS from inside IDEA. I just run it
from a bash script where my dev machine is configured as an HDFS client.
Shouldn't using 'spark-class org.apache.spark.deploy.Client launch' give us
this?
BTW all the computation is indeed running on the cluster.
was (Author: pferrel):
Getting input from: hdfs://occam4.local/user/pat/xrsj the job seems able to
complete up to the point where it tries to write the output. Then running
inside IDEA I am unable to connect to the cluster HDFS master to write.
I've never been able to have code write to HDFS from inside IDEA. I just run it
from a bash script where my dev machine is configured as an HDFS client.
Shouldn't using spark_client give us this?
BTW all the computation is indeed running on the cluster.
> Cooccurrence Analysis on Spark
> ------------------------------
>
> Key: MAHOUT-1464
> URL: https://issues.apache.org/jira/browse/MAHOUT-1464
> Project: Mahout
> Issue Type: Improvement
> Components: Collaborative Filtering
> Environment: hadoop, spark
> Reporter: Pat Ferrel
> Assignee: Sebastian Schelter
> Fix For: 1.0
>
> Attachments: MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch,
> MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, run-spark-xrsj.sh
>
>
> Create a version of Cooccurrence Analysis (RowSimilarityJob with LLR) that
> runs on Spark. This should be compatible with Mahout Spark DRM DSL so a DRM
> can be used as input.
> Ideally this would extend to cover MAHOUT-1422. This cross-cooccurrence has
> several applications including cross-action recommendations.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
