[
https://issues.apache.org/jira/browse/MAHOUT-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13969775#comment-13969775
]
Dmitriy Lyubimov edited comment on MAHOUT-1464 at 4/15/14 5:24 PM:
-------------------------------------------------------------------
bq. Running from my dev machine in IDEA against a remote cluster I can read
input from HDFS and the computation on Spark seems to complete correctly but
the write fails.
input, output, mahoutSparkContext(masterUrl = , Success?
HDFS:/occam4/user/pat/xrsj, HDFS:/occam4/user/pa
is this a spark task log? or front end log? seems worker process on the cluster
is trying to connect to hdfs name node (iirc port 8020 is hadoop namenode
service) and fails. Config/networking issues.
was (Author: dlyubimov):
bq, Running from my dev machine in IDEA against a remote cluster I can read
input from HDFS and the computation on Spark seems to complete correctly but
the write fails.
input, output, mahoutSparkContext(masterUrl = , Success?
HDFS:/occam4/user/pat/xrsj, HDFS:/occam4/user/pa
is this a spark task log? or front end log? seems worker process on the cluster
is trying to connect to hdfs name node (iirc port 8020 is hadoop namenode
service) and fails. Config/networking issues.
> Cooccurrence Analysis on Spark
> ------------------------------
>
> Key: MAHOUT-1464
> URL: https://issues.apache.org/jira/browse/MAHOUT-1464
> Project: Mahout
> Issue Type: Improvement
> Components: Collaborative Filtering
> Environment: hadoop, spark
> Reporter: Pat Ferrel
> Assignee: Sebastian Schelter
> Fix For: 1.0
>
> Attachments: MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch,
> MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, run-spark-xrsj.sh
>
>
> Create a version of Cooccurrence Analysis (RowSimilarityJob with LLR) that
> runs on Spark. This should be compatible with Mahout Spark DRM DSL so a DRM
> can be used as input.
> Ideally this would extend to cover MAHOUT-1422. This cross-cooccurrence has
> several applications including cross-action recommendations.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
