[
https://issues.apache.org/jira/browse/MAHOUT-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965921#comment-14965921
]
ASF GitHub Bot commented on MAHOUT-1570:
----------------------------------------
Github user smarthi commented on a diff in the pull request:
https://github.com/apache/mahout/pull/137#discussion_r42565606
--- Diff: pom.xml ---
@@ -121,6 +121,8 @@
<scala.compat.version>2.10</scala.compat.version>
<scala.version>2.10.4</scala.version>
<spark.version>1.3.1</spark.version>
+ <!-- TODO: Remove snapshot dependency when Flink 0.9.1 is released -->
+ <flink.version>0.9-SNAPSHOT</flink.version>
--- End diff --
there is a Flink-scala-shell in the flink project. It should be available
with the flink project binaries.
On Tue, Oct 20, 2015 at 6:01 PM, Dmitriy Lyubimov <[email protected]>
wrote:
> In pom.xml
> <https://github.com/apache/mahout/pull/137#discussion_r42560808>:
>
> > @@ -121,6 +121,8 @@
> > <scala.compat.version>2.10</scala.compat.version>
> > <scala.version>2.10.4</scala.version>
> > <spark.version>1.3.1</spark.version>
> > + <!-- TODO: Remove snapshot dependency when Flink 0.9.1 is released
-->
> > + <flink.version>0.9-SNAPSHOT</flink.version>
>
> @alexey <https://github.com/alexey> : BTW is there such a thing as Flink
> shell?
> … <#15087459e636606c_>
> On Tue, Oct 20, 2015 at 12:54 AM, Henry Saputra <[email protected]>
> wrote: In pom.xml <#137 (comment)
> <https://github.com/apache/mahout/pull/137#discussion_r42465218>>: > @@
> -121,6 +121,8 @@ > <scala.compat.version>2.10</scala.compat.version> >
> <scala.version>2.10.4</scala.version> >
> <spark.version>1.3.1</spark.version> > + <!-- TODO: Remove snapshot
> dependency when Flink 0.9.1 is released --> > +
> <flink.version>0.9-SNAPSHOT</flink.version> Flink 0.9.1 is out so we could
> remove the SNAPSHOT label I suppose. — Reply to this email directly or
view
> it on GitHub <https://github.com/apache/mahout/pull/137/files#r42465218>.
>
> —
> Reply to this email directly or view it on GitHub
> <https://github.com/apache/mahout/pull/137/files#r42560808>.
>
> Adding support for Apache Flink as a backend for the Mahout DSL
> ---------------------------------------------------------------
>
> Key: MAHOUT-1570
> URL: https://issues.apache.org/jira/browse/MAHOUT-1570
> Project: Mahout
> Issue Type: Improvement
> Reporter: Till Rohrmann
> Assignee: Alexey Grigorev
> Labels: DSL, flink, scala
> Fix For: 0.11.1
>
>
> With the finalized abstraction of the Mahout DSL plans from the backend
> operations (MAHOUT-1529), it should be possible to integrate further backends
> for the Mahout DSL. Apache Flink would be a suitable candidate to act as a
> good execution backend.
> With respect to the implementation, the biggest difference between Spark and
> Flink at the moment is probably the incremental rollout of plans, which is
> triggered by Spark's actions and which is not supported by Flink yet.
> However, the Flink community is working on this issue. For the moment, it
> should be possible to circumvent this problem by writing intermediate results
> required by an action to HDFS and reading from there.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
