[
https://issues.apache.org/jira/browse/MAHOUT-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588146#comment-14588146
]
ASF GitHub Bot commented on MAHOUT-1570:
----------------------------------------
GitHub user alexeygrigorev opened a pull request:
https://github.com/apache/mahout/pull/137
MAHOUT-1570: Flink backend for Mahout DSL
Implementation for MAHOUT-1570: Adding support for Apache Flink as a
backend for the Mahout DSL
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/alexeygrigorev/mahout flink-binding
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/mahout/pull/137.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #137
----
commit 37df8551c9c1b71eba251d545cc03b0dc37cd50a
Author: Alexey Grigorev <[email protected]>
Date: 2015-04-09T09:54:01Z
MAHOUT-1570: initial skeleton for Mahout DSL on Apache Flink
commit e4b059346f59fccb9c1e7ffa3c0e7059802358b9
Author: Alexey Grigorev <[email protected]>
Date: 2015-06-16T14:46:15Z
MAHOUT-1712: Flink: Ax, At, Atx operators
commit 685566a6f701d29775c685200db999edcc773776
Author: Alexey Grigorev <[email protected]>
Date: 2015-05-05T18:05:21Z
MAHOUT-1701: Flink: AtB implemented, ABt and AtA expressed via AtB
commit 8152d4b853dc14f5963a85eac9f00430e59f1716
Author: Alexey Grigorev <[email protected]>
Date: 2015-05-12T16:01:08Z
MAHOUT-1702: Flink: AewScalar and AewB
commit 679ffd9a1287410dcd6ec0cc73f7eb89f99267fd
Author: Alexey Grigorev <[email protected]>
Date: 2015-05-19T15:47:39Z
MAHOUT-1703: Flink: cbind, rbind and mapBlock
commit cdb8b2ffde7e3fb8c097114926d8622653aaf890
Author: Alexey Grigorev <[email protected]>
Date: 2015-05-26T13:43:26Z
MAHOUT-1709: Flink: slicing operator
commit 2310cfba4eb4846f8d10df2ae88edead36818d04
Author: Alexey Grigorev <[email protected]>
Date: 2015-05-26T13:51:36Z
MAHOUT-1710: Flink: A times incoreB operator
commit 5350f52c1cf85e89d5881207f9e302b32496e19a
Author: Alexey Grigorev <[email protected]>
Date: 2015-05-26T14:17:14Z
MAHOUT-1570: Flink: calculating ncol, nrow; colSum, colMean, norm methods
commit fbbfe9b73608e1c92d8fc1f178ca62cec83bcb72
Author: Alexey Grigorev <[email protected]>
Date: 2015-05-28T13:03:17Z
MAHOUT-1570: rebased to latest upstream
commit f338f13ce2c5f4c7ed056e6aeff904afd0f72f7e
Author: Alexey Grigorev <[email protected]>
Date: 2015-05-28T13:18:32Z
NOJIRA: added .cache to gitignore
commit f9aff54a262747cd6e3421877541a1489243b934
Author: Alexey Grigorev <[email protected]>
Date: 2015-06-02T12:25:16Z
MAHOUT-1570: upgraded to flink 0.9-SNAPSHOT for IO
commit c0c07f695f776ec805f1749d3b5bce4b9e95c35d
Author: Alexey Grigorev <[email protected]>
Date: 2015-06-02T14:04:47Z
MAHOUT-1734: Flink: DRM IO
commit c83e441adede177350ad4b5e1e35ff9f3bbb85f9
Author: Alexey Grigorev <[email protected]>
Date: 2015-06-16T13:18:42Z
MAHOUT-1570: Flink: added headers, comments and aknowledgements
----
> Adding support for Apache Flink as a backend for the Mahout DSL
> ---------------------------------------------------------------
>
> Key: MAHOUT-1570
> URL: https://issues.apache.org/jira/browse/MAHOUT-1570
> Project: Mahout
> Issue Type: Improvement
> Reporter: Till Rohrmann
> Assignee: Suneel Marthi
> Labels: DSL, flink, scala
>
> With the finalized abstraction of the Mahout DSL plans from the backend
> operations (MAHOUT-1529), it should be possible to integrate further backends
> for the Mahout DSL. Apache Flink would be a suitable candidate to act as a
> good execution backend.
> With respect to the implementation, the biggest difference between Spark and
> Flink at the moment is probably the incremental rollout of plans, which is
> triggered by Spark's actions and which is not supported by Flink yet.
> However, the Flink community is working on this issue. For the moment, it
> should be possible to circumvent this problem by writing intermediate results
> required by an action to HDFS and reading from there.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
