[
https://issues.apache.org/jira/browse/MAHOUT-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14935535#comment-14935535
]
ASF GitHub Bot commented on MAHOUT-1570:
----------------------------------------
Github user dlyubimov commented on a diff in the pull request:
https://github.com/apache/mahout/pull/137#discussion_r40705610
--- Diff:
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/CheckpointAction.scala
---
@@ -44,5 +44,6 @@ abstract class CheckpointAction[K: ClassTag] extends
DrmLike[K] {
case Some(cp) => cp
}
+ val classTag = implicitly[ClassTag[K]]
--- End diff --
maybe we should expose that in DrmLike.
I so far had a need for this in logical operators
(AbstractBinaryOp$classTagK, AbstractUnaryOp$classTagK) for optimizer's needs.
so maybe it needs to be promoted up if it turns out every implementation must
keep implicit classtag inside.
> Adding support for Apache Flink as a backend for the Mahout DSL
> ---------------------------------------------------------------
>
> Key: MAHOUT-1570
> URL: https://issues.apache.org/jira/browse/MAHOUT-1570
> Project: Mahout
> Issue Type: Improvement
> Reporter: Till Rohrmann
> Assignee: Alexey Grigorev
> Labels: DSL, flink, scala
> Fix For: 0.11.1
>
>
> With the finalized abstraction of the Mahout DSL plans from the backend
> operations (MAHOUT-1529), it should be possible to integrate further backends
> for the Mahout DSL. Apache Flink would be a suitable candidate to act as a
> good execution backend.
> With respect to the implementation, the biggest difference between Spark and
> Flink at the moment is probably the incremental rollout of plans, which is
> triggered by Spark's actions and which is not supported by Flink yet.
> However, the Flink community is working on this issue. For the moment, it
> should be possible to circumvent this problem by writing intermediate results
> required by an action to HDFS and reading from there.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
