[
https://issues.apache.org/jira/browse/MAHOUT-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214839#comment-15214839
]
ASF GitHub Bot commented on MAHOUT-1819:
----------------------------------------
Github user andrewpalumbo commented on a diff in the pull request:
https://github.com/apache/mahout/pull/206#discussion_r57629267
--- Diff:
flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala ---
@@ -249,12 +249,10 @@ object FlinkEngine extends DistributedEngine {
override def drmBroadcast(v: Vector)(implicit dc: DistributedContext):
BCast[Vector] =
FlinkByteBCast.wrap(v)
-
/** Broadcast support */
override def drmBroadcast(m: Matrix)(implicit dc: DistributedContext):
BCast[Matrix] =
FlinkByteBCast.wrap(m)
-
/** Parallelize in-core matrix as flink distributed matrix, using row
ordinal indices as data set keys. */
override def drmParallelizeWithRowIndices(m: Matrix, numPartitions: Int
= 1)
--- End diff --
we should probably note in the comments that this breaks the
drmParallelize() contract, and ignores the numPartitions parameter.
> Set the default Parallelism for Flink execution in FlinkDistributedContext
> ---------------------------------------------------------------------------
>
> Key: MAHOUT-1819
> URL: https://issues.apache.org/jira/browse/MAHOUT-1819
> Project: Mahout
> Issue Type: Improvement
> Components: Flink
> Affects Versions: 0.11.2
> Reporter: Suneel Marthi
> Assignee: Suneel Marthi
> Fix For: 0.12.0
>
>
> Remove the option to set the degree of parallelism at individual operators
> and set it once in FlinkDistributedContext.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
