[
https://issues.apache.org/jira/browse/MAHOUT-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076552#comment-14076552
]
Hudson commented on MAHOUT-1597:
--------------------------------
SUCCESS: Integrated in Mahout-Quality #2716 (See
[https://builds.apache.org/job/Mahout-Quality/2716/])
MAHOUT-1597: A + 1.0 (element-wise scala operation) gives wrong result if rdd
is missing rows, Spark side (dlyubimov) (dlyubimov: rev
377dcace16fe4fd77baaab91ad575e9da5c49ac0)
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAt.scala
*
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/AbstractUnaryOp.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/package.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/package.scala
*
spark/src/main/scala/org/apache/mahout/sparkbindings/drm/CheckpointedDrmSpark.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/AewB.scala
* spark/src/test/scala/org/apache/mahout/sparkbindings/drm/DrmLikeSuite.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/DrmLike.scala
*
math-scala/src/test/scala/org/apache/mahout/math/drm/RLikeDrmOpsSuiteBase.scala
*
math-scala/src/main/scala/org/apache/mahout/math/drm/logical/AbstractBinaryOp.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAewScalar.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/SparkEngine.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/CheckpointedDrm.scala
*
spark/src/test/scala/org/apache/mahout/sparkbindings/drm/RLikeDrmOpsSuite.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAtA.scala
* CHANGELOG
> A + 1.0 (element-wise scala operation) gives wrong result if rdd is missing
> rows, Spark side
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-1597
> URL: https://issues.apache.org/jira/browse/MAHOUT-1597
> Project: Mahout
> Issue Type: Bug
> Affects Versions: 0.9
> Reporter: Dmitriy Lyubimov
> Assignee: Dmitriy Lyubimov
> Fix For: 1.0
>
>
> {code}
> // Concoct an rdd with missing rows
> val aRdd: DrmRdd[Int] = sc.parallelize(
> 0 -> dvec(1, 2, 3) ::
> 3 -> dvec(3, 4, 5) :: Nil
> ).map { case (key, vec) => key -> (vec: Vector)}
> val drmA = drmWrap(rdd = aRdd)
> val controlB = inCoreA + 1.0
> val drmB = drmA + 1.0
> (drmB -: controlB).norm should be < 1e-10
> {code}
> should not fail.
> it was failing due to elementwise scalar operator only evaluates rows
> actually present in dataset.
> In case of Int-keyed row matrices, there are implied rows that yet may not be
> present in RDD.
> Our goal is to detect the condition and evaluate missing rows prior to
> physical operators that don't work with missing implied rows.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
