[
https://issues.apache.org/jira/browse/SPARK-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379432#comment-14379432
]
Yu Ishikawa commented on SPARK-6341:
------------------------------------
I found another bug at breeze-0.11.1 under Spark 1.3. The result of dividing a
sparse vector by a scalar value become a zero vector. However, David had
already fixed the bug at 0.12-SNAPSHOT. I think we should upgrade breeze to the
next version ASAP if it will be released.
h3. Test Code
{noformat}
val bv = new SparseVector(Array(1), Array(20.0), 5)
val result = bv :/ 20.0
assert(result.activeSize === 1)
{noformat}
h3. sbt test Result
{noformat}
[info] 0 did not equal 1 (SparseVectorTest.scala:362)
[info] org.scalatest.exceptions.TestFailedException:
[info] at
org.scalatest.Assertions$class.newAssertionFailedException(Assertions.scala:498)
[info] at
org.scalatest.FunSuite.newAssertionFailedException(FunSuite.scala:1559)
[info] at
org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:416)
[info] at
breeze.linalg.SparseVectorTest$$anonfun$43.apply$mcV$sp(SparseVectorTest.scala:362)
[info] at
breeze.linalg.SparseVectorTest$$anonfun$43.apply(SparseVectorTest.scala:358)
[info] at
breeze.linalg.SparseVectorTest$$anonfun$43.apply(SparseVectorTest.scala:358)
[info] at
org.scalatest.Transformer$$anonfun$apply$1.apply(Transformer.scala:22)
{noformat}
> Upgrade breeze from 0.11.1 to 0.11.2 or later
> ---------------------------------------------
>
> Key: SPARK-6341
> URL: https://issues.apache.org/jira/browse/SPARK-6341
> Project: Spark
> Issue Type: Improvement
> Components: ML, MLlib
> Affects Versions: 1.3.0
> Reporter: Yu Ishikawa
> Priority: Minor
>
> There is a bug to divide a breeze sparse vector which has any zero values
> with a scalar value. However, this bug is in breeze's side. I heard that once
> David fixes it and publishes it to maven, we can upgrade to breeze 0.11.2 or
> later.
> - [Apache Spark Developers List: Is there any bugs to divide a Breeze sparse
> vector at Spark
> v1.3.0-rc3](http://apache-spark-developers-list.1001551.n3.nabble.com/mllib-Is-there-any-bugs-to-divide-a-Breeze-sparse-vectors-at-Spark-v1-3-0-rc3-td11056.html)
> - [Is there any bugs to divide a sparse vector with `:/` at v0.11.1? · Issue
> #382 ·
> scalanlp/breeze](https://github.com/scalanlp/breeze/issues/382#issuecomment-80896698)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
