[
https://issues.apache.org/jira/browse/MAHOUT-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026865#comment-14026865
]
Hudson commented on MAHOUT-1572:
--------------------------------
SUCCESS: Integrated in Mahout-Quality #2649 (See
[https://builds.apache.org/job/Mahout-Quality/2649/])
MAHOUT-1572: blockify() to detect (naively) the data sparsity in the loaded
data (dlyubimov: rev 8c529ccff23d419c4cb5191b0435de40d6a9831c)
* spark/src/main/scala/org/apache/mahout/sparkbindings/drm/package.scala
* CHANGELOG
* spark/src/test/scala/org/apache/mahout/sparkbindings/drm/DrmLikeSuite.scala
> blockify() to detect (naively) the data sparsity in the loaded data
> --------------------------------------------------------------------
>
> Key: MAHOUT-1572
> URL: https://issues.apache.org/jira/browse/MAHOUT-1572
> Project: Mahout
> Issue Type: Bug
> Reporter: Dmitriy Lyubimov
> Fix For: 1.0
>
>
> per [~ssc]:
> .bq a dense matrix is converted into a SparseRowMatrix with dense row vectors
> by blockify(), after serialization this becomes a dense matrix in sparse
> format (triggering OOMs)!
> i guess we can look at first row vector and go on to either DenseMatrix or
> SparseRowMatrix
--
This message was sent by Atlassian JIRA
(v6.2#6252)
