Dmitriy Lyubimov created MAHOUT-1572:
----------------------------------------

             Summary: blockify() to detect (naively) the data sparsity in the 
loaded data 
                 Key: MAHOUT-1572
                 URL: https://issues.apache.org/jira/browse/MAHOUT-1572
             Project: Mahout
          Issue Type: Bug
            Reporter: Dmitriy Lyubimov
             Fix For: 1.0


per [~ssc]:
.bq a dense matrix is converted into a SparseRowMatrix with dense row vectors 
by blockify(), after serialization this becomes a dense matrix in sparse format 
(triggering OOMs)! 

i guess we can look at first row vector and go on to either DenseMatrix or 
SparseRowMatrix




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to