[
https://issues.apache.org/jira/browse/MAHOUT-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506332#comment-14506332
]
Andrew Palumbo edited comment on MAHOUT-1693 at 4/22/15 3:21 AM:
-----------------------------------------------------------------
Pushed to master. Will push to branch tomorrow.
was (Author: andrew_palumbo):
Pushed to master. Will push to branch tomorrow.
Sent from my Verizon Wireless 4G LTE smartphone
<div>-------- Original message --------</div><div>From: "ASF GitHub Bot (JIRA)"
<[email protected]> </div><div>Date:04/21/2015 11:14 PM (GMT-05:00)
</div><div>To: [email protected] </div><div>Subject: [jira] [Commented]
(MAHOUT-1693) FunctionalMatrixView materializes row vectors in scala shell
</div><div>
</div>
[
https://issues.apache.org/jira/browse/MAHOUT-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506322#comment-14506322
]
ASF GitHub Bot commented on MAHOUT-1693:
----------------------------------------
Github user asfgit closed the pull request at:
https://github.com/apache/mahout/pull/121
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
> FunctionalMatrixView materializes row vectors in scala shell
> ------------------------------------------------------------
>
> Key: MAHOUT-1693
> URL: https://issues.apache.org/jira/browse/MAHOUT-1693
> Project: Mahout
> Issue Type: Bug
> Components: Mahout spark shell, Math
> Affects Versions: 0.10.0
> Reporter: Suneel Marthi
> Assignee: Andrew Palumbo
> Priority: Blocker
> Fix For: 0.10.1
>
>
> FunctionalMatrixView materializes row vectors in scala shell.
> Problem first reported by a user Michael Alton, Intel:
> "When I first tried to make a large matrix, I got an out of Java heap space
> error. I increased the memory incrementally until I got it to work. “export
> MAHOUT_HEAPSIZE=8000” didn’t work, but “export MAHOUT_HEAPSIZE=64000” did.
> The question is why do we need so much memory? A 5000x5000 matrix of doubles
> should only take up ~200MB of space?"
> Problem has been narrowed down to not override toString() method in
> FunctionalMatrixView which causes it to materialize all of the row vectors
> when run in Mahout Spark Shell.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
