Matthias Boehm created SYSTEMML-2217:
----------------------------------------
Summary: OOM on reading ultra-sparse textcell matrix w/ unknown nnz
Key: SYSTEMML-2217
URL: https://issues.apache.org/jira/browse/SYSTEMML-2217
Project: SystemML
Issue Type: Task
Reporter: Matthias Boehm
In forced single-node execution, the read of textcell matrices with unknown nnz
can lead to out-of-memory situations because all matrices with unknown nnz are
allocated in dense format. This task aims to make these readers more robust by
inferring a rough estimate of the nnz from the file size on HDFS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
