Matthias Boehm created SYSTEMML-2155:
----------------------------------------
Summary: Recompute nnz on spark checkpoints for large matrices
Key: SYSTEMML-2155
URL: https://issues.apache.org/jira/browse/SYSTEMML-2155
Project: SystemML
Issue Type: Task
Reporter: Matthias Boehm
Operations over large matrices with dimensions > max integer, are always forced
to spark which implies missing nnz information due to lazy evaluation in spark.
This task aims to proactively recompute the nnz for such large matrices (which
are often ultra-sparse) to improve size propagation during recompilation and
repeated access.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)