Matthias Boehm created SYSTEMML-2155:
----------------------------------------

             Summary: Recompute nnz on spark checkpoints for large matrices
                 Key: SYSTEMML-2155
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2155
             Project: SystemML
          Issue Type: Task
            Reporter: Matthias Boehm


Operations over large matrices with dimensions > max integer, are always forced 
to spark which implies missing nnz information due to lazy evaluation in spark. 
This task aims to proactively recompute the nnz for such large matrices (which 
are often ultra-sparse) to improve size propagation during recompilation and 
repeated access.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to