[
https://issues.apache.org/jira/browse/SYSTEMML-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm closed SYSTEMML-2042.
------------------------------------
Resolution: Done
Assignee: Matthias Boehm
> Large Dense Matrix Blocks >16GB
> -------------------------------
>
> Key: SYSTEMML-2042
> URL: https://issues.apache.org/jira/browse/SYSTEMML-2042
> Project: SystemML
> Issue Type: Epic
> Reporter: Matthias Boehm
> Assignee: Matthias Boehm
> Priority: Major
> Fix For: SystemML 1.1
>
>
> This epic aims to add support for large-dense matrix blocks. Due to
> linearized double arrays and Java's limitation of 2G array elements, the
> current dense block representation is limited to 16GB. Given the trends
> towards large memory and scale-up environments, there is a needs to overcome
> this limitation. In order to avoid the memory inefficiency of two-dimensional
> (nested) arrays or chunked storage, we aim to provide alternative
> implementations that are selected based on the dimensions of allocated matrix
> blocks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)