[
https://issues.apache.org/jira/browse/SYSTEMML-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm updated SYSTEMML-2042:
-------------------------------------
Description: This epic aims to add support for large-dense matrix blocks.
Due to linearized double arrays and Java's limitation of 2G array elements, the
current dense block representation is limited to 16GB. Given the trends towards
large memory and scale-up environments, there is a needs to overcome this
limitation. In order to avoid the memory inefficiency of two-dimensional
(nested) arrays or chunked storage, we aim to provide alternative
implementations that are selected based on the dimensions of allocated matrix
blocks.
> Large Dense Matrix Blocks >16GB
> -------------------------------
>
> Key: SYSTEMML-2042
> URL: https://issues.apache.org/jira/browse/SYSTEMML-2042
> Project: SystemML
> Issue Type: Epic
> Reporter: Matthias Boehm
> Fix For: SystemML 1.1
>
>
> This epic aims to add support for large-dense matrix blocks. Due to
> linearized double arrays and Java's limitation of 2G array elements, the
> current dense block representation is limited to 16GB. Given the trends
> towards large memory and scale-up environments, there is a needs to overcome
> this limitation. In order to avoid the memory inefficiency of two-dimensional
> (nested) arrays or chunked storage, we aim to provide alternative
> implementations that are selected based on the dimensions of allocated matrix
> blocks.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
