[
https://issues.apache.org/jira/browse/SYSTEMML-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm updated SYSTEMML-2400:
-------------------------------------
Description: Dynamic recompilation deep copies the hop DAG and applies -
among other things - various rewrites. In case these rewrites create new hops
(no inplace modification) these rewrites lose the max thread constraints set by
parfor and paramserv. On nodes with large degree of parallelism this
constitutes a serious issue because it leads to large over-provisioning and
thus reduced performance and potential OOMs.
> Dynamic recompilation loses max thread constraints of hops
> ----------------------------------------------------------
>
> Key: SYSTEMML-2400
> URL: https://issues.apache.org/jira/browse/SYSTEMML-2400
> Project: SystemML
> Issue Type: Bug
> Reporter: Matthias Boehm
> Priority: Major
>
> Dynamic recompilation deep copies the hop DAG and applies - among other
> things - various rewrites. In case these rewrites create new hops (no inplace
> modification) these rewrites lose the max thread constraints set by parfor
> and paramserv. On nodes with large degree of parallelism this constitutes a
> serious issue because it leads to large over-provisioning and thus reduced
> performance and potential OOMs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
