[
https://issues.apache.org/jira/browse/SYSTEMML-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm closed SYSTEMML-1968.
------------------------------------
Resolution: Done
Assignee: Matthias Boehm
> Improve cost-based optimizer for distributed operations
> -------------------------------------------------------
>
> Key: SYSTEMML-1968
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1968
> Project: SystemML
> Issue Type: Sub-task
> Components: Compiler, Runtime
> Reporter: Matthias Boehm
> Assignee: Matthias Boehm
> Fix For: SystemML 1.0
>
>
> The current cost-based codegen optimizer has a couple of short-comings that
> lead to missed opportunities for large-scale computation:
> * Cost model unaware of distributed operations, which sometimes leads to
> unnecessary fusion of cell-wise vector operations into distributed row
> operations, which hurts performance due to additional side inputs that needs
> to be broadcast to all executors.
> * The current identification of interesting points ignores common Cell
> entries. In order to reason about above problematic, we need to consider cell
> to row switches, i.e., Cell templates that are merged into row templates as
> well.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
