Matthias Boehm created SYSTEMML-1741:
----------------------------------------
Summary: Rework codegen cost-based plan selector (opt V2)
Key: SYSTEMML-1741
URL: https://issues.apache.org/jira/browse/SYSTEMML-1741
Project: SystemML
Issue Type: Sub-task
Reporter: Matthias Boehm
So far our the cost-based codegen plan selector considers all materialization
points per connected component of partial fusion plan candidates as well as
multi aggregates and various cleanups in independent steps. This aims to rework
this into a full-fledged cost-based optimizer to address poor plan choices
encountered in various complex DAGs.
In detail, the new cost-based plan selector needs to address the following in
an holistic manner:
* Potential materialization points (operators with multiple consumers), decided
on a per-consumer basis
* Sparsity exploitation (in cost model and template flagging) incl ordering of
inputs
* Decisions on (overlapping) template types
* Multi-aggregates for cell- and row-templates
* Constraints and costs for distributed operations
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
