[
https://issues.apache.org/jira/browse/SAMZA-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346044#comment-16346044
]
Xinyu Liu commented on SAMZA-1580:
----------------------------------
oh, maybe we call it differently. I mean this optimizer will change the dag
itself based on some optimization criteria, and planner will take the dag after
optimization and plan the physical execution of it. Maybe it's part of the
planning too. I will probably take a look at Calcite when starting the actual
implementation.
> Optimizer for High-level API
> ----------------------------
>
> Key: SAMZA-1580
> URL: https://issues.apache.org/jira/browse/SAMZA-1580
> Project: Samza
> Issue Type: Bug
> Reporter: Xinyu Liu
> Assignee: Xinyu Liu
> Priority: Major
>
> Need an optimizer before the planning, which does the following:
> 1) Replace partitionBy() with a map(keyFn, ValueFn) if task count = 1
> 2) Remove broadcast() if task count = 1.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
