[
https://issues.apache.org/jira/browse/SAMZA-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895163#comment-15895163
]
ASF GitHub Bot commented on SAMZA-1067:
---------------------------------------
GitHub user xinyuiscool opened a pull request:
https://github.com/apache/samza/pull/75
SAMZA-1067: Physical execution graph and planner for fluent API
Initial commit for the physical graph and plan. The commit includes:
1) Physical ProcessorGraph, where each processor represents a physical
execution unit (e.g. a job in Yarn).
2) A planner does the following:
- create ProcessorGraph from StreamGraph. For this phase, the graph only
contains a single node (single stage);
- figure out the partitions of intermediate topics
- create the topics
Please note currently the planner is used in the remote runner for now.
Further changes/refactoring/cleanup are expected to be integrated with local
runner.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/xinyuiscool/samza SAMZA-1067
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/75.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #75
----
----
> Physical execution plan for logic expressions written in fluent API
> -------------------------------------------------------------------
>
> Key: SAMZA-1067
> URL: https://issues.apache.org/jira/browse/SAMZA-1067
> Project: Samza
> Issue Type: Bug
> Reporter: Yi Pan (Data Infrastructure)
> Assignee: Xinyu Liu
> Labels: features, operator
>
> Users can use fluent APIs (from SAMZA-914, SAMZA-915) to describe a logic
> expression to describe the full stream processing in DAG. We need to define a
> serializable version of DAG as the physical execution plan s.t. it can be
> distributed to all jobs and containers be instantiate the Samza processes in
> a distributed environment.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
