[
https://issues.apache.org/jira/browse/FLINK-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891694#comment-15891694
]
ASF GitHub Bot commented on FLINK-5134:
---------------------------------------
GitHub user zhijiangW opened a pull request:
https://github.com/apache/flink/pull/3455
[FLINK-5134][runtime]Aggregate ResourceSpe for chained operators when
generating JobGraph
It is a part of fine-grained resource configuration in 'flip-6'.
In 'JobGraph' generation, each created 'JobVertex' may contain a series of
chained operators, and the resource of 'JobVertex' should be aggregation of
individual resource in chained operators.
BTW, in order to avoid NPE issue and take it easy to process in the
following processes, I set the default unknown 'ResourceSpec' for 'Operator'
and 'StreamNode'.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhijiangW/flink FLILNK-5134
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3455.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3455
----
commit 1692fdccbdc702a598c09ba4ce408bb25504210f
Author: 淘江 <[email protected]>
Date: 2017-03-02T05:51:39Z
[FLINK-5134][runtime]Aggregate ResourceSpe for chained operators when
generating job graph
Summary: It is a sub task of fine-grained resource configuration. Aggregate
ResourceSpe for chained operators when generating job graph
Test Plan: N/A
Reviewers: 辅机
Subscribers: P577102
Differential Revision: https://aone.alibaba-inc.com/code/D124138
----
> Aggregate ResourceSpe for chained operators when generating job graph
> ---------------------------------------------------------------------
>
> Key: FLINK-5134
> URL: https://issues.apache.org/jira/browse/FLINK-5134
> Project: Flink
> Issue Type: Sub-task
> Components: DataStream API
> Reporter: zhijiang
> Assignee: zhijiang
>
> In *JobGraph* generation, each *JobVertex* corresponds to a series of chained
> operators.
> The resource of *JobVertex* should be aggregation of individual resource in
> chained operators.
> For memory resource in *JobVertex*, the aggregation is the sum formula for
> chained operators.
> And for cpu cores resource in *JobVertex*, the aggregation is the maximum
> formula for chained operators.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
