[jira] [Updated] (FLINK-14060) Set slot sharing groups according to pipelined regions
[
https://issues.apache.org/jira/browse/FLINK-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-14060:
---
Labels: pull-request-available (was: )
> Set slot sharing groups according to pipelined regions
> --
>
> Key: FLINK-14060
> URL: https://issues.apache.org/jira/browse/FLINK-14060
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Reporter: Xintong Song
>Assignee: Zhu Zhu
>Priority: Major
> Labels: pull-request-available
>
> {{StreamingJobGraphGenerator}} set slot sharing group for operators at
> compiling time.
> -Identify pipelined regions, with respect to
> {{allSourcesInSamePipelinedRegion}}-
> -Set slot sharing groups according to pipelined regions -
> -By default, each pipelined region should go into a separate slot sharing
> group-
> -If the user sets operators in multiple pipelined regions into same slot
> sharing group, it should be respected-
> The slot sharing group of a vertex is determined as:
> * if a vertex slot sharing group is specified to be {{null}}, the slot
> sharing group is null
> * if a vertex slot sharing group is specified to be a non-default value(the
> group name not "default"), it will be respected
> * if a vertex slot sharing group is "default", it will be the slot sharing
> group of the vertex's logical pipelined region
> The slot sharing group of a region is determined as:
> * if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
> in the same "default" slot sharing group
> * if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions
> will be in distinct slot sharing groups
> This step should not introduce any behavior changes, given that later
> scheduled pipelined regions can reuse slots from previous scheduled pipelined
> regions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14060) Set slot sharing groups according to pipelined regions
[
https://issues.apache.org/jira/browse/FLINK-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu updated FLINK-14060:
Description:
{{StreamingJobGraphGenerator}} set slot sharing group for operators at
compiling time.
-Identify pipelined regions, with respect to
{{allSourcesInSamePipelinedRegion}}-
-Set slot sharing groups according to pipelined regions -
-By default, each pipelined region should go into a separate slot sharing group-
-If the user sets operators in multiple pipelined regions into same slot
sharing group, it should be respected-
The slot sharing group of a vertex is determined as:
* if a vertex slot sharing group is specified to be {{null}}, the slot sharing
group is null
* if a vertex slot sharing group is specified to be a non-default value(the
group name not "default"), it will be respected
* if a vertex slot sharing group is "default", it will be the slot sharing
group of the vertex's logical pipelined region
The slot sharing group of a region is determined as:
* if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
in the same "default" slot sharing group
* if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions will
be in distinct slot sharing groups
This step should not introduce any behavior changes, given that later scheduled
pipelined regions can reuse slots from previous scheduled pipelined regions.
was:
{{StreamingJobGraphGenerator}} set slot sharing group for operators at
compiling time.
- * Identify pipelined regions, with respect to
{{allSourcesInSamePipelinedRegion}}-
- * Set slot sharing groups according to pipelined regions -
- ** By default, each pipelined region should go into a separate slot sharing
group-
- ** If the user sets operators in multiple pipelined regions into same slot
sharing group, it should be respected-
The slot sharing group of a vertex is determined as:
* if a vertex slot sharing group is specified to be {{null}}, the slot sharing
group is null
* if a vertex slot sharing group is specified to be a non-default value(the
group name not "default"), it will be respected
* if a vertex slot sharing group is "default", it will be the slot sharing
group of the vertex's logical pipelined region
The slot sharing group of a region is determined as:
* if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
in the same "default" slot sharing group
* if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions will
be in distinct slot sharing groups
This step should not introduce any behavior changes, given that later scheduled
pipelined regions can reuse slots from previous scheduled pipelined regions.
> Set slot sharing groups according to pipelined regions
> --
>
> Key: FLINK-14060
> URL: https://issues.apache.org/jira/browse/FLINK-14060
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Reporter: Xintong Song
>Priority: Major
>
> {{StreamingJobGraphGenerator}} set slot sharing group for operators at
> compiling time.
> -Identify pipelined regions, with respect to
> {{allSourcesInSamePipelinedRegion}}-
> -Set slot sharing groups according to pipelined regions -
> -By default, each pipelined region should go into a separate slot sharing
> group-
> -If the user sets operators in multiple pipelined regions into same slot
> sharing group, it should be respected-
> The slot sharing group of a vertex is determined as:
> * if a vertex slot sharing group is specified to be {{null}}, the slot
> sharing group is null
> * if a vertex slot sharing group is specified to be a non-default value(the
> group name not "default"), it will be respected
> * if a vertex slot sharing group is "default", it will be the slot sharing
> group of the vertex's logical pipelined region
> The slot sharing group of a region is determined as:
> * if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
> in the same "default" slot sharing group
> * if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions
> will be in distinct slot sharing groups
> This step should not introduce any behavior changes, given that later
> scheduled pipelined regions can reuse slots from previous scheduled pipelined
> regions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14060) Set slot sharing groups according to pipelined regions
[
https://issues.apache.org/jira/browse/FLINK-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu updated FLINK-14060:
Description:
{{StreamingJobGraphGenerator}} set slot sharing group for operators at
compiling time.
- * Identify pipelined regions, with respect to
{{allSourcesInSamePipelinedRegion}}
* Set slot sharing groups according to pipelined regions
** By default, each pipelined region should go into a separate slot sharing
group
** If the user sets operators in multiple pipelined regions into same slot
sharing group, it should be respected-
The slot sharing group of a vertex is determined as:
* if a vertex slot sharing group is specified to be {{null}}, the slot sharing
group is null
* if a vertex slot sharing group is specified to be a non-default value(the
group name not "default"), it will be respected
* if a vertex slot sharing group is "default", it will be the slot sharing
group of the vertex's logical pipelined region
The slot sharing group of a region is determined as:
* if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
in the same "default" slot sharing group
* if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions will
be in distinct slot sharing groups
This step should not introduce any behavior changes, given that later scheduled
pipelined regions can reuse slots from previous scheduled pipelined regions.
was:
{{StreamingJobGraphGenerator}} set slot sharing group for operators at
compiling time.
* Identify pipelined regions, with respect to
{{allSourcesInSamePipelinedRegion}}
* Set slot sharing groups according to pipelined regions
** By default, each pipelined region should go into a separate slot sharing
group
** If the user sets operators in multiple pipelined regions into same slot
sharing group, it should be respected
This step should not introduce any behavior changes, given that later scheduled
pipelined regions can reuse slots from previous scheduled pipelined regions.
> Set slot sharing groups according to pipelined regions
> --
>
> Key: FLINK-14060
> URL: https://issues.apache.org/jira/browse/FLINK-14060
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Reporter: Xintong Song
>Priority: Major
>
> {{StreamingJobGraphGenerator}} set slot sharing group for operators at
> compiling time.
> - * Identify pipelined regions, with respect to
> {{allSourcesInSamePipelinedRegion}}
> * Set slot sharing groups according to pipelined regions
> ** By default, each pipelined region should go into a separate slot sharing
> group
> ** If the user sets operators in multiple pipelined regions into same slot
> sharing group, it should be respected-
> The slot sharing group of a vertex is determined as:
> * if a vertex slot sharing group is specified to be {{null}}, the slot
> sharing group is null
> * if a vertex slot sharing group is specified to be a non-default value(the
> group name not "default"), it will be respected
> * if a vertex slot sharing group is "default", it will be the slot sharing
> group of the vertex's logical pipelined region
> The slot sharing group of a region is determined as:
> * if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
> in the same "default" slot sharing group
> * if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions
> will be in distinct slot sharing groups
> This step should not introduce any behavior changes, given that later
> scheduled pipelined regions can reuse slots from previous scheduled pipelined
> regions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14060) Set slot sharing groups according to pipelined regions
[
https://issues.apache.org/jira/browse/FLINK-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu updated FLINK-14060:
Description:
{{StreamingJobGraphGenerator}} set slot sharing group for operators at
compiling time.
- * Identify pipelined regions, with respect to
{{allSourcesInSamePipelinedRegion}}-
- * Set slot sharing groups according to pipelined regions -
- ** By default, each pipelined region should go into a separate slot sharing
group-
- ** If the user sets operators in multiple pipelined regions into same slot
sharing group, it should be respected-
The slot sharing group of a vertex is determined as:
* if a vertex slot sharing group is specified to be {{null}}, the slot sharing
group is null
* if a vertex slot sharing group is specified to be a non-default value(the
group name not "default"), it will be respected
* if a vertex slot sharing group is "default", it will be the slot sharing
group of the vertex's logical pipelined region
The slot sharing group of a region is determined as:
* if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
in the same "default" slot sharing group
* if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions will
be in distinct slot sharing groups
This step should not introduce any behavior changes, given that later scheduled
pipelined regions can reuse slots from previous scheduled pipelined regions.
was:
{{StreamingJobGraphGenerator}} set slot sharing group for operators at
compiling time.
- * Identify pipelined regions, with respect to
{{allSourcesInSamePipelinedRegion}}
* Set slot sharing groups according to pipelined regions
** By default, each pipelined region should go into a separate slot sharing
group
** If the user sets operators in multiple pipelined regions into same slot
sharing group, it should be respected-
The slot sharing group of a vertex is determined as:
* if a vertex slot sharing group is specified to be {{null}}, the slot sharing
group is null
* if a vertex slot sharing group is specified to be a non-default value(the
group name not "default"), it will be respected
* if a vertex slot sharing group is "default", it will be the slot sharing
group of the vertex's logical pipelined region
The slot sharing group of a region is determined as:
* if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
in the same "default" slot sharing group
* if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions will
be in distinct slot sharing groups
This step should not introduce any behavior changes, given that later scheduled
pipelined regions can reuse slots from previous scheduled pipelined regions.
> Set slot sharing groups according to pipelined regions
> --
>
> Key: FLINK-14060
> URL: https://issues.apache.org/jira/browse/FLINK-14060
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Reporter: Xintong Song
>Priority: Major
>
> {{StreamingJobGraphGenerator}} set slot sharing group for operators at
> compiling time.
> - * Identify pipelined regions, with respect to
> {{allSourcesInSamePipelinedRegion}}-
> - * Set slot sharing groups according to pipelined regions -
> - ** By default, each pipelined region should go into a separate slot sharing
> group-
> - ** If the user sets operators in multiple pipelined regions into same slot
> sharing group, it should be respected-
> The slot sharing group of a vertex is determined as:
> * if a vertex slot sharing group is specified to be {{null}}, the slot
> sharing group is null
> * if a vertex slot sharing group is specified to be a non-default value(the
> group name not "default"), it will be respected
> * if a vertex slot sharing group is "default", it will be the slot sharing
> group of the vertex's logical pipelined region
> The slot sharing group of a region is determined as:
> * if {{allVerticesInSameSlotSharingGroupByDefault}} is true, all regions are
> in the same "default" slot sharing group
> * if {{allVerticesInSameSlotSharingGroupByDefault}} is false, all regions
> will be in distinct slot sharing groups
> This step should not introduce any behavior changes, given that later
> scheduled pipelined regions can reuse slots from previous scheduled pipelined
> regions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14060) Set slot sharing groups according to pipelined regions
[
https://issues.apache.org/jira/browse/FLINK-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Metzger updated FLINK-14060:
---
Component/s: Runtime / Coordination
> Set slot sharing groups according to pipelined regions
> --
>
> Key: FLINK-14060
> URL: https://issues.apache.org/jira/browse/FLINK-14060
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Reporter: Xintong Song
>Priority: Major
>
> {{StreamingJobGraphGenerator}} set slot sharing group for operators at
> compiling time.
> * Identify pipelined regions, with respect to
> {{allSourcesInSamePipelinedRegion}}
> * Set slot sharing groups according to pipelined regions
> ** By default, each pipelined region should go into a separate slot sharing
> group
> ** If the user sets operators in multiple pipelined regions into same slot
> sharing group, it should be respected
> This step should not introduce any behavior changes, given that later
> scheduled pipelined regions can reuse slots from previous scheduled pipelined
> regions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
