[
https://issues.apache.org/jira/browse/FLINK-29665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lijie Wang updated FLINK-29665:
-------------------------------
Description: Currently, the subpartition range division algorithm is fixed
(data-independent), and the *TaskDeploymentDescriptor(TDD)* can be generated
according to the number of subpartitions and downstream parallelism. In order
to support dividing according to the amount of data in the subpartition range,
the scheduler needs to support flexible subpartition range divisions. The
scheduler will be responsible for deciding the subpartition range division
infos for each job vertex, and then pass the division infos to job vertices
when initializing them.
> Support flexible subpartition range divisions
> ---------------------------------------------
>
> Key: FLINK-29665
> URL: https://issues.apache.org/jira/browse/FLINK-29665
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Reporter: Lijie Wang
> Assignee: Lijie Wang
> Priority: Major
> Fix For: 1.17.0
>
>
> Currently, the subpartition range division algorithm is fixed
> (data-independent), and the *TaskDeploymentDescriptor(TDD)* can be generated
> according to the number of subpartitions and downstream parallelism. In order
> to support dividing according to the amount of data in the subpartition
> range, the scheduler needs to support flexible subpartition range divisions.
> The scheduler will be responsible for deciding the subpartition range
> division infos for each job vertex, and then pass the division infos to job
> vertices when initializing them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
