[
https://issues.apache.org/jira/browse/FLINK-21330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu closed FLINK-21330.
---------------------------
Resolution: Fixed
Done via 5f0c76f2e87326cf844d9914e8b8f6cd7f311c8f
> Optimize the performance of PipelinedRegionSchedulingStrategy
> -------------------------------------------------------------
>
> Key: FLINK-21330
> URL: https://issues.apache.org/jira/browse/FLINK-21330
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Reporter: Zhilong Hong
> Assignee: Zhilong Hong
> Priority: Major
> Labels: pull-request-available, pull-requests-available
> Fix For: 1.13.0
>
>
> PipelinedRegionSchedulingStrategy is used for task scheduling. Its
> initialization is located at {{PipelinedRegionSchedulingStrategy#init}}. The
> initialization can be divided into two parts:
> # Calculating consumed result partitions of SchedulingPipelinedRegions
> # Calculating the consumer pipelined region of SchedulingResultPartition
> Based on FLINK-21328, the {{consumedResults}} of
> {{DefaultSchedulingPipelinedRegion}} can be replaced with
> {{ConsumedPartitionGroup}}.
> Then we can optimize the procedures we mentioned above. After the
> optimization, the time complexity decreases from O(N^2) to O(N).
> The related usage of {{getConsumedResults}} should be replaced, too.
> Furthermore, {{PipelinedRegionSchedulingStrategy#maybeScheduleRegion}} can be
> optimized at the same time.
> The detailed design doc is located at:
> [https://docs.google.com/document/d/1OjGAyJ9Z6KsxcMtBHr6vbbrwP9xye7CdCtrLvf8dFYw/edit#heading=h.a1mz4yjpry6m]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
