[
https://issues.apache.org/jira/browse/FLINK-32288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu closed FLINK-32288.
---------------------------
Resolution: Done
done via b462d0ec4d1d421a369e45f8dca33284b5be6bc2
> Improve the scheduling performance of AdaptiveBatchScheduler
> ------------------------------------------------------------
>
> Key: FLINK-32288
> URL: https://issues.apache.org/jira/browse/FLINK-32288
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Coordination
> Affects Versions: 1.18.0
> Reporter: xingbe
> Assignee: xingbe
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.18.0
>
>
> After adding the benchmark of AdaptiveBatchScheduler in FLINK-30480, we
> noticed a regression in the performance of
> SchedulingDownstreamTasksInBatchJobBenchmark#SchedulingDownstreamTasks. When
> scheduling a batch job with a parallelism of 4000*4000, the time spent
> increased from 32ms to 1336ms on my local PC.
> To improve the performance, we can optimize the traversal by checking if the
> consumedPartitionGroups have finished all its partitions.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
