[ https://issues.apache.org/jira/browse/FLINK-14679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chesnay Schepler closed FLINK-14679. ------------------------------------ Resolution: Fixed master: cc02399c4f4c1076153a18d7928720f95725d400 > Add total number of partitions to ResultPartitionDeploymentDescriptor > --------------------------------------------------------------------- > > Key: FLINK-14679 > URL: https://issues.apache.org/jira/browse/FLINK-14679 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Coordination > Reporter: Chesnay Schepler > Assignee: Chesnay Schepler > Priority: Major > Labels: pull-request-available > Fix For: 1.10.0 > > Time Spent: 20m > Remaining Estimate: 0h > > The ResourceManager requires some way to tell whether it has received all > partitions for a given dataset; to ensure that a) no incomplete datasets are > shows to the user [as completed] and b) to initiate a timeout-based cleanup > of other partitions. > Conversely, since the RM only has access to what the TaskExecutor sends, this > information must also be accessible to the TE. > A good candidate for placing this seems to be the > {{ResultPartitionDeploymentDescriptor}} or {{PartitionDescriptor}}, as these > already contain the DataSetID. -- This message was sent by Atlassian Jira (v8.3.4#803005)