Chesnay Schepler created FLINK-14679:
----------------------------------------
Summary: Add total number of partitions to
ResultPartitionDeploymentDescriptor
Key: FLINK-14679
URL: https://issues.apache.org/jira/browse/FLINK-14679
Project: Flink
Issue Type: Sub-task
Components: Runtime / Coordination
Reporter: Chesnay Schepler
Assignee: Chesnay Schepler
Fix For: 1.10.0
The ResourceManager requires some way to tell whether it has received all
partitions for a given dataset; to ensure that a) no incomplete datasets are
shows to the user [as completed] and b) to initiate a timeout-based cleanup of
other partitions.
Conversely, since the RM only has access to what the TaskExecutor sends, this
information must also be accessible to the TE.
A good candidate for placing this seems to be the
{{ResultPartitionDeploymentDescriptor}} or {{PartitionDescriptor}}, as these
already contain the DataSetID.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
