Kurt Young created FLINK-4430:
---------------------------------
Summary: prevent BLOCKING partition data lose when task is finished
Key: FLINK-4430
URL: https://issues.apache.org/jira/browse/FLINK-4430
Project: Flink
Issue Type: Sub-task
Reporter: Kurt Young
When we have a BLOCKING result partition type, the data is actually holded by
TaskManager, not the slot. When we finish the produce task, we will mark this
task finished and try to release the slot. Under the new architecture, with
yarn or mesos mode, releasing slot may trigger releasing the container, so the
TaskManager will be terminated, thus the result data is lost. We should
introduce some mechanism to prevent this from happening.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)