[ 
https://issues.apache.org/jira/browse/FLINK-16416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051218#comment-17051218
 ] 

Andrey Zagrebin commented on FLINK-16416:
-----------------------------------------

Ah, so you mean TaskExecutorServices#shutDown will not be called in case of TM 
process killing. Indeed, it is the case. I think we do not want to delay the 
abrupt TM shutdown as it is explicitly requested and usually expected to happen 
asap. To avoid any file leftovers in this case, I would follow the shutdown 
hook pattern.

> Shutdown the task manager gracefully in standalone mode
> -------------------------------------------------------
>
>                 Key: FLINK-16416
>                 URL: https://issues.apache.org/jira/browse/FLINK-16416
>             Project: Flink
>          Issue Type: Improvement
>          Components: Command Line Client
>            Reporter: Yangze Guo
>            Priority: Major
>
> Recently, I try to add a new {{GPUManager}} to the {{TaskExecutorServices}}. 
> I register the "GPUManager#close" function, in which I write some cleanup 
> logic, to the {{TaskExecutorServices#shutDown}}. However, I found that the 
> cleanup logic does not run as expected in standalone mode.
>  After an investigation in the codebase, I found that the 
> {{TaskExecutorServices#shutDown}} will be called only on a fatal error while 
> we just kill the TM process in the {{flink-daemon.sh}}. However, the LOG 
> shows that some services, e.g. TaskExecutorLocalStateStoresManager, did clean 
> up themselves by registering {{shutdownHook}}.
>  If that is the right way, then we need to register a {{shutdownHook}} for 
> {{TaskExecutorServices}} as well.
>  If that is not, we may find another solution to shutdown TM gracefully.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to