[
https://issues.apache.org/jira/browse/FLINK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936579#comment-16936579
]
Till Rohrmann commented on FLINK-14139:
---------------------------------------
Thanks for reporting this issue [~kevin.cyj]. I'll take a look at the PR.
> Fix potential memory leak of rest server when using session/standalone cluster
> ------------------------------------------------------------------------------
>
> Key: FLINK-14139
> URL: https://issues.apache.org/jira/browse/FLINK-14139
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / REST
> Reporter: Yingjie Cao
> Assignee: Yingjie Cao
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.10.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Flink's rest server uses netty decoder for http request processing and file
> uploading. However io.netty.handler.codec.http.multipart.DiskAttribute and
> io.netty.handler.codec.http.multipart.DiskFileUpload class of netty would
> register some temp files, including post chunks and upload file chunks, to
> java.io.DeleteOnExitHook which has a potential of memory leak, because the
> registered file names will never be deleted before the cluster stops.
> Most of the time, this is not a big problem, however we use Flink session
> cluster a long running service for ad-hoc SQL query, this problem gets worse.
> In fact, Flink handles the clean up of temp files through
> org.apache.flink.util.ShutdownHookUtil (though not including the post
> chunks), so it is no need to register these files to java.io.DeleteOnExitHook.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)