[
https://issues.apache.org/jira/browse/FLINK-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17028012#comment-17028012
]
Yang Wang commented on FLINK-15405:
-----------------------------------
[~chesnay] Thanks for your comments.
Currently, the staging directory is always located at $USER_HOME/.flink. For
example, if the submit user is admin, then the staging directory will be
/user/admin/.flink.
If two Yarn clusters are sharing the HDFS cluster, then all the application
staging directory will be created under /user/admin/.flink. When the
application exited exceptionally or terminated by {{yarn application -kill}},
then the staging directory will be residual and need to be cleaned up manually.
So it will be easier to clean up if different Yarn cluster are using the
separate staging directory.
> Make Yarn staging directory configurable
> ----------------------------------------
>
> Key: FLINK-15405
> URL: https://issues.apache.org/jira/browse/FLINK-15405
> Project: Flink
> Issue Type: New Feature
> Components: Deployment / YARN
> Reporter: Yang Wang
> Priority: Minor
>
> Currently, when deploying Flink cluster on yarn, we always use home dir as
> the prefix of staging directory. It is not convenient when multiple yarn
> cluster are using the same HDFS cluster. It will be not easy to cleanup the
> residual application staging directories. So it will be better if we could
> specify a user-defined directory as staging prefix.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
