[
https://issues.apache.org/jira/browse/YARN-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623494#comment-16623494
]
Zhankun Tang commented on YARN-8806:
------------------------------------
[~yuan_zac] Thanks for providing the patch. I also noticed this problem before.
Here is my solution for your reference, we can also use tempfile.deleteOnExit()
to delete it when JVM exit(except crash)
> Enable local staging directory and clean it up when submarine job is submitted
> ------------------------------------------------------------------------------
>
> Key: YARN-8806
> URL: https://issues.apache.org/jira/browse/YARN-8806
> Project: Hadoop YARN
> Issue Type: Sub-task
> Environment: In the /tmp dir, there are launch scripts which are not
> cleaned up as follows:
> -rw-r--r-- 1 hadoop netease 1100 Sep 18 10:46
> PRIMARY_WORKER-launch-script8635233314077649086.sh
> -rw-r--r-- 1 hadoop netease 1100 Sep 18 10:46
> WORKER-launch-script129488020578466938.sh
> -rw-r--r-- 1 hadoop netease 1028 Sep 18 10:46
> PS-launch-script471092031021738136.sh
> Reporter: Zac Zhou
> Assignee: Zac Zhou
> Priority: Major
> Attachments: YARN-8806.001.patch, YARN-8806.002.patch,
> YARN-8806.003.patch
>
>
> YarnServiceJobSubmitter.generateCommandLaunchScript creates container launch
> scripts in the local filesystem. Container launch scripts would be uploaded
> to hdfs staging dir, but would not be not deleted after the job is submitted
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
