[
https://issues.apache.org/jira/browse/YARN-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Youquan Lin updated YARN-10313:
---
Description:
We used azkaban to submit many yarn jobs, and the /tmp directory will have many
hadoop-unjar directories. Sometimes the hadoop-unjar directory on the azkaban
machine takes up a lot of space, but we do not know which process generated
this directory. In order to solve this problem, we add the hadoop process id to
the suffix of the hadoop-unjar directory.
- hadoop process id
{code:java}
10554 org.apache.hadoop.util.RunJar{code}
- hadoop-unjar directory name
{code:java}
hadoop-unjar8020753511094521686-10554
{code}
was:
We used azkaban to submit many yarn jobs, and the /tmp directory will have many
hadoop-unjar directories. Sometimes the hadoop-unjar directory on the azkaban
machine takes up a lot of space, but we do not know which process generated
this directory. In order to solve this problem, we add the hadoop process id to
the suffix of the hadoop-unjar directory.
- hadoop process id
```
10554 org.apache.hadoop.util.RunJar
```
- hadoop-unjar directory name
```
hadoop-unjar8020753511094521686-10554
```
> Add hadoop process id to the suffix of hadoop-unjar directory
> -
>
> Key: YARN-10313
> URL: https://issues.apache.org/jira/browse/YARN-10313
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: client
>Affects Versions: 3.1.3
>Reporter: Youquan Lin
>Assignee: Youquan Lin
>Priority: Major
>
> We used azkaban to submit many yarn jobs, and the /tmp directory will have
> many hadoop-unjar directories. Sometimes the hadoop-unjar directory on the
> azkaban machine takes up a lot of space, but we do not know which process
> generated this directory. In order to solve this problem, we add the hadoop
> process id to the suffix of the hadoop-unjar directory.
>
> - hadoop process id
>
> {code:java}
> 10554 org.apache.hadoop.util.RunJar{code}
>
> - hadoop-unjar directory name
>
> {code:java}
> hadoop-unjar8020753511094521686-10554
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org