[
https://issues.apache.org/jira/browse/HADOOP-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007880#comment-16007880
]
Steve Loughran commented on HADOOP-8970:
----------------------------------------
YARN apps just use a relative path for temp files; rely on NM cleanup after.
Should this be closed as "done?"
> Need a different environment variable or configuration that states where
> local temporary files are stored than hadoop.tmp.dir
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8970
> URL: https://issues.apache.org/jira/browse/HADOOP-8970
> Project: Hadoop Common
> Issue Type: Improvement
> Components: conf
> Reporter: Robert Justice
>
> I'm finding that hadoop.tmp.dir is used for a base directory in configuration
> of working directories for many other hadoop sub components (mapred, hdfs,
> hue, etc) and that it directs where the Hadoop client stores some local
> temporary files, as well as temporary files on HDFS.
> Users may be dealing with tight space in /tmp. In order to move where job
> setup files, hive, hue files, etc, are locally stored, they have to create a
> new directory on HDFS (i.e. /temp) and local directories on another
> filesystem and make sure permissions are setup properly in HDFS and for the
> local filesystem across all the nodes across the cluster.
> I'm wondering if it would be better to have a hadoop.local.tmp.dir that is
> configurable at the client level to say where local files are kept, and break
> that out from hadoop.tmp.dir? Know this is a major change, but thought I
> would suggest it.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
