[
https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth reopened TEZ-1337:
---------------------------------
[~airbots] - apologies for not updating this jira after TEZ-1393. The earlier
comments aren't valid anymore. Given the number of directories involved as
pointed out in TEZ-1393 (and comments on this) - this was always not a very
well understood issue.
However, there's still utility in letting users configure a directory which
will be used for what would otherwise be the YARN local-dirs and log-dirs. The
comment about this directory being deleted during staging / task cleanup still
holds.
Essentially, allow users to setup a directory, into which tasks write their
intermediate output, and into which logs are generated - which is controllable
by users. If this isn't setup - the staging directory can always be used for
the same.
> Handling of local-dirs for Local Mode
> -------------------------------------
>
> Key: TEZ-1337
> URL: https://issues.apache.org/jira/browse/TEZ-1337
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Siddharth Seth
> Assignee: Chen He
> Fix For: 0.5.0
>
> Attachments: TEZ-1337.patch
>
>
> staging dir is being used to write intermediate data. At some point, it may
> be worthwhile to confgure a separate work area. IAC, these should be cleaned
> up - at least the intermediate data after a local session executes.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
