[
https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15388390#comment-15388390
]
Wei Zheng commented on HIVE-14167:
----------------------------------
Thanks [~sseth] for review. Yes I tested it on a real cluster, and the spilling
destination is like this:
/grid/2/hadoop/yarn/local/usercache/root/appcache/application_1469059655454_0004/container_e27_1469059655454_0004_01_000048/tmp/partition-1-6031801271262901303.tmp
> Use work directories provided by Tez instead of directly using YARN local dirs
> ------------------------------------------------------------------------------
>
> Key: HIVE-14167
> URL: https://issues.apache.org/jira/browse/HIVE-14167
> Project: Hive
> Issue Type: Improvement
> Affects Versions: 2.1.0
> Reporter: Siddharth Seth
> Assignee: Wei Zheng
> Attachments: HIVE-14167.1.patch, HIVE-14167.2.patch,
> HIVE-14167.3.patch
>
>
> HIVE-13303 fixed things to use multiple directories instead of a single tmp
> directory. However it's using yarn-local-dirs directly.
> I'm not sure how well using the yarn-local-dir will work on a secure cluster.
> Would be better to use Tez*Context.getWorkDirs. This provides an app specific
> directory - writable by the user.
> cc [~sershe]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
