This is an automated email from the ASF dual-hosted git repository.
mehakmeet pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/branch-3.3 by this push:
new b0377379af1 HADOOP-18764. fs.azure.buffer.dir to be under Yarn
container path on yarn applications (#5788)
b0377379af1 is described below
commit b0377379af161f3f58abfb708911acaae71d6983
Author: Mehakmeet Singh <mehakmeet.singh.b...@gmail.com>
AuthorDate: Fri Jun 30 12:00:26 2023 +0530
HADOOP-18764. fs.azure.buffer.dir to be under Yarn container path on yarn
applications (#5788)
Changing fs.azure.buffer.dir for azure so things clean up better in
long-lived yarn clusters.
Contributed by: Mehakmeet Singh
---
.../hadoop-common/src/main/resources/core-default.xml | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git
a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
index b1a25ce1f00..1501ee4bc26 100644
--- a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
+++ b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
@@ -2133,9 +2133,11 @@ The switch to turn S3A auditing on or off.
<property>
<name>fs.azure.buffer.dir</name>
- <value>${hadoop.tmp.dir}/abfs</value>
+ <value>${env.LOCAL_DIRS:-${hadoop.tmp.dir}}/abfs</value>
<description>Directory path for buffer files needed to upload data blocks
- in AbfsOutputStream.</description>
+ in AbfsOutputStream.
+ Yarn container path will be used as default value on yarn applications,
+ otherwise fall back to hadoop.tmp.dir </description>
</property>
<property>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
