Zamil Majdy created HADOOP-17990:
------------------------------------
Summary: Failing concurrent FS.initialize commands when
fs.azure.createRemoteFileSystemDuringInitialization is enabled on hadoop-azure
ABFS
Key: HADOOP-17990
URL: https://issues.apache.org/jira/browse/HADOOP-17990
Project: Hadoop Common
Issue Type: Bug
Components: common, fs
Affects Versions: 3.3.1
Reporter: Zamil Majdy
*Bug description:*
`fs.mkdirs` command for `RawLocalFileSystem` doesn't work in Hadoop 3 with
NativeIO enabled.
The failure was happening when doing the native `chmod` command to the file
(the `mkdir` command itself is working).
Stacktrace:
{{ENOENT: No such file or directory ENOENT: No such file or directory at
org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmodImpl(Native Method) at
org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmod(NativeIO.java:382) at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:974)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:660)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:700)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:672)}}
*To reproduce:*
* Add `fs.mkdirs` in RawLocalFileSystem with NativeIO enabled.
* Sample: [https://github.com/apache/hadoop/pull/3391]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
