[
https://issues.apache.org/jira/browse/YARN-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14528725#comment-14528725
]
Chris Nauroth commented on YARN-3549:
-------------------------------------
Hi [~djp]. This will be a YARN code change in the localizer, so YARN is the
appropriate project to track it. The code change will involve calling a native
fstat method provided in hadoop-common, but that code already exists, and I
don't expect it will need any changes to support this.
> use JNI-based FileStatus implementation from
> io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation
> from RawLocalFileSystem in checkLocalDir.
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-3549
> URL: https://issues.apache.org/jira/browse/YARN-3549
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Reporter: zhihai xu
> Assignee: zhihai xu
>
> Use JNI-based FileStatus implementation from
> io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation
> from RawLocalFileSystem in checkLocalDir.
> As discussed in YARN-3491, shell-based implementation getPermission runs
> shell command "ls -ld" to get permission, which take 4 or 5 ms(very slow).
> We should switch to io.nativeio.NativeIO.POSIX#getFstat as implementation in
> RawLocalFileSystem to get rid of shell-based implementation for FileStatus.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
