[ https://issues.apache.org/jira/browse/HADOOP-9981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776665#comment-13776665 ]
Hadoop QA commented on HADOOP-9981: ----------------------------------- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12604835/HADOOP-9981.001.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.fs.TestPath org.apache.hadoop.cli.TestHDFSCLI {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3117//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3117//console This message is automatically generated. > Listing in RawLocalFileSystem is inefficient > -------------------------------------------- > > Key: HADOOP-9981 > URL: https://issues.apache.org/jira/browse/HADOOP-9981 > Project: Hadoop Common > Issue Type: Bug > Affects Versions: 2.3.0 > Reporter: Kihwal Lee > Assignee: Colin Patrick McCabe > Priority: Critical > Attachments: HADOOP-9981.001.patch > > > After HADOOP-9652, listStatus() or globStatus() calls against a local file > system directory is very slow. A user was loading data from local file > system to Hive and it took about 30 seconds. The same operation took less > than a second pre-HADOOP-9652. > The input path had many other files beside the input files and strace showed > that fork & exec of stat against each and every one of them. jstack confirmed > that this was being done from getNativeFileLinkStatus(). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira