James Yu created HADOOP-9377:
--------------------------------
Summary: FTPFileSystem.listStatus() runs very slow, due to
inappropriate call of filePath.makeQualified
Key: HADOOP-9377
URL: https://issues.apache.org/jira/browse/HADOOP-9377
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 2.0.3-alpha
Reporter: James Yu
FTPFileSystem.listStatus() calls
getFileStatus(ftpFiles[i], absolute) calls
new FileStatus(....) calls
filePath.makeQualified(...) calls
fs.getWorkingDirectory() calls
getHomeDirectory()
which creates new FTP connection every time, to get the workdingDirectory. this
caused the FTPFileSystem.listStatus() takes long time to run (on average 3-6
seconds per file in my test).
I attach a suggestion of fix in FTPFileSystem.java, only 4 lines of change.
after the fix, there's no slowness issue anymore.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
