Charlie Helin created HDFS-9110: ----------------------------------- Summary: Improve upon HDFS-8480 Key: HDFS-9110 URL: https://issues.apache.org/jira/browse/HDFS-9110 Project: Hadoop HDFS Issue Type: Improvement Affects Versions: 2.7.0 Reporter: Charlie Helin Priority: Minor Fix For: 2.6.1, 2.7.0
This is a request to do some cosmetic improvements on top of HDFS-8480. There a couple of File -> java.nio.file.Path conversions which is a little bit distracting. The second aspect is more around efficiency, to be perfectly honest I'm not sure what the number of files that may be processed. However as HDFS-8480 eludes to it appears that this number could be significantly large. The current implementation is basically a collect and process where all files first is being examined; put into a collection and after that processed. HDFS-8480 could simply be further enhanced by employing a single iteration without creating an intermediary collection of filenames by using a FileWalker -- This message was sent by Atlassian JIRA (v6.3.4#6332)