dengzhhu653 opened a new pull request #1920: MAPREDUCE-7241. FileInputFormat listStatus with less memory footprint URL: https://github.com/apache/hadoop/pull/1920 LocatedFileStatus returned by fs.listLocatedStatus contains the LocatedBlock, which is useless when MR submitting jobs. The patch tries to exclude the LocatedBlock from the LocatedFileStatus, allows MR scanning more files with less memory footprint.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
