dengzhhu653 opened a new pull request #1492: MAPREDUCE-7241. FileInputFormat listStatus oom caused by lots of unwanted block infos URL: https://github.com/apache/hadoop/pull/1492 FileInputFormat may cause oom problem when scanning lots of files during listing status, as described in https://issues.apache.org/jira/browse/MAPREDUCE-7241. This patch can reduce the memory usage, allowing MR scanning more files with less memory footprint.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
