steveloughran commented on pull request #2168: URL: https://github.com/apache/hadoop/pull/2168#issuecomment-732997464
latest patch follows on from HADOOP-17318 and passes in status when opening .pending and .pendingset files. for the magic committer this saves 1 HEAD per file in task commit; 1 HEAD per task in job commit For max speedup/scale we'd need to also adopt incremental listing. Later. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
