steveloughran commented on issue #1407: HADOOP-16490. Improve S3Guard handling of FNFEs in copy URL: https://github.com/apache/hadoop/pull/1407#issuecomment-529465938 FWIW, in the HADOOP-16207 code there was a bug in a recent iteration where each task was committing the staging file .pendingset files[ to to the temp dir system property of its task, which was being set to a different path on each NM; only work written by tasks running on the same NM as job commit were found. Wonder if this is similar
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
