steveloughran opened a new pull request #565: HADOOP-16058 S3A tests to include Terasort URL: https://github.com/apache/hadoop/pull/565 HADOOP-16058. Add S3A tests to run terasort for the magic and directory committers. Contributed by Steve Loughran. Contains: MAPREDUCE-7090. BigMapOutput example doesn't work with paths off cluster fs MAPREDUCE-7091. Terasort on S3A to switch to new committers MAPREDUCE-7092. MR examples to work better against cloud stores Bonus feature: prints the results to see which committers are faster in the specific test setup. As that's a function of latency to the store, bandwidth and size of jobs, it's not at all meaningful, just interesting.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
