steveloughran opened a new pull request #1834: HADOOP-16848. Experimental directory marker optimization. URL: https://github.com/apache/hadoop/pull/1834 # Optimizes directory marker operations through:- * Async create/clear * An option "fs.s3a.experimental.optimized.directory.operations" That performs whatever optimisations to directory marker IO are considered effective to reduce that I while still avoiding problems with missing markers and/or markers not deleted. # Important 1. Work in progress 2. Experimental: use at own risk 3. Not for use against buckets whether other S3A releases are active 4. And not for use with data you value. View it as a Proof of Concept to explore what we can do here.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
