anujmodi2021 commented on code in PR #6270:
URL: https://github.com/apache/hadoop/pull/6270#discussion_r1400365675
##########
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/FileSystemConfigurations.java:
##########
@@ -59,7 +59,8 @@ public final class FileSystemConfigurations {
public static final boolean DEFAULT_AZURE_ENABLE_SMALL_WRITE_OPTIMIZATION =
false;
public static final int DEFAULT_READ_BUFFER_SIZE = 4 * ONE_MB; // 4 MB
public static final boolean DEFAULT_READ_SMALL_FILES_COMPLETELY = false;
- public static final boolean DEFAULT_OPTIMIZE_FOOTER_READ = false;
+ public static final boolean DEFAULT_OPTIMIZE_FOOTER_READ = true;
+ public static final int DEFAULT_FOOTER_READ_BUFFER_SIZE = 512 * ONE_KB;
Review Comment:
Updated the doc.
So 256KB is enough data but to be on safer side we want to read more. It was
found that 512 KB is a sweet spot between caching as much data as possible
without impacting performance as much as possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
