bilaharith commented on a change in pull request #1907: HADOOP-16854 Fix to prevent OutOfMemoryException and Make the threadpool and bytebuffer pool common across all AbfsOutputStream instances URL: https://github.com/apache/hadoop/pull/1907#discussion_r403502506
########## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/FileSystemConfigurations.java ########## @@ -49,7 +49,11 @@ public static final int DEFAULT_AZURE_LIST_MAX_RESULTS = 500; public static final int MAX_CONCURRENT_READ_THREADS = 12; - public static final int MAX_CONCURRENT_WRITE_THREADS = 8; + public static final int DEFAULT_WRITE_CONCURRENCY_FACTOR = 4; Review comment: Not changed, Removed an unused constant. This value 4 is currently hardcoded in AbfsOutputStream class. Now made it a config. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
