[
https://issues.apache.org/jira/browse/HADOOP-17596?focusedWorklogId=595919&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-595919
]
ASF GitHub Bot logged work on HADOOP-17596:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 13/May/21 06:51
Start Date: 13/May/21 06:51
Worklog Time Spent: 10m
Work Description: anoopsjohn commented on a change in pull request #2795:
URL: https://github.com/apache/hadoop/pull/2795#discussion_r631605580
##########
File path:
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestAbfsInputStream.java
##########
@@ -569,6 +570,20 @@ public void testDiffReadRequestSizeAndRAHBlockSize()
throws Exception {
testReadAheads(inputStream, FORTY_EIGHT_KB, SIXTEEN_KB);
}
+ @Test
+ public void testDefaultReadaheadQueueDepth() throws Exception {
+ Configuration config = getRawConfiguration();
+ config.unset("fs.azure.readaheadqueue.depth");
Review comment:
This in effect change this config (Is set already) for this test class.
As we direct change in Raw config.
Should we create a cloned conf from rawConfig and on that unset and use that
for FS created for this method?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 595919)
Time Spent: 1h (was: 50m)
> ABFS: Change default Readahead Queue Depth from num(processors) to const
> ------------------------------------------------------------------------
>
> Key: HADOOP-17596
> URL: https://issues.apache.org/jira/browse/HADOOP-17596
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.3.1
> Reporter: Sumangala Patki
> Assignee: Sumangala Patki
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> The default value of readahead queue depth is currently set to the number of
> available processors. However, this can result in one inputstream instance
> consuming more processor time. To ensure equal thread allocation during read
> for all inputstreams created in a session, we change the default readahead
> queue depth to a constant (2).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
