[
https://issues.apache.org/jira/browse/HADOOP-18517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17627889#comment-17627889
]
ASF GitHub Bot commented on HADOOP-18517:
-----------------------------------------
steveloughran commented on PR #5103:
URL: https://github.com/apache/hadoop/pull/5103#issuecomment-1301058159
testing against s3 cardiff. all ok except that
-ITestAbfsReadWriteAndSeek.testReadAndWriteWithDifferentBufferSizesAndSeek[Size=104,857,600-readahead=true]]
is taking so long to write the file that the test can time out if other things
are under way on the laptop. I'm not going to change that test though to make
it configurable, add readFully() actions or similar.
i do have plans there, as it is the single "huge file" test in the codebase,
but not in this PR
> ABFS: Add fs.azure.enable.readahead option to disable readahead
> ---------------------------------------------------------------
>
> Key: HADOOP-18517
> URL: https://issues.apache.org/jira/browse/HADOOP-18517
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/azure
> Affects Versions: 3.3.4
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> Add an option fs.azure.enable.readahead to allow the abfs readahead to be
> disabled.
> This has been shipping in cloudera releases, because workloads with heavy
> random IO don't always benefit from prefetching.
> Pulling this in to ASF hadoop allows for
> * everyone to experiment with/without prefetching
> * ability to disable prefetching if you have problems with it
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
