[
https://issues.apache.org/jira/browse/HADOOP-18517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shilun Fan updated HADOOP-18517:
--------------------------------
Hadoop Flags: Reviewed
Description:
Add an option fs.azure.enable.readahead to allow the abfs readahead to be
disabled.
This has been shipping in cloudera releases, because workloads with heavy
random IO don't always benefit from prefetching.
Pulling this in to ASF hadoop allows for
* everyone to experiment with/without prefetching
* ability to disable prefetching if you have problems with it
was:
Add an option fs.azure.enable.readahead to allow the abfs readahead to be
disabled.
This has been shipping in cloudera releases, because workloads with heavy
random IO don't always benefit from prefetching.
Pulling this in to ASF hadoop allows for
* everyone to experiment with/without prefetching
* ability to disable prefetching if you have problems with it
> ABFS: Add fs.azure.enable.readahead option to disable readahead
> ---------------------------------------------------------------
>
> Key: HADOOP-18517
> URL: https://issues.apache.org/jira/browse/HADOOP-18517
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/azure
> Affects Versions: 3.3.4
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0, 3.3.5
>
>
> Add an option fs.azure.enable.readahead to allow the abfs readahead to be
> disabled.
> This has been shipping in cloudera releases, because workloads with heavy
> random IO don't always benefit from prefetching.
> Pulling this in to ASF hadoop allows for
> * everyone to experiment with/without prefetching
> * ability to disable prefetching if you have problems with it
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]