[ 
https://issues.apache.org/jira/browse/HADOOP-18517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shilun Fan updated HADOOP-18517:
--------------------------------
    Hadoop Flags: Reviewed
     Description: 
Add an option fs.azure.enable.readahead to allow the abfs readahead to be 
disabled.

This has been shipping in cloudera releases, because workloads with heavy 
random IO don't always benefit from prefetching.

Pulling this in to ASF hadoop allows for
* everyone to experiment with/without prefetching
* ability to disable prefetching if you have problems with it



  was:

Add an option fs.azure.enable.readahead to allow the abfs readahead to be 
disabled.

This has been shipping in cloudera releases, because workloads with heavy 
random IO don't always benefit from prefetching.

Pulling this in to ASF hadoop allows for
* everyone to experiment with/without prefetching
* ability to disable prefetching if you have problems with it




> ABFS: Add fs.azure.enable.readahead option to disable readahead
> ---------------------------------------------------------------
>
>                 Key: HADOOP-18517
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18517
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/azure
>    Affects Versions: 3.3.4
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0, 3.3.5
>
>
> Add an option fs.azure.enable.readahead to allow the abfs readahead to be 
> disabled.
> This has been shipping in cloudera releases, because workloads with heavy 
> random IO don't always benefit from prefetching.
> Pulling this in to ASF hadoop allows for
> * everyone to experiment with/without prefetching
> * ability to disable prefetching if you have problems with it



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to