[ 
https://issues.apache.org/jira/browse/HADOOP-14645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran resolved HADOOP-14645.
-------------------------------------
    Resolution: Won't Fix

> add a predicate/option to probe an S3A FS for being consistent
> --------------------------------------------------------------
>
>                 Key: HADOOP-14645
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14645
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: HADOOP-13345
>            Reporter: Steve Loughran
>
> The committer work shows It's useful for s3a-aware code to be able to ask if 
> the FS is consistent fir listings. AWS S3 is when s3guard is turned on, but 
> third-party S3 implementations may also be consistent.
> The committer should be able to ask an FS if it is consistent, something 
> which can be
> * off by default against AWS
> * configured to be one for all buckets (external s3 server)
> * dynamically set when s3guard is enabled.
> This could be done with some predicate isListingConsistent(), or just probed 
> as an FS option (fs.s3a.consistent.listing) which could be set explicitly in 
> configs, and set dynamically when s3guard is on. That's actually the 
> simpleset route all round



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Reply via email to