[ 
https://issues.apache.org/jira/browse/HADOOP-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran resolved HADOOP-14000.
-------------------------------------
    Resolution: Won't Fix

> S3guard metadata stores to support millions of entries
> ------------------------------------------------------
>
>                 Key: HADOOP-14000
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14000
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.0.0-beta1
>            Reporter: Steve Loughran
>            Priority: Major
>
> S3 repos can have millions of child entries
> Currently {{DirListingMetaData}} can't and {{MetadataStore.listChildren(Path 
> path)}} won't be able to handle directories that big, for listing, deleting 
> or naming.
> We will need a paged response from the listing operation, something which can 
> be iterated over.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Reply via email to