[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Nauroth updated HADOOP-13208:
---
Affects Version/s: (was: 2.8.0)
Target Version/s: 2.8.0 (was: 2.9.0)
Fix
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Nauroth updated HADOOP-13208:
---
Release Note: S3A has optimized the listFiles method by doing a bulk
listing of all entries
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Nauroth updated HADOOP-13208:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.9.0
Status:
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Nauroth updated HADOOP-13208:
---
Attachment: HADOOP-13208-branch-2-021.patch
Steve, thank you for patch 020. I verified all
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-020.patch
Patch 020
* moves out all the new listing
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-019.patch
Patch 019
@Aaron
Returning the array
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
The no of requests is 5+(N/5000) for the curious,
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-018.patch
Patch 018; in sync with branch-2; all glob
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-017.patch
This is the aws module in sync with
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-012.patch
HADOOP-13208 patch 012: javadoc failing now
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
tested agains s3 ireland. With the modified test,
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-011.patch
Patch 011: fix up TestS3ADirectoryPerformance
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-010.patch
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: (was: HADOOP-13208-branch-2-009.patch)
> S3A listFiles(recursive=true) to
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Target Version/s: 2.9.0
Status: Open (was: Patch Available)
> S3A
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-009.patch
Patch 010. Address checkstyle and findbugs
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-009.patch
Patch 009.
# specify RemoteIterator in
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-008.patch
Patch 008; rebased to branch-2...some merge
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-007.patch
This is patch -007, which I'm numbering to
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Open (was: Patch Available)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Status: Patch Available (was: Open)
> S3A listFiles(recursive=true) to do a bulk
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Attachment: HADOOP-13208-branch-2-001.patch
Patch 001
incorporates HADOOP-13207
*
[
https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13208:
Summary: S3A listFiles(recursive=true) to do a bulk listObjects instead of
walking the
39 matches
Mail list logo