[
https://issues.apache.org/jira/browse/ASTERIXDB-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115952#comment-17115952
]
ASF subversion and git services commented on ASTERIXDB-2736:
------------------------------------------------------------
Commit 1a28c658810ded5d50ff88f42ef88ec8f82926e1 in asterixdb's branch
refs/heads/master from Hussain Towaileb
[ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=1a28c65 ]
[ASTERIXDB-2736][EXT] Ensure retrieving all objects if an S3 bucket has more
than 1000 objects
- user model changes: no
- storage format changes: no
- interface changes: no
Details:
- Fixed the AWS reader to handle reading more than 1000
objects coming in a single request.
- Added a test case for the above mentioned item.
Change-Id: Ic7891aa86852e07dfad9ce41de908b34f86bdb42
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/6344
Integration-Tests: Jenkins <jenk...@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenk...@fulliautomatix.ics.uci.edu>
Reviewed-by: Hussain Towaileb <hussai...@gmail.com>
> Ensure all files are retrieved if more than 1000 files exist in AWS S3 bucket
> -----------------------------------------------------------------------------
>
> Key: ASTERIXDB-2736
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-2736
> Project: Apache AsterixDB
> Issue Type: Bug
> Components: EXT - External data
> Affects Versions: 0.9.5
> Reporter: Hussain Towaileb
> Assignee: Hussain Towaileb
> Priority: Major
> Fix For: 0.9.5
>
>
> When the objects are listed from an AWS S3 bucket, a maximum of 1000 objects
> are retrieved at a time. Ensure that all objects are retrieved if more than
> 1000 objects exist in a bucket.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
