[
https://issues.apache.org/jira/browse/NIFI-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18064126#comment-18064126
]
ASF subversion and git services commented on NIFI-15685:
--------------------------------------------------------
Commit 75184260be137931c198690dcef32a971581c940 in nifi's branch
refs/heads/main from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=75184260be1 ]
NIFI-15685 - ListS3 V1 pagination fails when delimiter is not set causing
infinite loop for buckets with more than 1000 objects
This closes #10983.
Signed-off-by: Peter Turcsanyi <[email protected]>
> ListS3 V1 pagination fails when delimiter is not set causing infinite loop
> for buckets with more than 1000 objects
> ------------------------------------------------------------------------------------------------------------------
>
> Key: NIFI-15685
> URL: https://issues.apache.org/jira/browse/NIFI-15685
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Reporter: Pierre Villard
> Assignee: Pierre Villard
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> In S3ObjectBucketLister.setNextMarker() (the V1 lister), the code
> unconditionally used listObjectsResponse.nextMarker() as the pagination
> marker. Per the AWS S3 ListObjects V1 API, nextMarker is only populated when
> a delimiter is specified in the request. Without a delimiter, nextMarker()
> returns null, which resets the listing back to the beginning of the bucket,
> creating an infinite loop re-fetching the same first page of objects.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
