cgivre opened a new pull request, #2660: URL: https://github.com/apache/drill/pull/2660
# [DRILL-8320](https://issues.apache.org/jira/browse/DRILL-8320): Prevent Infinite Pagination for Index Paginator ## Description In some cases that use keyset/index pagination, if the API does not have a boolean column that indicates when to stop, Drill will send requests until the API stops returning data. This PR fixes this by making the boolean parameter optional. If that parameter is not present, if the index result is blank or the same as the previous request, pagination will end. Note, if the pagination parameters are buried in nested objects, this cannot be configured with a `dataPath`. If the user uses a `dataPath`, pagination will stop at the first page. ## Documentation No user facing changes. ## Testing Added unit test and tested manually with Hubspot API. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
