tustvold commented on PR #389: URL: https://github.com/apache/arrow-rs-object-store/pull/389#issuecomment-2922830949
list_with_offset is designed for listing everything after a given prefix, this is useful for data lake changelogs among other use-cases where you know you aren't interested in records before some time. I appreciate this isn't sufficient to add pagination, but that doesn't make it useless😅 If you need an ordered output, you will need to fetcy everything and sort, which is ultimately what this PR is proposing always doing and I am pushing back on. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
