sreeb-msft opened a new pull request, #5661: URL: https://github.com/apache/hadoop/pull/5661
This PR includes code and test changes for the Pagination feature to be supported for Delete operations. The Pagination feature is to ensure the ACL checks that typically precede a recursive delete call in HNS settings can be conducted in a page-wise manner, leading to lower chances of the operation timing out. However, to keep with the existing driver test suite, the OSS changes for this on the driver side are intended to include only shorter tests. This is because, testing an end-to-end pagination scenario would require creation and deletion of a non-empty folder with number of resources greater than the current page limit set, which would slow down the entire test runs. Requirements: xMs Version: 2023-08-03 and above New configuration for Paginated delete introduced in this is called `fs.azure.enable.paginated.delete`. The default value for this is currently set to `false`. It can be flipped through the above configuration, and the default value can also be flipped to `true` if the tenants running the tests support pagination in delete. It is also important to note that the feature is supported only for HNS accounts, where the concept of ACL Checks hold good. Thus, for HNS cases, the pagination parameter and continuation token are coupled together, and a non-null continuation token will be passed in the server response only when the ACL checks are to be conducted for a directory having a greater number of resources than the page size. A non-null continuation token can also be passed by the user in the API call only when pagination behavior is expected. In the case of FNS accounts, pagination is not supported, and the parameter is ignored even if passed. Here the continuation token refers to what is returned in the server response when the actual number of resources getting listed and deleted are greater than a certain limit, and have no relation to this pagination feature. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
