k5342 commented on PR #4132: URL: https://github.com/apache/ozone/pull/4132#issuecomment-1371940161
Hi @errose28, thank you for your pointer. Fortunately, it worked for us. We have many multipart-uploaded files under the same prefix in our environment; hence it requires us to reduce the window from 1000 to 10. We are concerned about OM load increase, so we will carefully apply it to our production use. We already tried a `--page-size` option aws-cli, but it had not worked and stuck us. We did not notice limiting RPC entries on the Ozone client side in the listStatus API. Thank you for guiding me. I will put +1 for the @kerneltime's suggestion on expanding a new API call or putting new arguments for existing API. From my personal view, I think extending listStatus API to add a capability for just serving only keys is the most elegant solution. However, the listStatus already has much variety of arguments and overloads, so further extending is a bit complicated, and that requires to pay a compatibility issue too. In that sense, a new API method to get keys might be the most simple (might be naïve?) solution. I submitted this patch to check the CI pass. However, it turned out that just omitting pipelineInfo breaks the compatibility for OFS, so I think this direction is unacceptable for merge; now we can close this PR. Thank you for your comments! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
