gauravkm commented on PR #3062: URL: https://github.com/apache/celeborn/pull/3062#issuecomment-2684010769
@gaoyajun02 Yes. I am still working on this. We (at Stripe) realized that the implementation needs to be a lot more comprehensive and thorough. We are internally testing out the new implementation which I will then open for review in OSS as well. We also found that the current approach introduces a lot of overhead for apps that provision a high partition count but only write to a few of them. So we have altered the design to be able to accommodate such apps. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
