waitinfuture commented on PR #2373: URL: https://github.com/apache/celeborn/pull/2373#issuecomment-2037721273
> @wangshengjie123 Is there any doc or ticket explaining this approach? Also for the sort based approach that you mentioned. The sort based approach is roughly like follows: 1. Each sub reducer reads from all partition splits for data within its map range 2. The first read request will trigger the partition split file to be sorted based on map ids, so each IO will be sequential   -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
