EnricoMi commented on issue #731: URL: https://github.com/apache/incubator-uniffle/issues/731#issuecomment-1812087568
Given `partitionId` is 32 bit and `taskAttemptId` even 64 bit, there is always a chance that the BlockID overflows, no matter how we balance the different parts. Can you elaborate a bit on the design decision taken to have BlockID contain those parts, and in favour of what benefits you sacrifice large number of partitions or tasks. I am happy to work out alternatives and contribute, but a bit of background knowledge is needed here. Maybe comments in on Github is not the best format to elaborate on this issue. Happy to chat elsewhere. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
