walterddr opened a new issue, #9272: URL: https://github.com/apache/pinot/issues/9272
Problem === Currently we do not split data table when size is too large. thus we set the default GRPC channel msg size to 128MB. however this is still an issue when join two large tables together (especially using broadcast JOIN) Propose === - introduce data table splitter so that each data block is small enough. this also help pipeline processing and speed up the overall latency. - allow mailbox to send data blocks with variating number of splits. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
