marin-ma commented on PR #6056: URL: https://github.com/apache/incubator-gluten/pull/6056#issuecomment-2174720993
> @zhztheplayer @marin-ma Similarly if the batch size is too large, each column exceeds the L2 cache size, the performance should be very bad as well. Can you submit a similar PR to fix this? Split the large batchs into the small one during Split. @FelixYBW Do we need a new Operator for it? If it's only for split, we already have it https://github.com/apache/incubator-gluten/pull/5536 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
