jinchengchenghh opened a new issue, #10933: URL: https://github.com/apache/incubator-gluten/issues/10933
### Description 1. Move the lock from WholeStageResultIterator constructor to shuffle reader, the threads can prepare the first batch in advance, now it is a small batch, for GPU, it will produce a big batch with bytes 1GB 2. Implement the decompression, convert buffer to cudf table, resize batch in GPU 3. Then the threads can prepare read buffer from file. ### Gluten version None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
