alamb commented on PR #20820: URL: https://github.com/apache/datafusion/pull/20820#issuecomment-4025539235
What I am planning to do next in this PR (after I finish up some other things for work) is 1. Integrate in "morsels" into the Parquet opener flow (as a proof of concept) 2. Sketch out how IO and CPU might be split I am also trying to figure out what types of queues would belong in the FIleStream (queues of MorselFutures perhaps 🤔 ) Or maybe I need to make a more explicit state machine * `IOMorsels` * `CPUMorsels` 🤔 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
