andygrove commented on issue #15323: URL: https://github.com/apache/datafusion/issues/15323#issuecomment-2781458966
> I have a working version locally and will create a PR soon, just one problem, I don't think we can know the number of blocking threads tokio is configured with. > > this is important as for example Comet set this by default to 10, and tokio default is 512 IIRC. > > the working version can be improved with some optimization like prefetch and more, but it will be good enough for now and we can iterate further Comet currently creates a new tokio runtime per plan but there is a proposal to move to a global tokio runtime (per executor) instead. https://github.com/apache/datafusion-comet/issues/1590 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
