tustvold commented on issue #13692: URL: https://github.com/apache/datafusion/issues/13692#issuecomment-2577190762
> Where I do see difference is --concurrency 8+: Once the concurrency exceeds the pool size starvation is inevitable, and isn't the issue people have been running into. The issue is tokio starving at low concurrency, I believe to do with the way it polls its reactor. Unfortunately the reproducer had a bug, which I fixed, but now it isn't as obvious, perhaps it never was a good reproducer. What probably needs to happen is someone to try this on one of the real workloads that had this issue and see if it helps. Unfortunately I have no more time to dedicate to this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
