timsaucer commented on PR #1311: URL: https://github.com/apache/datafusion-python/pull/1311#issuecomment-3589787734
I am tempted to take a stab at redoing our runtime and using a CPU Executor similar to this example: https://github.com/apache/datafusion/blob/main/datafusion-examples/examples/query_planning/thread_pools.rs The idea would be to say that all datafusion work gets shipped over to a dedicated threadpool to keep the Python thread lighter, but I am not sure if that's worth it or not. I may be over-analyzing a problem that isn't much of an actual problem. I would like to figure out exactly why this isn't working though. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
