alamb commented on issue #13692: URL: https://github.com/apache/datafusion/issues/13692#issuecomment-4387981353
Here is a related bsky post https://bsky.app/profile/andrewlamb1111.bsky.social/post/3ml532gyb722j And my talk: https://www.youtube.com/watch?v=FeqRdDG1Y7g&feature=youtu.be > block_in_place I think block_in_place takes over one of the threads and prevents it from handling any more work until the blocking task is done. For example if you have 8 threads in your Runtime you can only issue 8 block_in_place calls before no additional tasks can be processed So in a normal DataFusion plan (that tries to keep all cores busy) if we used block_in_place I suspect we would end up with all 8 cores "blocked" and nothing else being processed. It would be an interesting experiment to try -- maybe a good use for coding agents to run the experiment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
