wesm commented on pull request #6744: URL: https://github.com/apache/arrow/pull/6744#issuecomment-621305031
Yeah, I think one definite thing that needs to happen at minimum is externalizing the thread pool used for asynchronous IO calls so that the user is able to set whatever concurrency limit makes sense for them. A perhaps more bigger picture issue is how to broker resource allocation more fairly amongst multiple consumers, since the current mode is that every consumer is greedy and able to hose the thread pool. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
