chasingegg commented on issue #46913: URL: https://github.com/apache/arrow/issues/46913#issuecomment-3018084957
> > [@pitrou](https://github.com/pitrou) I guess a `real async` operation should call s3's getObjectAsync to let s3 (crt)client to deal with it. > > Well, AFAIU, it would use the AWS SDK's own thread pool, wouldn't it? > From my investigation, yes for s3Client, No for s3CrtClient which is easily occupying the full bandwidth without tuning the thread pool size. > > [@pitrou](https://github.com/pitrou) could we rely on s3CrtClient which is more efficient instead of s3Client? > > There's already an issue open for that: [#18923](https://github.com/apache/arrow/issues/18923) > > Someone has to work on a PR for it, though. Haha, that's true... trying to do so, hopefully there are not too much to change between two clients' interfaces. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
