Le 30/09/2020 à 02:58, Pierre Belzile a écrit : > Hi, > > Some thoughts: > 1. For async IO, the system must have threads that quickly service the > callback. Otherwise the S3/GCS end will close the connection. A single > thread pool where all the threads are doing an expensive compute operation > (like CSV decoding or regex matching) can starve the IO.
Note that the AWS SDK for C++ has its own "async" APIs (which I presume use a dedicated thread pool underneath). Regards Antoine.
