jorgecarleitao commented on pull request #8453: URL: https://github.com/apache/arrow/pull/8453#issuecomment-707483047
Note that there is an important note in [Tokio's documentation](https://docs.rs/tokio/0.2.22/tokio/index.html#cpu-bound-tasks-and-blocking-code): > If your code is CPU-bound and you wish to limit the number of threads used to run it, you should run it on another thread pool such as rayon. You can use an oneshot channel to send the result back to Tokio when the rayon task finishes. I.e. Tokio's `spawn` is suitable for non-blocking, non-CPU-bound tasks. This may explain why we do not see a significant performance increase when using `tokio::spawn`: most of our tasks are CPU-bounded. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
