Dandandan edited a comment on pull request #546:
URL: https://github.com/apache/arrow-datafusion/pull/546#issuecomment-867801844
In my view, creating tasks this small is unlikely to be of benefit for query
execution. Note that spawn blocking will create new threads on demand (512 by
Dandandan edited a comment on pull request #546:
URL: https://github.com/apache/arrow-datafusion/pull/546#issuecomment-867801844
In my view, creating tasks this small is unlikely to be of benefit for the.
Note that spawn blocking will create new threads on demand (512 by default),
which
Dandandan edited a comment on pull request #546:
URL: https://github.com/apache/arrow-datafusion/pull/546#issuecomment-860194116
> maybe a better way is to use rayon
In my opinion we should try to stay away from Rayon and probably also should
stay away from introducing parallelism
