srilman opened a new pull request, #43698:
URL: https://github.com/apache/arrow/pull/43698

   ### Rationale for this change
   
   (See https://github.com/apache/arrow/issues/43694)
   
   ### What changes are included in this PR?
   
   Added the option `ExecContext exec_context` to `arrow::dataset::ScanOptions` 
and modified the scanner and sub-functions to either use the internally 
specified thread pool or the default internal pool when necessary.
   
   ### Are these changes tested?
   
   Added a Parquet scanner test that uses the new ExecContext using a separate 
thread pool for each fragment.
   
   ### Are there any user-facing changes?
   
   Yes, adds a new option. I'm not sure how to update the documentation though


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to