rdettai commented on pull request #1905: URL: https://github.com/apache/arrow-datafusion/pull/1905#issuecomment-1058140404
just to be sure I understand you correctly: if we used `PartitionedFile` for the file slicing, you would obtain parallelism by creating multiple `ObjectReader` instances? In the case we don't want one `ObjectReader` instance to be distributed accross threads, `file_reader()` should stop returning `Arc<dyn ObjectReader>` and return an owned object (`Box<dyn ObjectReader>`). This would allow you to cut out the mutex. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
