asfimport commented on issue #42257: URL: https://github.com/apache/arrow/issues/42257#issuecomment-2184204289
[Deepak Majeti](https://issues.apache.org/jira/browse/PARQUET-474?#comment-15338078) / @majetideepak: I don't think we should make parquet-cpp library handle multi-threading at all. Managing synchronization will be an unnecessary complication and is usually handled well by the downstream application. For parallelism, downstream applications can create multiple instances of the reader, one per thread. For efficiency, we could implement an API to share read-only resources like "file footer" among the instances. This is what ORC library does too and it works very well. https://github.com/apache/orc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
