RobindeGrootNL commented on pull request #10450: URL: https://github.com/apache/arrow/pull/10450#issuecomment-1073930379
I am currently looking into incorporating these changes into a library that I use for data loading ([Petastorm](https://github.com/uber/petastorm)) and they use the `ParquetDataset` implementation to read data from a parquet dataset in the [make_batch_reader() function that calls the Reader class](https://github.com/uber/petastorm/blob/master/petastorm/reader.py). I see that the decryption arguments are present in `ParquetFile` but not in `ParquetDataset` in pyarrow. Is it possible to accept decryption_properties in ParquetDataset as well? If not, would it be possible to provide some guidance on a workaround? Thank you in advance! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
