jorisvandenbossche commented on PR #12909: URL: https://github.com/apache/arrow/pull/12909#issuecomment-1109507238
Actually, on second thought, be _do_ have some infrastructure for testing this, as we had to do something similar in the past for the parquet_dataset constructor. We have the following fixture for a filesystem that logs if a file get accessed: https://github.com/apache/arrow/blob/4010916f864783b2a8e7a7d1a9d0187060ec47e7/python/pyarrow/tests/test_dataset.py#L124-L153 and see an example of how this is used: https://github.com/apache/arrow/blob/4010916f864783b2a8e7a7d1a9d0187060ec47e7/python/pyarrow/tests/test_dataset.py#L3206-L3228 @Salonijain27 would you have time to take a look at this today? Otherwise I can also take a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
