assignUser commented on issue #37816: URL: https://github.com/apache/arrow/issues/37816#issuecomment-1728599693
Yeah with `unify_schemas=FALSE` it should only touch one file to get the schema (atleast that is my read on the documentation...) not sure if the downloads are triggered due to some other access due to the fact that it appears to be a local fs. Have you tested what happens when opening the dataset via bucket uri? related issue: #33312 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
