balshetzer opened a new issue, #37278: URL: https://github.com/apache/arrow/issues/37278
### Describe the usage question you have. Please include as many useful details as possible. We use an arrow flight based API to export data. It would be very useful to be able to use something like the pyarrow.dataset object over such datasets too. Right now the dataset wants a directory of files. But it would be useful to be able provide an implementation of an interface that has operations like listing all tables, getting their schemas, reading portions of the tables, etc. So it can be used in front of arrow flight. If I had such a thing then I could pass a pyarrow.dataset backed by our data to, say, DuckDB and it could efficiently perform queries with row and column filtering. ### Component(s) FlightRPC, Python -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
