alamb commented on PR #10619: URL: https://github.com/apache/datafusion/pull/10619#issuecomment-2132163536
> Does DataFusion already have this feature, or did I miss it? If not, I think it would be a valuable feature for users of object storage. THis feature is in `datafusion-cli` (not DataFusion core) via a synamic schema provider ```shell andrewlamb@Andrews-MacBook-Pro-2:~/Software/influxdb_iox$ datafusion-cli DataFusion CLI v38.0.0 > select * from '/tmp/foo.parquet'; +---------+ | column1 | +---------+ | 1 | +---------+ 1 row(s) fetched. Elapsed 0.015 seconds. ``` Automatically allowing access to reading arbtrary files / urls is likely not appropriate for datafusion by default, however having it be an easier feature to add would be good. Maybe this would be a good feature to add as an example or maybe even move the dynamic table provider into datafusion core (not enabled by default) if this is a feature others want -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
