goldmedal commented on PR #10619: URL: https://github.com/apache/datafusion/pull/10619#issuecomment-2131302454
On a related note, I found that the usage flow of ObjectStore in DataFusion involves registering the source as a table and then querying the table. This approach makes sense. However, I think it might be possible to provide something like a table function or other methods to allow users to dynamically decide which path they want to scan. There are similar features in DuckDB and Spark: - DuckDB: `SELECT * FROM read_parquet('file-path/test.parquet')` - Spark: `spark.read.parquet('xxxx')` Does DataFusion already have this feature, or did I miss it? If not, I think it would be a valuable feature for users of object storage. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org