goldmedal commented on PR #10619:
URL: https://github.com/apache/datafusion/pull/10619#issuecomment-2131302454
On a related note, I found that the usage flow of ObjectStore in DataFusion
involves registering the source as a table and then querying the table. This
approach makes sense. However, I think it might be possible to provide
something like a table function or other methods to allow users to dynamically
decide which path they want to scan.
There are similar features in DuckDB and Spark:
- DuckDB: `SELECT * FROM read_parquet('file-path/test.parquet')`
- Spark: `spark.read.parquet('xxxx')`
Does DataFusion already have this feature, or did I miss it? If not, I think
it would be a valuable feature for users of object storage.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
