avantgardnerio commented on issue #2025: URL: https://github.com/apache/arrow-datafusion/issues/2025#issuecomment-1229184217
I think @matthewmturner is on to something. The SQL in this issue is straightforward and makes sense from an intuitive user perspective. Why it doesn't work seems like a limitation of DataFusion: 1. Additional TableProviders can be registered in Rust applications (i.e. datafusion-tui or ballista) 2. Files can be registered in SQL dynamically at run time - but for built-in TableProviders only 3. However, there is no dynamic (SQL) way to register a new table with a custom table provider Our use-case is running a Ballista server, with `delta-rs` compiled in, with the intention of allowing users to register tables in locations we can't know at compile time. Unfortunately, I think the way `FileFormat`s work currently doesn't make this possible? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
