Re: [I] Dynamic schema for custom TableProvider [datafusion]

2024-05-28 Thread via GitHub
maronavenue closed issue #10559: Dynamic schema for custom TableProvider URL: https://github.com/apache/datafusion/issues/10559 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] Dynamic schema for custom TableProvider [datafusion]

2024-05-28 Thread via GitHub
maronavenue commented on issue #10559: URL: https://github.com/apache/datafusion/issues/10559#issuecomment-2135474005 Thanks @alamb. I think what you proposed in your example is something we could leverage. We essentially needed a way to register tables dynamically based on what the user re

Re: [I] Dynamic schema for custom TableProvider [datafusion]

2024-05-23 Thread via GitHub
alamb commented on issue #10559: URL: https://github.com/apache/datafusion/issues/10559#issuecomment-2127695450 > @alamb - Thanks for responding. This sounds interesting. Could you elaborate on how this can be achieved? > What information gets passed down to SchemaProvider that I can

Re: [I] Dynamic schema for custom TableProvider [datafusion]

2024-05-22 Thread via GitHub
maronavenue commented on issue #10559: URL: https://github.com/apache/datafusion/issues/10559#issuecomment-2124316836 @alamb - Thanks for responding. This sounds interesting. Could you elaborate on how this can be achieved? - What information gets passed down to `SchemaProvider` that I ca

Re: [I] Dynamic schema for custom TableProvider [datafusion]

2024-05-19 Thread via GitHub
alamb commented on issue #10559: URL: https://github.com/apache/datafusion/issues/10559#issuecomment-2119371654 > how can we make the schema generic as well so users can select any fields from all tables the said API has? One way you might be able to do this would be creating a Schem

[I] Dynamic schema for custom TableProvider [datafusion]

2024-05-17 Thread via GitHub
maronavenue opened a new issue, #10559: URL: https://github.com/apache/datafusion/issues/10559 ### Is your feature request related to a problem or challenge? Hi team, We have been exploring DataFusion to provide unified access to all our various data sources. For cases where we