emkornfield commented on pull request #9368: URL: https://github.com/apache/arrow/pull/9368#issuecomment-776084026
> Thinking about this a bit more I think an alternative to a lot of the metadata querying is to define a minimal sql table schema and querying capabilities for it. I'll expand more in a little bit I did a rough sketch on how the metadata layer could be modeled as pseudo-columns as comments on the proto. I think this addresses some uneasiner I had with the existing model: 1. It uses one consistent data model for tabular data (the arrow model). 2. It makes query semantics clearer instead of trying to model them in an ad-hoc manner through protobufs This comes at slightly more complex for server implementations. And potential confusion on limitations for specific tables. This might be limited to some extend if we had a different GetMetadata action so implementations know to expect a query to specific pseudo-table. I expect we would provide library wrappers over JDBC to also ease implementation. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
