iconara commented on issue #1704: URL: https://github.com/apache/arrow-adbc/issues/1704#issuecomment-4754050382
Thanks for all the references. > There's nothing in the existing API which says that all the data needs to be returned in a single RecordBatch. Can you explain this in more detail? The way I understand things is that a list can't span record batches. Unless I've misunderstood that detail, I don't see how the driver can yield to the client until it has materialized a full catalog. David suggested returning a partial list of schemas and/or tables and then repeating the catalog in the next record batch with a new (potentially partial) list of schemas. That is not something that I would expect to get as a client from reading the API docs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
