Hi Jan, Cool! I hope you're having success using Avatica.
I would call it missing functionality in Avatica itself. IIRC, you'll get bundles of 100 messages that come back in one HTTP response from the Avatica server.
It's been a while since I've looked at state of the art web-tech, but I remember seeing some neat natives built into gRPC that support streaming on top of HTTP/2. I'm not sure how best (in terms of client compatibility) to support streaming results back instead of bundling and sending once a certain size is reached, but it's definitely an area that could be improved! Would love to have a discussion on the matter.
- Josh Jan Van Besien wrote:
Hi, I was looking into Avatica to create a "thin" jdbc client for our existing "thick" jdbc client implemented with calcite. I got something working very quickly, very much similar to what Apache Phoenix has done. However, I immediately notice that there is no streaming between client and server for large result sets. In other words, if I execute a query which results in a large result set, the client has to wait a long time without any feedback and if the result set is large enough the server goes OOM. I am wondering if this functionality is simply missing from Avatica or whether there is some extra work required on my end to make it work. Thanks Jan
