platinumhamburg commented on PR #1702: URL: https://github.com/apache/fluss/pull/1702#issuecomment-3306468808
> For a periodic poll of a small table (every 1-5 seconds and 5 columns tops), what approach do you think makes? I'm more inclined towards batch RPC, and I thought this approach with periodic polls makes sense since most of users find websockets and SSE way more intimidating. > > However, if we want to consider large tables as well - although I think we should also identify the use cases first - a streaming approach indeed makes sense there. In this scenario, I tend to favor implementing the server-side protocol based on Batch RPC. We would create a Snapshot and retrieve the snapshot data through one or multiple pollBatch requests. The streaming read semantics can be provided to users by the client side in the form of an Iterator, but we don't necessarily have to implement it at the RPC layer. Under this pattern, full scans for both large and small tables are unified - for small tables, a single scan can return all data, while for large tables, multiple scans can be performed as needed. Therefore, the small table scenario naturally becomes a special case of the large table scenario. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
