platinumhamburg commented on PR #1702: URL: https://github.com/apache/fluss/pull/1702#issuecomment-3306387725
> Hi @platinumhamburg @polyzos , thank you for sharing your detailed insights. > > * I agree that the full scan should inherit the batch scanner API. > * Regarding the ProtoBuf protocol, I believe implementing [server-side streaming RPC](https://grpc.io/docs/languages/java/basics/#server-side-streaming-rpc) at the tablet server level would be beneficial for full table scan. This would reduce network roundtrips and simplify error handling—for example, the tablet server could close the opened snapshot immediately if any error occurs while sending back records. Hi @xx789633 , thank for advice, streaming RPC indeed provides us with more comfortable streaming read semantics and offers more natural exception handling and cleanup capabilities on Snapshot Pin. And I think Batch RPC also has its advantages. With Batch RPC, we can perform channel multiplexing within a single connection, allowing a single RPC request to serve multiple Table scanners simultaneously, just as we implemented in FetchLog requests. This can significantly reduce connection overhead. Perhaps we can further discuss and evaluate the pros and cons of both approaches. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
