1fanwang commented on PR #39886: URL: https://github.com/apache/beam/pull/39886#issuecomment-6959039322
> Is there a way to just make this all more precise byte tracking and less offline math? Yes. Each client now reports the exact bytes a message adds to the request it sends, the JSON body for REST and the protobuf for gRPC, and the writer cuts batches against the 10 MB limit with those sizes, so the batching does no offline sums. The per-message validator that runs first is unchanged. The PR description has a before and after run. https://github.com/apache/beam/pull/39886/commits/3679c9763e112a6a352812a3be4fc20a52ea0740 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
