damccorm opened a new issue, #19744: URL: https://github.com/apache/beam/issues/19744
In the PubSubIO, the default max batch size is set to `10 * 1024 * 1024` bytes. This however does not take into account the size increase of base64 encoding the messages after the flush. Base64 encodes each set of three bytes into four bytes. Therefore the 'true' size limit placed on the unencoded batch should be x = ((10 * 1024 * 1024) / 4) * 3 = 7864320 bytes Imported from Jira [BEAM-8145](https://issues.apache.org/jira/browse/BEAM-8145). Original Jira may contain additional context. Reported by: Primevenn. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
