damccorm opened a new issue, #20455: URL: https://github.com/apache/beam/issues/20455
The default limit of a grpc message is set low to 4 MB, and is not overridden in the sdk_worker.py for the _control_channel. This was first discovered when submitting a beam job via a flink operator orchestrated by kubernetes ([https://github.com/GoogleCloudPlatform/flink-on-k8s-operator)](https://github.com/GoogleCloudPlatform/flink-on-k8s-operator). This issue was resolved for apache-beam\==2.18 in BEAM-10334, but exists in apache-beam\==2.22 (and presumably all versions 2.17 onwards). This can be fixed by modifying the options parameter to allow any size grpc message to be sent or received. Imported from Jira [BEAM-10458](https://issues.apache.org/jira/browse/BEAM-10458). Original Jira may contain additional context. Reported by: kshivvy. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
