Keshav created BEAM-10458:
-----------------------------

             Summary: Message limit for grpc message is set to default 4 MB
                 Key: BEAM-10458
                 URL: https://issues.apache.org/jira/browse/BEAM-10458
             Project: Beam
          Issue Type: Bug
          Components: sdk-py-harness
    Affects Versions: 2.22.0
            Reporter: Keshav
            Assignee: Keshav


The default limit of a grpc message is set low to 4 MB, and is not overridden 
in the sdk_worker.py for the _control_channel. This was first discovered when 
submitting a beam job via a flink operator orchestrated by kubernetes 
([https://github.com/GoogleCloudPlatform/flink-on-k8s-operator)|https://github.com/GoogleCloudPlatform/flink-on-k8s-operator].
 This issue was resolved for apache-beam==2.18 in BEAM-10334, but exists in 
apache-beam==2.22 (and presumably all versions 2.17 onwards). 

 

This can be fixed by modifying the options parameter to allow any size grpc 
message to be sent or received.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to