[ 
https://issues.apache.org/jira/browse/BEAM-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16669402#comment-16669402
 ] 

Douglas Browne commented on BEAM-4124:
--------------------------------------

[~lostluck] I share the sentiment that we should probably be relying on gRPC to 
impose these transport limitations. My team is currently trying to get a Beam 
Go pipeline operational which regularly works with protos on the order of 20MB, 
nothing too crazy, but certainly larger than 4MB. Are you willing to take 
ownership of this issue and help lift the non-configurable limits? If not, how 
do you recommend we proceed given that we have a strong need to use Beam Go for 
our application in the near future?

> Support elements larger than 4 MB
> ---------------------------------
>
>                 Key: BEAM-4124
>                 URL: https://issues.apache.org/jira/browse/BEAM-4124
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-go
>            Reporter: Cody Schroeder
>            Priority: Major
>
> The Go SDK harness is limited by a gRPC message size limit of 4 MB.
> https://github.com/apache/beam/blob/4a32353/sdks/go/pkg/beam/core/runtime/harness/datamgr.go#L31



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to