Robert Burke created BEAM-10110:
-----------------------------------

             Summary: Populate pipeline_proto_coder_id field for dataflow.
                 Key: BEAM-10110
                 URL: https://issues.apache.org/jira/browse/BEAM-10110
             Project: Beam
          Issue Type: Task
          Components: runner-dataflow, sdk-go
            Reporter: Robert Burke
            Assignee: Robert Burke


Dataflow isn't natively translating from the Beam Pipeline Proto yet, but 
requires SDKs to translate the graph into it's own format. Adding this hint for 
custom coders (Coders  not known to Dataflow/Beam) avoids having dataflow 
re-synthesize coders from it's format, back to the pipeline proto.

Currently there's the awkward restriction on which coders should receive the 
ID, rather than having the SDK apply the field to all of them, but this is a 
good first step to get there. This restriction may be lifted on a subsequent 
dataflow release. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to