[
https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001616#comment-17001616
]
Chamikara Madhusanka Jayalath commented on BEAM-9005:
-----------------------------------------------------
Regarding Flink and Spark VR failures, this seems to be due to environment ID
not being set for some of the ParDo transforms in the generated runner API
proto.
I set the environment ID here:
[https://github.com/apache/beam/blob/master/sdks/go/pkg/beam/core/runtime/graphx/translate.go#L272]
But I think there are other locations where Go SDK generates ParDo transforms
that does not go through this location during translation. Due to this
Spark/Flink fails since some ParDos do not have environment set.
[~lostluck] and [~danoliveira] any idea ? Is there any location where Go SDK
generates ParDos. I suspect COGBK but not sure.
> Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183
> -----------------------------------------------------------------------------
>
> Key: BEAM-9005
> URL: https://issues.apache.org/jira/browse/BEAM-9005
> Project: Beam
> Issue Type: Bug
> Components: sdk-go
> Reporter: Chamikara Madhusanka Jayalath
> Assignee: Chamikara Madhusanka Jayalath
> Priority: Critical
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Looking into this.
>
> cc: [~bhulette] [~lostluck] [~danoliveira]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
