[ 
https://issues.apache.org/jira/browse/BEAM-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396837#comment-17396837
 ] 

Robert Burke commented on BEAM-12636:
-------------------------------------

There were a handful of bugs with windowing that were fixed in this PR: 
[https://github.com/apache/beam/pull/14966] and they should be included in 
2.32.0.  (https://issues.apache.org/jira/browse/BEAM-11086  was the JIRA). 
Unfortunately, that PR didn't make the 2.31 cut (on Jun 2nd).



The Go SDK at those versions is considered experimental. Though we expect 
2.33.0 to remove the experimental designation. So until recently Windowing 
wasn't receiving much attention at all, so earlier SDK versions will be buggy 
with respect to it.

Finally, my usual Disclaimer that Dataflow doesn't support use of the Go SDK. 
More information on the error would be useful however to validate it would have 
been fixed.

 

> Windowing transform not working for sdk-go on Dataflow?
> -------------------------------------------------------
>
>                 Key: BEAM-12636
>                 URL: https://issues.apache.org/jira/browse/BEAM-12636
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow, sdk-go
>    Affects Versions: 2.31.0
>            Reporter: Claudio Prates
>            Priority: P3
>
> Hi, I'm trying to run the example 
> [windowed_wordcount|https://github.com/apache/beam/blob/master/sdks/go/examples/windowed_wordcount/windowed_wordcount.go]
>  on Dataflow but it doesn't seems to be working.
> When I try to run it, the only error I get from the logs in Dataflow is 
> "Error processing pipeline". When I change the example to not use windowing 
> all works fine.
> The version of the SDK I'm using is 2.31.0. Tried up to 2.26.0 and all have 
> the same behaviour.
> And I'm running the example with
> {code:java}
> go run main.go --runner=dataflow --region=europe-west1 --project=<project> 
> --staging_location=gs://bucket/path --temp_location=gs://bucket/path 
> --max_num_workers=1
> {code}
> Also tried the with
> {code:java}
> go run main.go --runner=dataflow --region=europe-west1 --project=<project> 
> --staging_location=gs://bucket/path --temp_location=gs://bucket/path 
> --max_num_workers=1 -worker_harness_container_image=apache/beam_go_sdk:latest 
> --experiments=use_runner_v2
> {code}
> Is this actually a bug or am I make some mistake running the example?
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to