[
https://issues.apache.org/jira/browse/BEAM-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103108#comment-17103108
]
sailaxmankumar commented on BEAM-9505:
--------------------------------------
could you please suggest if there is any workaround to use version >2.17?
currently our streaming pipeline in dataflow seems to logging a lot of errors
and slowing down the processing. !Worker error log count.png!
> SpannerIO spurious error message with empty bundles
> ---------------------------------------------------
>
> Key: BEAM-9505
> URL: https://issues.apache.org/jira/browse/BEAM-9505
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.18.0, 2.19.0, 2.20.0
> Reporter: Niel Markwick
> Assignee: Niel Markwick
> Priority: Minor
> Attachments: Worker error log count.png
>
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> -When using DataflowRunner in streaming mode. DoFn.StartBundle is called
> multiple times for the same bundle.-
> -This does not occur with DirectRunner.-
> -This breaks DoFn's which require per-bundle setup and teardown procedures.-
> When a bundle is empty (such as in streaming if a window is empty), SpannerIO
> will report a spurious error message:
> {{IllegalStateException: Sorter should be null here}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
