[
https://issues.apache.org/jira/browse/BEAM-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Niel Markwick updated BEAM-9505:
--------------------------------
Component/s: (was: runner-dataflow)
io-java-gcp
Fix Version/s: 2.21.0
Affects Version/s: 2.20.0
Description:
-When using DataflowRunner in streaming mode. DoFn.StartBundle is called
multiple times for the same bundle.-
-This does not occur with DirectRunner.-
-This breaks DoFn's which require per-bundle setup and teardown procedures.-
When a bundle is empty (such as in streaming if a window is empty), SpannerIO
will report a spurious error message:
{{IllegalStateException: Sorter should be null here}}
was:
When using DataflowRunner in streaming mode. DoFn.StartBundle is called
multiple times for the same bundle.
This does not occur with DirectRunner.
This breaks DoFn's which require per-bundle setup and teardown procedures.
Priority: Minor (was: Major)
Summary: SpannerIO spurious error message with empty bundles
(was: DoFn.StartBundle called multiple times when streaming)
> SpannerIO spurious error message with empty bundles
> ---------------------------------------------------
>
> Key: BEAM-9505
> URL: https://issues.apache.org/jira/browse/BEAM-9505
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.18.0, 2.19.0, 2.20.0
> Reporter: Niel Markwick
> Assignee: Niel Markwick
> Priority: Minor
> Fix For: 2.21.0
>
>
> -When using DataflowRunner in streaming mode. DoFn.StartBundle is called
> multiple times for the same bundle.-
> -This does not occur with DirectRunner.-
> -This breaks DoFn's which require per-bundle setup and teardown procedures.-
> When a bundle is empty (such as in streaming if a window is empty), SpannerIO
> will report a spurious error message:
> {{IllegalStateException: Sorter should be null here}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
