[
https://issues.apache.org/jira/browse/BEAM-12085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17406442#comment-17406442
]
Beam JIRA Bot commented on BEAM-12085:
--------------------------------------
This issue was marked "stale-P2" and has not received a public comment in 14
days. It is now automatically moved to P3. If you are still affected by it, you
can comment and move it back to P2.
> PubsubLiteIO.read() fails in DataflowRunner v1 due to lack of BundleFinalizer
> support
> -------------------------------------------------------------------------------------
>
> Key: BEAM-12085
> URL: https://issues.apache.org/jira/browse/BEAM-12085
> Project: Beam
> Issue Type: New Feature
> Components: extensions-java-gcp
> Affects Versions: 2.28.0
> Reporter: Tianzi Cai
> Priority: P3
> Labels: PubsubLiteIO, dataflow
>
> Reading from a Pub/Sub Lite subscription using PubsubLiteIO fails with
> DataflowRunner. It works in DirectRunner.
> {code:java}
> import org.apache.beam.sdk.io.gcp.pubsublite.PubsubLiteIO;
> //..
> pipeline
> .apply("Read From Lite", PubsubLiteIO.read(subscriberOpitons))
> .apply("Convert and print",
> MapElements.into(TypeDescriptors.strings()).via(
> (SequencedMessage sequencedMessage) -> {
> String data =
> sequencedMessage.getMessage().getData().toStringUtf8();
> LOG.info("Received: " + data);
> return data;
> }
> ));
> {code}
> {noformat}
> java.lang.UnsupportedOperationException: BundleFinalizer unsupported by
> non-portable Dataflow.
> at
> org.apache.beam.runners.dataflow.worker.SplittableProcessFnFactory$SplittableDoFnRunnerFactory.lambda$createRunner$2(SplittableProcessFnFactory.java:170)
> at
> org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.OutputAndTimeBoundedSplittableProcessElementInvoker$1.bundleFinalizer(OutputAndTimeBoundedSplittableProcessElementInvoker.java:195)
> at
> org.apache.beam.sdk.io.gcp.pubsublite.PerSubscriptionPartitionSdf$DoFnInvoker.invokeProcessElement(Unknown
> Source)
> at
> org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.OutputAndTimeBoundedSplittableProcessElementInvoker.invokeProcessElement(OutputAndTimeBoundedSplittableProcessElementInvoker.java:123)
> at
> org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SplittableParDoViaKeyedWorkItems$ProcessFn.processElement(SplittableParDoViaKeyedWorkItems.java:523)
> {noformat}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
