[
https://issues.apache.org/jira/browse/BEAM-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177144#comment-17177144
]
Brian Hulette commented on BEAM-10663:
--------------------------------------
Note there were two issues introduced in
https://github.com/apache/beam/pull/11749 discussed this JIRA:
- An issue with schema inference. Boyuan mitigated this in
https://github.com/apache/beam/pull/12518
- Now that xlang Kafka uses SDF/bundle finalization it cannot be run on Flink.
This is the reason the test is still disabled. 2.23.0 users were able to use
xlang Kafka on Flink, so I would argue this is a regression. I think we should
consider rolling back https://github.com/apache/beam/pull/11749 for 2.24.0. The
fix in https://github.com/apache/beam/pull/12561 looks like it only addresses
Dataflow.
> Python postcommit fails after BEAM-9977 #11749 merge
> ----------------------------------------------------
>
> Key: BEAM-10663
> URL: https://issues.apache.org/jira/browse/BEAM-10663
> Project: Beam
> Issue Type: Bug
> Components: cross-language, io-py-kafka, test-failures
> Affects Versions: 2.24.0
> Reporter: Piotr Szuberski
> Assignee: Boyuan Zhang
> Priority: P0
> Fix For: 2.24.0
>
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> Python postcommits fail on CrossLanguageKafkaIO python tests after #11749
> (BEAM-9977) merge.
>
> Fragment of stackstrace:
> ```
> {{Caused by: java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: Error received from SDK harness for instruction
> 2: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Could
> not find a way to create AutoValue class class
> org.apache.beam.sdk.io.kafka.KafkaSourceDescriptor
> at
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> at
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> at
> org.apache.beam.sdk.fn.data.CompletableFutureInboundDataClient.awaitCompletion(CompletableFutureInboundDataClient.java:48)
> at
> org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:91)
> at
> org.apache.beam.fn.harness.BeamFnDataReadRunner.blockTillReadFinishes(BeamFnDataReadRunner.java:342)
> at
> org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:108)
> at
> org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:302)
> at
> org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
> at
> org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)}}
> ```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
