[
https://issues.apache.org/jira/browse/BEAM-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17490517#comment-17490517
]
Robert Burke commented on BEAM-13921:
-------------------------------------
It looks like Spark doesn't support the brand of Side Inputs that the Java
Debezium transform uses. Solution is to disable this test for spark runs in
integration.go
```
2022/02/10 00:41:02 Staged binary artifact with token:
2022/02/10 00:41:05 Submitted job:
go0testdebeziumio0basicread-jenkins-0210004103-20d7da84_8514b2ee-f44a-44fa-be4e-0b5ff3a0a59c
2022/02/10 00:41:05 Job state: STOPPED
2022/02/10 00:41:05 Job state: STARTING
2022/02/10 00:41:05 Job state: RUNNING
2022/02/10 00:41:19 (): java.lang.UnsupportedOperationException: Side inputs
to executable stage are currently unsupported.
at
org.apache.beam.runners.spark.translation.SparkStreamingPortablePipelineTranslator.translateExecutableStage(SparkStreamingPortablePipelineTranslator.java:242)
at
org.apache.beam.runners.spark.translation.SparkStreamingPortablePipelineTranslator.translate(SparkStreamingPortablePipelineTranslator.java:127)
at
org.apache.beam.runners.spark.translation.SparkStreamingPortablePipelineTranslator.translate(SparkStreamingPortablePipelineTranslator.java:72)
at
org.apache.beam.runners.spark.SparkPipelineRunner.lambda$run$1(SparkPipelineRunner.java:167)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022/02/10 00:41:19 (): java.lang.UnsupportedOperationException: Side inputs
to executable stage are currently unsupported.
2022/02/10 00:41:19 Job state: FAILED
ptest.go:101: Failed to execute job: job
go0testdebeziumio0basicread-jenkins-0210004103-20d7da84_8514b2ee-f44a-44fa-be4e-0b5ff3a0a59c
failed
--- FAIL: TestDebeziumIO_BasicRead (93.69s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium
93.784s
```
> validatesCrossLanguageRunnerGoUsingJava failing for beam_PostCommit_XVR_Spark
> ------------------------------------------------------------------------------
>
> Key: BEAM-13921
> URL: https://issues.apache.org/jira/browse/BEAM-13921
> Project: Beam
> Issue Type: Bug
> Components: cross-language, test-failures
> Reporter: Chamikara Madhusanka Jayalath
> Assignee: Ritesh Ghorse
> Priority: P1
>
> For example,
> https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3349/console
> https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3350/console
> https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3351/console
> Ritesh, is this related to recent Go wrapper updates ?
> cc: [~lostluck]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
