[
https://issues.apache.org/jira/browse/BEAM-11375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241761#comment-17241761
]
Kyle Weaver edited comment on BEAM-11375 at 12/1/20, 6:38 PM:
--------------------------------------------------------------
I was able to reproduce this locally. I think the cause is a recent Kafka
upgrade
(https://github.com/apache/beam/commit/d1ff41dba9507c7b279b4b5a5ae0e4f25712dd86).
$ ./gradlew :runners:spark:validatesRunnerBatch --info
20/12/01 10:16:16 ERROR kafka.server.KafkaServer: Fatal error during
KafkaServer startup. Prepare to shutdown
java.lang.NoSuchMethodError:
org.apache.kafka.common.security.JaasUtils.isZkSecurityEnabled()Z
at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:384)
at kafka.server.KafkaServer.startup(KafkaServer.scala:207)
at
kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44)
at
org.apache.beam.runners.spark.translation.streaming.utils.EmbeddedKafkaCluster.startBroker(EmbeddedKafkaCluster.java:128)
at
org.apache.beam.runners.spark.translation.streaming.utils.EmbeddedKafkaCluster.startup(EmbeddedKafkaCluster.java:119)
at
org.apache.beam.runners.spark.translation.streaming.ResumeFromCheckpointStreamingTest.setup(ResumeFromCheckpointStreamingTest.java:121)
was (Author: ibzib):
I was able to reproduce this locally and I think the cause is a recent Kafka
upgrade
(https://github.com/apache/beam/commit/d1ff41dba9507c7b279b4b5a5ae0e4f25712dd86).
$ ./gradlew :runners:spark:validatesRunnerBatch --info
20/12/01 10:16:16 ERROR kafka.server.KafkaServer: Fatal error during
KafkaServer startup. Prepare to shutdown
java.lang.NoSuchMethodError:
org.apache.kafka.common.security.JaasUtils.isZkSecurityEnabled()Z
at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:384)
at kafka.server.KafkaServer.startup(KafkaServer.scala:207)
at
kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44)
at
org.apache.beam.runners.spark.translation.streaming.utils.EmbeddedKafkaCluster.startBroker(EmbeddedKafkaCluster.java:128)
at
org.apache.beam.runners.spark.translation.streaming.utils.EmbeddedKafkaCluster.startup(EmbeddedKafkaCluster.java:119)
at
org.apache.beam.runners.spark.translation.streaming.ResumeFromCheckpointStreamingTest.setup(ResumeFromCheckpointStreamingTest.java:121)
> Java & Spark postcommits failing.
> ---------------------------------
>
> Key: BEAM-11375
> URL: https://issues.apache.org/jira/browse/BEAM-11375
> Project: Beam
> Issue Type: Bug
> Components: runner-spark, test-failures
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: P1
>
> Both beam_PostCommit_Java and beam_PostCommit_Java_ValidatesRunner_Spark are
> failing with error:
> 04:15:13 FAILURE: Build failed with an exception.
> 04:15:13
> 04:15:13 * What went wrong:
> 04:15:13 Execution failed for task ':runners:spark:validatesRunnerBatch'.
> 04:15:13 > Process 'Gradle Test Executor 364' finished with non-zero exit
> value 1
> 04:15:13 This problem might be caused by incorrect test process
> configuration.
> 04:15:13 Please refer to the test execution section in the User Manual at
> https://docs.gradle.org/6.7/userguide/java_testing.html#sec:test_execution
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
