See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1959/display/redirect?page=changes>
Changes:
[chamikaramj] Fixing a breakage of multi-lang auto Runner v2 enabling
[noreply] interface{} -> any for registration (#24600)
[noreply] Restrict tox to be in 3.x version (#24601)
[noreply] [Playground] support for Kafka-enabled examples (#24459)
[noreply] Fix some small notebook typos (#24616)
[noreply] initialize and increment metrics properly (#24592)
[noreply] Add schema conversion support from Kafka Connect Record schemas to
Beam
[noreply] interface{} -> any for starcgen (#24618)
[noreply] interface{} -> any for remaining references (#24625)
[noreply] Updating issue-tagger Workflow (#171) (#23143)
[noreply] [GitHub Actions] - Updates in Build Playground Backend to runs-on
[noreply] [GitHub Actions] - Updates in Build Playground Frontend to runs-on
[noreply] [GitHub Actions] - Updates in Go Tests to runs-on Self-hosted runners
[noreply] [GitHub Actions] - Updates in Java Tests to runs-on Self-hosted
runners
[noreply] Updated label_prs workflow (#173) (#23145)
[noreply] [CdapIO] CdapIO and SparkReceiverIO updates (#24436)
[noreply] Revert "[GitHub Actions] - Updates in Java Tests to runs-on
Self-hosted
[noreply] Disallow sliding windows with combiner fanout to prevent data loss
------------------------------------------
[...truncated 533.76 KB...]
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.4/commons-lang-2.4.jar
(262 kB at 689 kB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/codehaus/groovy/groovy/2.0.1/groovy-2.0.1.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.8.1/commons-lang3-3.8.1.jar
(502 kB at 1.3 MB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/antlr/antlr/2.7.7/antlr-2.7.7.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar
(588 kB at 1.5 MB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm-tree/4.0/asm-tree-4.0.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-script-interpreter/1.2/maven-script-interpreter-1.2.jar
(22 kB at 54 kB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm-commons/4.0/asm-commons-4.0.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/com/ibm/icu/icu4j/70.1/icu4j-70.1.jar (14
MB at 32 MB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm/4.0/asm-4.0.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/antlr/antlr/2.7.7/antlr-2.7.7.jar (445 kB
at 1.0 MB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm-util/4.0/asm-util-4.0.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm-tree/4.0/asm-tree-4.0.jar
(22 kB at 51 kB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm-analysis/4.0/asm-analysis-4.0.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm-commons/4.0/asm-commons-4.0.jar
(38 kB at 87 kB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm/4.0/asm-4.0.jar (46 kB at
102 kB/s)
[INFO] Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/ant/ant/1.8.1/ant-1.8.1.jar
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm-util/4.0/asm-util-4.0.jar
(37 kB at 81 kB/s)
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/ow2/asm/asm-analysis/4.0/asm-analysis-4.0.jar
(20 kB at 43 kB/s)
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar (282
kB at 602 kB/s)
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/ant/ant/1.8.1/ant-1.8.1.jar
(1.5 MB at 3.0 MB/s)
[INFO] Downloaded from central:
https://repo.maven.apache.org/maven2/org/codehaus/groovy/groovy/2.0.1/groovy-2.0.1.jar
(3.3 MB at 5.7 MB/s)
[INFO] Generating project in Batch mode
[INFO] Archetype repository not defined. Using the one from
[org.apache.beam:beam-sdks-java-maven-archetypes-examples:2.24.0] found in
catalog remote
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.45.0-SNAPSHOT/maven-metadata.xml
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.45.0-SNAPSHOT/maven-metadata.xml
(1.7 kB at 3.3 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.45.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.45.0-20221209.224853-9.pom
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.45.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.45.0-20221209.224853-9.pom
(4.1 kB at 17 kB/s)
[INFO] Downloading from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.45.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.45.0-20221209.224853-9.jar
[INFO] Downloaded from test.release:
https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.45.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.45.0-20221209.224853-9.jar
(243 kB at 346 kB/s)
[INFO]
----------------------------------------------------------------------------
[INFO] Using following parameters for creating project from Archetype:
beam-sdks-java-maven-archetypes-examples:2.45.0-SNAPSHOT
[INFO]
----------------------------------------------------------------------------
[INFO] Parameter: groupId, Value: org.example
[INFO] Parameter: artifactId, Value: word-count-beam
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: package, Value: org.apache.beam.examples
[INFO] Parameter: packageInPathFormat, Value: org/apache/beam/examples
[INFO] Parameter: package, Value: org.apache.beam.examples
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: groupId, Value: org.example
[INFO] Parameter: targetPlatform, Value: 1.8
[INFO] Parameter: artifactId, Value: word-count-beam
[INFO] Project created from Archetype in dir:
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 8.819 s
[INFO] Finished at: 2022-12-10T05:22:03Z
[INFO] ------------------------------------------------------------------------
Verified [INFO] BUILD SUCCESS
cd word-count-beam
ls
pom.xml
src
Verified pom.xml
Verified src
ls src/main/java/org/apache/beam/examples/
common
complete
DebuggingWordCount.java
KafkaWordCountAvro.java
KafkaWordCountJson.java
MinimalWordCount.java
multilanguage
subprocess
WindowedWordCount.java
WordCount.java
Verified WordCount.java
ls src/main/java/org/apache/beam/examples/complete/game/
GameStats.java
HourlyTeamScore.java
injector
LeaderBoard.java
StatefulTeamScore.java
UserScore.java
utils
Verified UserScore.java
**************************************
* Test: Runs the WordCount Code with Dataflow runner
**************************************
gsutil rm
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/count*
|| echo 'No files'
CommandException: No URLs matched:
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/count*
No files
mvn compile exec:java -q -Dmaven.wagon.http.retryHandler.class=default
-Dmaven.wagon.http.retryHandler.count=5 -Dmaven.wagon.http.pool=false
-Dmaven.wagon.httpconnectionManager.ttlSeconds=120
-Dhttp.keepAlive=false
-Dexec.mainClass=org.apache.beam.examples.WordCount
-Dexec.args="--runner=DataflowRunner
--project=apache-beam-testing --region=us-central1
--gcpTempLocation=gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp
--output=gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/counts
--inputFile=gs://apache-beam-samples/shakespeare/*"
-Pdataflow-runner
Using maven /home/jenkins/tools/maven/apache-maven-3.5.4
[ERROR] COMPILATION ERROR :
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[49,36]
package org.apache.beam.sdk.io.kafka does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[59,31]
package org.apache.kafka.common does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[60,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[61,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[49,36]
package org.apache.beam.sdk.io.kafka does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[59,31]
package org.apache.kafka.common does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[60,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[61,45]
package org.apache.kafka.common.serialization does not exist
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.7.0:compile (default-compile)
on project word-count-beam: Compilation failure: Compilation failure:
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[49,36]
package org.apache.beam.sdk.io.kafka does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[59,31]
package org.apache.kafka.common does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[60,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[61,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[49,36]
package org.apache.beam.sdk.io.kafka does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[59,31]
package org.apache.kafka.common does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[60,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[61,45]
package org.apache.kafka.common.serialization does not exist
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] COMPILATION ERROR :
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[49,36]
package org.apache.beam.sdk.io.kafka does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[59,31]
package org.apache.kafka.common does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[60,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[61,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[49,36]
package org.apache.beam.sdk.io.kafka does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[59,31]
package org.apache.kafka.common does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[60,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[61,45]
package org.apache.kafka.common.serialization does not exist
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.7.0:compile (default-compile)
on project word-count-beam: Compilation failure: Compilation failure:
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[49,36]
package org.apache.beam.sdk.io.kafka does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[59,31]
package org.apache.kafka.common does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[60,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java:[61,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[49,36]
package org.apache.beam.sdk.io.kafka does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[59,31]
package org.apache.kafka.common does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[60,45]
package org.apache.kafka.common.serialization does not exist
[ERROR]
/tmp/groovy-generated-8655719562703339509-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java:[61,45]
package org.apache.kafka.common.serialization does not exist
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] Failed command
> Task :runners:google-cloud-dataflow-java:runQuickstartJavaDataflow FAILED
FAILURE: Build completed with 8 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:3:runQuickstartJavaSpark'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:flink:1.13:runQuickstartJavaFlinkLocal'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:twister2:runQuickstartJavaTwister2'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
6: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:direct-java:runQuickstartJavaDirect'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
7: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflowBom'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
8: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runQuickstartJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 22m 30s
19 actionable tasks: 12 executed, 5 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/cxquy5ete7xdi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
