See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/10416/display/redirect?page=changes>
Changes:
[dannymccormick] Update dashboards to use gh data instead of jira data
[noreply] Merge pull request #21746: Exclude GCP Java packages from Dependabot
[noreply] Update
.test-infra/metrics/grafana/dashboards/source_data_freshness.json
[noreply] Better cross langauge support for dataframe reads. (#21762)
[noreply] Add template_location flag to Go Dataflow runner (#21774)
[noreply] [BEAM-14406] Drain test for SDF truncation in Go SDK (#17814)
[noreply] More Jira -> Issues doc updates (#21770)
[noreply] [BEAM-11104] Add code snippet for Go SDK Self-Checkpointing (#17956)
------------------------------------------
[...truncated 19.11 KB...]
> Task :model:fn-execution:processResources
> Task :sdks:java:io:hadoop-common:processResources NO-SOURCE
> Task :sdks:java:io:hadoop-format:processResources NO-SOURCE
> Task :examples:java:twitter:createCheckerFrameworkManifest
> Task :sdks:java:io:jdbc:createCheckerFrameworkManifest
> Task :sdks:java:testing:test-utils:createCheckerFrameworkManifest
> Task :runners:spark:3:createCheckerFrameworkManifest
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :sdks:java:io:common:createCheckerFrameworkManifest
> Task :sdks:java:io:hadoop-format:processTestResources
> Task :examples:java:twitter:processResources NO-SOURCE
> Task :sdks:java:io:jdbc:processResources NO-SOURCE
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:io:common:compileJava NO-SOURCE
> Task :examples:java:twitter:processTestResources NO-SOURCE
> Task :sdks:java:testing:test-utils:processTestResources NO-SOURCE
> Task :sdks:java:io:common:processResources NO-SOURCE
> Task :runners:spark:3:processResources
> Task :sdks:java:io:common:classes UP-TO-DATE
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE
> Task :runners:spark:3:processTestResources
> Task :sdks:java:io:common:jar
> Task :sdks:java:io:common:processTestResources NO-SOURCE
> Task :runners:spark:2:copyMainJava
> Task :runners:spark:2:createCheckerFrameworkManifest
> Task :runners:spark:2:copyMainResources
> Task :runners:spark:2:processResources
> Task :runners:spark:2:copyTestJava
> Task :runners:spark:2:copyTestResources
> Task :runners:spark:2:processTestResources
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :sdks:java:core:generateTestAvroJava
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :sdks:java:core:processTestResources
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:job-management:extractIncludeProto
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :runners:local-java:compileJava FROM-CACHE
> Task :runners:local-java:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava FROM-CACHE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :runners:local-java:jar
> Task :sdks:java:testing:test-utils:jar
> Task :sdks:java:extensions:arrow:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE
> Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE
> Task :sdks:java:testing:test-utils:testJar
> Task :sdks:java:extensions:arrow:jar
> Task :sdks:java:io:jdbc:compileJava FROM-CACHE
> Task :sdks:java:io:jdbc:classes UP-TO-DATE
> Task :sdks:java:io:jdbc:jar
> Task :sdks:java:io:common:compileTestJava FROM-CACHE
> Task :sdks:java:io:common:testClasses UP-TO-DATE
> Task :sdks:java:io:common:testJar
> Task :examples:java:twitter:compileJava FROM-CACHE
> Task :examples:java:twitter:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :examples:java:twitter:jar
> Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-common:classes UP-TO-DATE
> Task :sdks:java:io:hadoop-common:jar
> Task :sdks:java:fn-execution:jar
> Task :sdks:java:io:hadoop-format:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-format:classes UP-TO-DATE
> Task :sdks:java:io:hadoop-format:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar
> Task :runners:core-java:jar
> Task :sdks:java:core:compileTestJava FROM-CACHE
> Task :sdks:java:core:testClasses
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:core:shadowTestJar FROM-CACHE
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :runners:java-job-service:compileJava FROM-CACHE
> Task :runners:java-job-service:classes UP-TO-DATE
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:java-job-service:jar
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:compileJava FROM-CACHE
> Task :sdks:java:extensions:ml:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:jar
> Task :runners:core-java:compileTestJava FROM-CACHE
> Task :runners:core-java:testClasses UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :runners:core-java:testJar
> Task :runners:spark:2:compileJava FROM-CACHE
> Task :runners:spark:2:classes
> Task :runners:spark:3:compileJava FROM-CACHE
> Task :runners:spark:3:classes
> Task :examples:java:twitter:compileTestJava FROM-CACHE
> Task :examples:java:twitter:testClasses UP-TO-DATE
> Task :examples:java:twitter:testJar
> Task :runners:direct-java:compileTestJava FROM-CACHE
> Task :runners:direct-java:testClasses UP-TO-DATE
> Task :runners:spark:2:jar
> Task :runners:spark:3:jar
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :runners:spark:2:compileTestJava FROM-CACHE
> Task :runners:spark:2:testClasses
> Task :runners:spark:3:compileTestJava FROM-CACHE
> Task :runners:spark:3:testClasses
> Task :runners:direct-java:shadowTestJar FROM-CACHE
> Task :runners:spark:3:testJar
> Task :runners:spark:2:testJar
> Task :sdks:java:io:google-cloud-platform:jar
> Task :examples:java:compileJava FROM-CACHE
> Task :examples:java:classes UP-TO-DATE
> Task :examples:java:jar
> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :sdks:java:io:hadoop-format:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :sdks:java:io:hadoop-format:testClasses
> Task :runners:spark:2:validatesRunnerBatch
> Task :runners:spark:3:validatesRunnerBatch
> Task :runners:spark:2:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-88346082-d403-4b38-a7bd-c6961f681da0
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-156af433-92f4-4ba9-a63b-d5449c191fd6
> Task :runners:spark:3:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ce44e7d8-e0ab-492a-8634-62af4d6af466
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c3d8efd3-566e-4593-a7e6-323f7d9a49b6
> Task :runners:spark:2:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-512451c9-cb72-42d2-892c-2612301d77ca
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2c547380-e381-4a96-ad66-68af7e3e1c17
> Task :runners:spark:3:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-adb365e3-3931-43a8-a108-016a1ce5a4c6
org.apache.beam.sdk.transforms.ParDoLifecycleTest >
testTeardownCalledAfterExceptionInProcessElement FAILED
java.lang.RuntimeException at ParDoLifecycleTest.java:211
> Task :runners:spark:2:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b9696fe9-6801-44b8-ada1-1e25e9bb35dc
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-11effa52-4e8d-42a6-bc4c-f347163998e1
> Task :runners:spark:3:validatesRunnerBatch FAILED
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-eef087d7-3f58-411b-a5f5-be89151f01f2
278 tests completed, 1 failed, 1 skipped
> Task :runners:spark:2:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a8037083-aaa6-41a7-bdc2-9b164a3094e3
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-45cc7848-c2c0-4b78-b133-ff2e922279e4
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f63107c6-e2b4-464e-9c38-d096d5aae3b4
> Task :runners:spark:2:validatesRunner
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2f6f7c94-8ecf-4bb6-a824-c5d6fa76b589
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-13bb25ea-7a9d-4e82-8932-9a1785213b1d
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-01c29fbd-7206-4618-b2fe-3c9e0bb8eb76
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-41c3fe16-ed47-4b8c-a411-c8d6e475c373
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a28e9451-79a5-46c6-b237-7064c789214e
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:validatesRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/ws/src/runners/spark/3/build/reports/tests/validatesRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 31s
146 actionable tasks: 92 executed, 52 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tfzr4dmafst62
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]