See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/10682/display/redirect?page=changes>
Changes:
[Steve Niemitz] Fix UpdateSchemaDestination when source format is set to AVRO
[noreply] Add a dataflow override for runnerv1 to still use SDF on runnerv2.
[noreply] [Playground] Result filter bug (#22215)
[noreply] [Website] update case-studies layout (#22342)
------------------------------------------
[...truncated 18.22 KB...]
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :examples:java:processTestResources
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :runners:direct-java:processTestResources NO-SOURCE
> Task :sdks:java:io:hadoop-common:createCheckerFrameworkManifest
> Task :sdks:java:io:hadoop-format:createCheckerFrameworkManifest
> Task :sdks:java:io:common:createCheckerFrameworkManifest
> Task :sdks:java:io:hadoop-format:processResources NO-SOURCE
> Task :examples:java:twitter:createCheckerFrameworkManifest
> Task :sdks:java:io:hadoop-common:processResources NO-SOURCE
> Task :sdks:java:io:common:compileJava NO-SOURCE
> Task :sdks:java:io:jdbc:createCheckerFrameworkManifest
> Task :sdks:java:testing:test-utils:createCheckerFrameworkManifest
> Task :sdks:java:io:common:processResources NO-SOURCE
> Task :sdks:java:io:common:classes UP-TO-DATE
> Task :sdks:java:io:jdbc:processResources NO-SOURCE
> Task :examples:java:twitter:processResources NO-SOURCE
> Task :examples:java:twitter:processTestResources NO-SOURCE
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:io:hadoop-format:processTestResources
> Task :sdks:java:testing:test-utils:processTestResources NO-SOURCE
> Task :runners:spark:3:createCheckerFrameworkManifest
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE
> Task :runners:spark:3:processResources
> Task :runners:spark:3:processTestResources
> Task :sdks:java:io:common:jar
> Task :sdks:java:io:common:processTestResources NO-SOURCE
> Task :runners:spark:2:copyMainJava
> Task :runners:spark:2:createCheckerFrameworkManifest
> Task :runners:spark:2:copyMainResources
> Task :runners:spark:2:processResources
> Task :runners:spark:2:copyTestJava
> Task :runners:spark:2:copyTestResources
> Task :runners:spark:2:processTestResources
> Task :sdks:java:core:generateTestAvroJava
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :sdks:java:core:processTestResources
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :sdks:java:extensions:arrow:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:classes UP-TO-DATE
> Task :sdks:java:extensions:arrow:jar
> Task :runners:local-java:compileJava FROM-CACHE
> Task :runners:local-java:classes UP-TO-DATE
> Task :runners:local-java:jar
> Task :sdks:java:io:common:compileTestJava FROM-CACHE
> Task :sdks:java:io:common:testClasses UP-TO-DATE
> Task :sdks:java:io:common:testJar
> Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE
> Task :sdks:java:io:jdbc:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-common:classes UP-TO-DATE
> Task :sdks:java:io:jdbc:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:io:hadoop-common:jar
> Task :sdks:java:testing:test-utils:compileJava FROM-CACHE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:io:jdbc:jar
> Task :sdks:java:testing:test-utils:jar
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :examples:java:twitter:compileJava FROM-CACHE
> Task :examples:java:twitter:classes UP-TO-DATE
> Task :examples:java:twitter:jar
> Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-format:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE
> Task :sdks:java:io:hadoop-format:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar
> Task :sdks:java:testing:test-utils:testJar
> Task :sdks:java:io:hadoop-format:jar
> Task :sdks:java:extensions:protobuf:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar
> Task :sdks:java:core:compileTestJava FROM-CACHE
> Task :sdks:java:core:testClasses
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:core:shadowTestJar FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :runners:core-java:compileTestJava FROM-CACHE
> Task :runners:core-java:testClasses UP-TO-DATE
> Task :runners:core-java:testJar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:java-job-service:compileJava FROM-CACHE
> Task :runners:java-job-service:classes UP-TO-DATE
> Task :runners:java-job-service:jar
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:compileJava FROM-CACHE
> Task :sdks:java:extensions:ml:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :sdks:java:extensions:ml:jar
> Task :sdks:java:io:kafka:jar
> Task :examples:java:twitter:compileTestJava FROM-CACHE
> Task :examples:java:twitter:testClasses UP-TO-DATE
> Task :examples:java:twitter:testJar
> Task :runners:direct-java:compileTestJava FROM-CACHE
> Task :runners:direct-java:testClasses UP-TO-DATE
> Task :runners:spark:2:compileJava FROM-CACHE
> Task :runners:spark:2:classes
> Task :runners:spark:3:compileJava FROM-CACHE
> Task :runners:spark:3:classes
> Task :runners:spark:2:jar
> Task :runners:spark:3:jar
> Task :runners:direct-java:shadowTestJar FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :runners:spark:3:compileTestJava FROM-CACHE
> Task :runners:spark:3:testClasses
> Task :runners:spark:2:compileTestJava FROM-CACHE
> Task :runners:spark:2:testClasses
> Task :runners:spark:3:testJar
> Task :runners:spark:2:testJar
> Task :sdks:java:io:google-cloud-platform:jar
> Task :examples:java:compileJava FROM-CACHE
> Task :examples:java:classes UP-TO-DATE
> Task :examples:java:jar
> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :sdks:java:io:hadoop-format:compileTestJava FROM-CACHE
> Task :sdks:java:io:hadoop-format:testClasses
> Task :runners:spark:2:validatesRunnerBatch
> Task :runners:spark:3:validatesRunnerBatch
> Task :runners:spark:2:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2830d7d7-2a90-4ebe-a528-eadad0c7e544
> Task :runners:spark:3:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5ed4baeb-adf2-4c10-b967-29c4b8da306d
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-018ecd22-e372-4ade-a0ec-118c92571709
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3d23c1c2-69d4-469b-ab11-d1b990b3228a
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-673d8910-077b-47be-b477-a55a351d6415
> Task :runners:spark:2:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1d084c6e-54bb-49fc-9df9-e42a063f06b8
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-19e09d79-2077-44e2-b403-ec31caa8e244
org.apache.beam.sdk.transforms.ParDoLifecycleTest >
testTeardownCalledAfterExceptionInFinishBundle FAILED
java.lang.RuntimeException at ParDoLifecycleTest.java:227
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-02a232bf-402f-4b34-bff4-1d05f4187dae
278 tests completed, 1 failed, 1 skipped
> Task :runners:spark:2:validatesRunnerBatch FAILED
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-fd901408-8dda-4a1d-acac-880484f1099f
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-49ba1cd4-a704-4468-90a9-c726fec7ab6e
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f78e275f-ebfa-4fd5-8253-38a53d71e9b9
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-292a8a27-8587-426b-952d-665d4d8412f9
> Task :runners:spark:2:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1aeeb26a-03d4-4807-b062-69be4610e9b8
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3cc950af-eccc-468f-b165-e46011e1d2c1
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e64b0df6-fa70-4e65-8329-565754ebf702
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-32990f5f-48d2-44f7-a917-f79b9cebad81
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d8f83d09-d87a-4060-98ae-60b0c913ea33
> Task :runners:spark:3:validatesRunner
> Task :runners:spark:2:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-66e5e59a-eff7-411f-83a3-b1979711daac
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:2:validatesRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/ws/src/runners/spark/2/build/reports/tests/validatesRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
146 actionable tasks: 91 executed, 53 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wua4o6qjlloto
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
