See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/10797/display/redirect?page=changes>
Changes:
[Moritz Mack] Annotate stateful VR test in TestStreamTest with UsesStatefulParDo
[Moritz Mack] Properly close Spark (streaming) context if Pipeline translation
fails
[noreply] [Playground] [Backend] Datastore queries and mappers to get
precompiled
------------------------------------------
[...truncated 18.47 KB...]
> Task :examples:java:processTestResources
> Task :sdks:java:io:hadoop-format:createCheckerFrameworkManifest
> Task :runners:local-java:processResources NO-SOURCE
> Task :sdks:java:io:hadoop-common:processResources NO-SOURCE
> Task :sdks:java:io:hadoop-format:processResources NO-SOURCE
> Task :runners:direct-java:processResources NO-SOURCE
> Task :runners:direct-java:processTestResources NO-SOURCE
> Task :sdks:java:io:jdbc:createCheckerFrameworkManifest
> Task :examples:java:twitter:createCheckerFrameworkManifest
> Task :sdks:java:testing:test-utils:createCheckerFrameworkManifest
> Task :sdks:java:io:common:createCheckerFrameworkManifest
> Task :examples:java:twitter:processResources NO-SOURCE
> Task :sdks:java:io:jdbc:processResources NO-SOURCE
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:io:hadoop-format:processTestResources
> Task :examples:java:twitter:processTestResources NO-SOURCE
> Task :sdks:java:testing:test-utils:processTestResources NO-SOURCE
> Task :sdks:java:io:common:compileJava NO-SOURCE
> Task :sdks:java:io:common:processResources NO-SOURCE
> Task :runners:spark:3:createCheckerFrameworkManifest
> Task :sdks:java:io:common:classes UP-TO-DATE
> Task :runners:spark:3:processResources
> Task :runners:spark:3:processTestResources
> Task :sdks:java:io:common:jar
> Task :sdks:java:core:processResources
> Task :sdks:java:io:common:processTestResources NO-SOURCE
> Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE
> Task :runners:spark:2:copyMainJava
> Task :runners:spark:2:createCheckerFrameworkManifest
> Task :runners:spark:2:copyMainResources
> Task :runners:spark:2:processResources
> Task :runners:spark:2:copyTestJava
> Task :runners:spark:2:copyTestResources
> Task :runners:spark:2:processTestResources
> Task :sdks:java:core:generateTestAvroJava
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :sdks:java:core:processTestResources
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:job-management:extractIncludeProto
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :runners:local-java:compileJava FROM-CACHE
> Task :runners:local-java:classes UP-TO-DATE
> Task :sdks:java:extensions:arrow:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:classes UP-TO-DATE
> Task :runners:local-java:jar
> Task :sdks:java:extensions:arrow:jar
> Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-common:classes UP-TO-DATE
> Task :examples:java:twitter:compileJava FROM-CACHE
> Task :examples:java:twitter:classes UP-TO-DATE
> Task :sdks:java:io:common:compileTestJava FROM-CACHE
> Task :sdks:java:io:common:testClasses UP-TO-DATE
> Task :examples:java:twitter:jar
> Task :sdks:java:io:common:testJar
> Task :sdks:java:io:hadoop-common:jar
> Task :sdks:java:io:jdbc:compileJava FROM-CACHE
> Task :sdks:java:io:jdbc:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava FROM-CACHE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar
> Task :sdks:java:io:jdbc:jar
> Task :sdks:java:fn-execution:jar
> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:io:hadoop-format:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-format:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE
> Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE
> Task :sdks:java:testing:test-utils:testJar
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:io:hadoop-format:jar
> Task :sdks:java:extensions:protobuf:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar
> Task :sdks:java:core:compileTestJava FROM-CACHE
> Task :sdks:java:core:testClasses
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:core:shadowTestJar FROM-CACHE
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :runners:core-java:compileTestJava FROM-CACHE
> Task :runners:core-java:testClasses UP-TO-DATE
> Task :runners:java-job-service:compileJava FROM-CACHE
> Task :runners:java-job-service:classes UP-TO-DATE
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:java-job-service:jar
> Task :runners:core-java:testJar
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:extensions:ml:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:jar
> Task :sdks:java:io:kafka:jar
> Task :examples:java:twitter:compileTestJava FROM-CACHE
> Task :examples:java:twitter:testClasses UP-TO-DATE
> Task :examples:java:twitter:testJar
> Task :runners:direct-java:compileTestJava FROM-CACHE
> Task :runners:direct-java:testClasses UP-TO-DATE
> Task :runners:spark:2:compileJava FROM-CACHE
> Task :runners:spark:2:classes
> Task :runners:spark:3:compileJava FROM-CACHE
> Task :runners:spark:3:classes
> Task :runners:spark:3:jar
> Task :runners:spark:2:jar
> Task :runners:direct-java:shadowTestJar FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :runners:spark:2:compileTestJava FROM-CACHE
> Task :runners:spark:3:compileTestJava FROM-CACHE
> Task :runners:spark:3:testClasses
> Task :runners:spark:2:testClasses
> Task :runners:spark:3:testJar
> Task :runners:spark:2:testJar
> Task :sdks:java:io:google-cloud-platform:jar
> Task :examples:java:compileJava FROM-CACHE
> Task :examples:java:classes UP-TO-DATE
> Task :examples:java:jar
> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :sdks:java:io:hadoop-format:compileTestJava FROM-CACHE
> Task :sdks:java:io:hadoop-format:testClasses
> Task :runners:spark:2:validatesRunnerBatch
> Task :runners:spark:3:validatesRunnerBatch
> Task :runners:spark:2:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-14c1d052-3d32-460d-9e2e-87eb14034fe8
> Task :runners:spark:3:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0ca6ba55-20b5-4789-b04a-5ae9a6b85a46
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-86ff6e91-72e7-4fcf-a9d2-a5890f1d21e1
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c73c963d-d49f-47fd-af89-e396a4b7375b
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-23742e7a-03c0-4ce9-b4de-865f38b6680f
> Task :runners:spark:2:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-40a8e3ef-6841-42c5-8de2-73bbeae0117e
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-40dad825-8381-4984-a6b1-1a6518d0f6ad
org.apache.beam.sdk.transforms.ParDoLifecycleTest >
testTeardownCalledAfterExceptionInProcessElement FAILED
java.lang.RuntimeException at ParDoLifecycleTest.java:213
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1477a057-b580-4c35-8d4d-e6056f298437
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-dc5de8ff-ecdd-49cb-9da0-d8faed1fa307
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-46a83703-a836-4533-9eb5-e9e266238cc0
> Task :runners:spark:2:validatesRunnerBatch FAILED
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-fbbde3ed-c3e6-460e-86ff-df7f7fcab6b5
278 tests completed, 1 failed, 1 skipped
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2b5e6f01-cd85-43a0-9d93-dd806c19d5d3
> Task :runners:spark:2:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d1ef3f65-93b6-46c3-bcf7-fda72b105de1
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-88d93bfc-f7d9-4976-bec2-a6708260c5a2
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-76a2cc14-acce-47e4-8150-c64d521804ea
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c98f34ad-c44f-4fc8-9ab9-3451e450acf4
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-bd9c32a9-7838-4a3b-b735-b3b4f9573a14
> Task :runners:spark:3:validatesRunner
> Task :runners:spark:2:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5b21eadb-c0cd-451a-9a73-ef7c56bd7fe1
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:2:validatesRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/ws/src/runners/spark/2/build/reports/tests/validatesRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 55s
146 actionable tasks: 91 executed, 53 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/c3qdlwntwjhj2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]