See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/10767/display/redirect?page=changes>
Changes:
[noreply] Revert "Remove subprocess.PIPE usage by using a temp file (#22654)"
------------------------------------------
[...truncated 19.20 KB...]
> Task :sdks:java:io:hadoop-common:processResources NO-SOURCE
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :sdks:java:io:hadoop-format:processResources NO-SOURCE
> Task :examples:java:twitter:createCheckerFrameworkManifest
> Task :sdks:java:io:common:createCheckerFrameworkManifest
> Task :runners:direct-java:processTestResources NO-SOURCE
> Task :examples:java:twitter:processResources NO-SOURCE
> Task :sdks:java:testing:test-utils:createCheckerFrameworkManifest
> Task :examples:java:twitter:processTestResources NO-SOURCE
> Task :sdks:java:io:common:compileJava NO-SOURCE
> Task :sdks:java:io:jdbc:createCheckerFrameworkManifest
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:io:common:processResources NO-SOURCE
> Task :sdks:java:io:common:classes UP-TO-DATE
> Task :sdks:java:io:hadoop-format:processTestResources
> Task :sdks:java:testing:test-utils:processTestResources NO-SOURCE
> Task :sdks:java:io:jdbc:processResources NO-SOURCE
> Task :runners:spark:3:createCheckerFrameworkManifest
> Task :runners:spark:3:processResources
> Task :sdks:java:core:processResources
> Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE
> Task :runners:spark:3:processTestResources
> Task :runners:spark:2:copyMainJava
> Task :runners:spark:2:createCheckerFrameworkManifest
> Task :runners:spark:2:copyMainResources
> Task :runners:spark:2:processResources
> Task :runners:spark:2:copyTestJava
> Task :runners:spark:2:copyTestResources
> Task :runners:spark:2:processTestResources
> Task :sdks:java:io:common:jar
> Task :sdks:java:io:common:processTestResources NO-SOURCE
> Task :sdks:java:core:generateTestAvroJava
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :sdks:java:core:processTestResources
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:job-management:shadowJar FROM-CACHE
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :runners:local-java:compileJava FROM-CACHE
> Task :runners:local-java:classes UP-TO-DATE
> Task :sdks:java:extensions:arrow:compileJava FROM-CACHE
> Task :sdks:java:extensions:arrow:classes UP-TO-DATE
> Task :runners:local-java:jar
> Task :sdks:java:extensions:arrow:jar
> Task :sdks:java:io:jdbc:compileJava FROM-CACHE
> Task :sdks:java:io:jdbc:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava FROM-CACHE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-common:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:io:common:compileTestJava FROM-CACHE
> Task :sdks:java:io:jdbc:jar
> Task :sdks:java:io:common:testClasses UP-TO-DATE
> Task :sdks:java:io:hadoop-common:jar
> Task :sdks:java:io:common:testJar
> Task :examples:java:twitter:compileJava FROM-CACHE
> Task :examples:java:twitter:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE
> Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE
> Task :examples:java:twitter:jar
> Task :sdks:java:testing:test-utils:testJar
> Task :sdks:java:io:hadoop-format:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-format:classes UP-TO-DATE
> Task :sdks:java:io:hadoop-format:jar
> Task :sdks:java:extensions:protobuf:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :sdks:java:core:compileTestJava FROM-CACHE
> Task :sdks:java:core:testClasses
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :sdks:java:core:shadowTestJar FROM-CACHE
> Task :runners:core-java:jar
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:core-java:compileTestJava FROM-CACHE
> Task :runners:core-java:testClasses UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :sdks:java:expansion-service:jar
> Task :runners:core-java:testJar
> Task :runners:java-job-service:compileJava FROM-CACHE
> Task :runners:java-job-service:classes UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:ml:compileJava FROM-CACHE
> Task :sdks:java:extensions:ml:classes UP-TO-DATE
> Task :runners:direct-java:compileTestJava FROM-CACHE
> Task :runners:direct-java:testClasses UP-TO-DATE
> Task :runners:java-job-service:jar
> Task :sdks:java:extensions:ml:jar
> Task :sdks:java:io:kafka:jar
> Task :examples:java:twitter:compileTestJava FROM-CACHE
> Task :examples:java:twitter:testClasses UP-TO-DATE
> Task :examples:java:twitter:testJar
> Task :runners:direct-java:shadowTestJar FROM-CACHE
> Task :runners:spark:3:compileJava FROM-CACHE
> Task :runners:spark:3:classes
> Task :runners:spark:2:compileJava FROM-CACHE
> Task :runners:spark:2:classes
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :runners:spark:2:jar
> Task :runners:spark:3:jar
> Task :runners:spark:2:compileTestJava FROM-CACHE
> Task :runners:spark:2:testClasses
> Task :runners:spark:3:compileTestJava FROM-CACHE
> Task :runners:spark:3:testClasses
> Task :sdks:java:io:google-cloud-platform:jar
> Task :runners:spark:2:testJar
> Task :runners:spark:3:testJar
> Task :examples:java:compileJava FROM-CACHE
> Task :examples:java:classes UP-TO-DATE
> Task :examples:java:jar
> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :sdks:java:io:hadoop-format:compileTestJava FROM-CACHE
> Task :sdks:java:io:hadoop-format:testClasses
> Task :runners:spark:2:validatesRunnerBatch
> Task :runners:spark:3:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f0377f15-bea7-4ffe-adfa-c7366563e055
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f35654dd-5b99-48ab-b7f6-6d2a6de51eba
> Task :runners:spark:2:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-8f4dadb8-1f2a-43cf-ac82-2600142aa55e
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-302b633f-a793-4788-8c46-c71b296ce632
> Task :runners:spark:3:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-4558d490-2634-4093-beb0-4133afabd9f4
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-375e9679-9249-4caa-bc72-2f440009be20
> Task :runners:spark:2:validatesRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-acb044f6-0a5d-4653-b833-dec7c8f5dc3b
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-49c50b60-b602-4a92-ab0e-2c49ee31ea1f
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-aa19b782-6060-43ff-a110-231e49dbd4ee
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a62af2bf-bd7b-4359-b1d0-6ade9f32163d
> Task :runners:spark:2:validatesRunnerBatch
org.apache.beam.sdk.transforms.ParDoLifecycleTest >
testTeardownCalledAfterExceptionInStartBundle FAILED
java.lang.RuntimeException at ParDoLifecycleTest.java:200
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a3e85816-6e4b-46cd-8bd9-e9637c97429c
278 tests completed, 1 failed, 1 skipped
> Task :runners:spark:2:validatesRunnerBatch FAILED
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5e483269-ed55-4b51-9054-b6b34228d026
> Task :runners:spark:2:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-91b1ac92-7b1a-4378-91d8-9814fe7fc251
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5159e728-b68e-4a66-90d9-8b95fef3a137
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-fe5809d4-45c1-42db-8cd2-8222f62a22d2
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0fa45d01-71fd-4caf-a358-66bd39cf24e5
> Task :runners:spark:3:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-041f849d-a3b3-487d-ac35-d0dd82c486f7
> Task :runners:spark:3:validatesRunner
> Task :runners:spark:2:validatesRunnerStreaming
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7c0905e9-db73-4000-b6f3-7a8208b5f08e
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:2:validatesRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/ws/src/runners/spark/2/build/reports/tests/validatesRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 11s
146 actionable tasks: 91 executed, 53 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zmlgwa65raqwq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]