See <https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Java11/1800/display/redirect?page=changes>
Changes: [nielm] Add Spanner Integration tests to verify exception handling [noreply] [BEAM-12903] Cron job to cleanup Dataproc leaked resources (#21779) [noreply] [BEAM-7209][BEAM-9351][BEAM-9428] Upgrade Hive to version 3.1.3 (#17749) [noreply] Sharding IO tests (Kafka, Debezium, JDBC, Kinesis, Neo4j) from the [noreply] Merge pull request #17604 from [BEAM-14315] Match updated files [noreply] Merge pull request #21781 from Sklearn Mnist example and IT test [noreply] Get the latest version of go-licenses (#21901) [noreply] Hide internal helpers added to DoFn for batched DoFns (#21860) [noreply] Updated documentation for ml.inference docs. (#21868) [Pablo Estrada] Moving to 2.41.0-SNAPSHOT on master branch. [noreply] Add a type hint to nexmark query 3 joinFn (#21873) ------------------------------------------ [...truncated 10.44 KB...] > Task :sdks:java:harness:createCheckerFrameworkManifest > Task :sdks:java:fn-execution:createCheckerFrameworkManifest > Task :runners:core-construction-java:processResources NO-SOURCE > Task :sdks:java:io:kafka:processResources NO-SOURCE > Task :sdks:java:harness:processResources NO-SOURCE > Task :sdks:java:extensions:google-cloud-platform-core:processResources > NO-SOURCE > Task :runners:java-job-service:processResources NO-SOURCE > Task :sdks:java:fn-execution:processResources NO-SOURCE > Task :runners:java-fn-execution:processResources NO-SOURCE > Task :sdks:java:core:generateAvroProtocol NO-SOURCE > Task :runners:core-java:processResources NO-SOURCE > Task :sdks:java:expansion-service:processResources NO-SOURCE > Task :runners:spark:3:processResources > Task :runners:core-java:processTestResources NO-SOURCE > Task :sdks:java:core:generateAvroJava NO-SOURCE > Task :model:fn-execution:extractProto > Task :model:job-management:extractProto > Task :runners:spark:3:processTestResources > Task :model:job-management:processResources > Task :model:fn-execution:processResources > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :sdks:java:core:processResources > Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE > Task :sdks:java:core:generateTestAvroJava > Task :sdks:java:core:generateTestGrammarSource NO-SOURCE > Task :sdks:java:core:processTestResources > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :model:pipeline:generateProto FROM-CACHE > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :model:pipeline:jar > Task :model:pipeline:shadowJar FROM-CACHE > Task :model:fn-execution:extractIncludeProto > Task :model:job-management:extractIncludeProto > Task :model:fn-execution:generateProto FROM-CACHE > Task :model:job-management:generateProto FROM-CACHE > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:job-management:shadowJar FROM-CACHE > Task :model:fn-execution:shadowJar FROM-CACHE > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar FROM-CACHE > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:fn-execution:jar > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :runners:core-construction-java:jar > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :runners:java-job-service:compileJava Note: <https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Java11/ws/src/runners/java-job-service/src/main/java/org/apache/beam/runners/jobsubmission/PortablePipelineJarCreator.java> uses unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:java-job-service:classes > Task :runners:java-job-service:jar > Task :sdks:java:core:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:core:testClasses > Task :runners:spark:3:compileJava > Task :sdks:java:core:shadowTestJar > Task :runners:core-java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:core-java:testClasses > Task :runners:core-java:testJar > Task :runners:spark:3:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:3:classes > Task :runners:spark:3:jar > Task :runners:spark:3:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:3:testClasses > Task :runners:spark:3:testJar Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 1m 39s 77 actionable tasks: 51 executed, 24 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/h2s5oud2m3hrc Build step 'Invoke Gradle script' changed build result to SUCCESS [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Java11/ws/src/gradlew> -x shadowJar -x shadowTestJar -x compileJava -x compileTestJava -x jar -x testJar -x classes -x testClasses -Dorg.gradle.java.home=/usr/lib/jvm/java-11-openjdk-amd64 --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :runners:spark:3:validatesRunner Starting a Gradle Daemon, 1 busy and 1 incompatible Daemons could not be reused, use --status for details Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins > Task :buildSrc:check > Task :buildSrc:build > Task :runners:spark:3:validatesRunnerBatch WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-78c2d83c-debc-4d62-b891-4d323064143d [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-8ce1c37a-cd01-4986-9a98-bbff039b4366 [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-1128e6fa-bbcf-4ce4-8677-2d07e0886ca3 org.apache.beam.sdk.transforms.ParDoLifecycleTest > testTeardownCalledAfterExceptionInProcessElement FAILED java.lang.RuntimeException at ParDoLifecycleTest.java:211 [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-7852cdc9-5a35-461c-8da5-fbcfa8d99b3a 278 tests completed, 1 failed, 1 skipped > Task :runners:spark:3:validatesRunnerBatch FAILED > Task :runners:spark:3:validatesRunnerStreaming WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-1f526d74-ae6f-4de6-9596-827b8c8a4ecf WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-45367e79-94d3-45c7-bbb3-98b78b7bf5bc [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-14ebd2cc-6604-4c92-b6b8-9007db689cc0 WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-37b529b6-06a4-48db-be63-7982cb0b482c [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-0b64c6be-ca2a-4461-a4df-d4db2ff92853 FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:spark:3:validatesRunnerBatch'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Java11/ws/src/runners/spark/3/build/reports/tests/validatesRunnerBatch/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 3m 59s 12 actionable tasks: 6 executed, 6 up-to-date Publishing build scan... https://gradle.com/s/63h4r4olil3jc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
