See <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2504/display/redirect>
Changes: ------------------------------------------ [...truncated 45.89 KB...] Collecting beautifulsoup4<5.0,>=4.9.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19)) Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB) Collecting pyyaml<7,>=6.0.1 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20)) Obtaining dependency information for pyyaml<7,>=6.0.1 from https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB) Collecting tenacity<9.0,>=6.1.0 (from -r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21)) Obtaining dependency information for tenacity<9.0,>=6.1.0 from https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB) Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19)) Obtaining dependency information for soupsieve>1.2 from https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB) Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB) Using cached tenacity-8.2.3-py3-none-any.whl (24 kB) Using cached soupsieve-2.5-py3-none-any.whl (36 kB) Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4 Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5 tenacity-8.2.3 Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses> INFO:root:Pulling license for 126 dependencies using 16 threads. INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5 INFO:root:pull_licenses_java.py succeed. It took 1.409024 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :release:go-licenses:java:dockerRun + rm -rf '/output/*' + go get github.com/apache/beam/sdks/v2/java/container go: downloading github.com/apache/beam/sdks/v2 v2.50.0 go: downloading github.com/apache/beam v2.50.0+incompatible > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:java:container:downloadCloudProfilerAgent % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0version.txt NOTICES profiler_java_agent.so 100 4183k 100 4183k 0 0 20.2M 0 --:--:-- --:--:-- --:--:-- 20.2M > Task :sdks:java:container:goPrepare UP-TO-DATE > Task :sdks:java:container:goBuild /home/jenkins/go/bin/go1.21.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go pathingjar.go pathingjar_test.go > Task :sdks:java:container:java8:copySdkHarnessLauncher Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons: - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency for more details about this problem. > Task :release:go-licenses:java:dockerRun go: downloading github.com/golang/protobuf v1.5.3 go: downloading google.golang.org/grpc v1.57.0 go: downloading google.golang.org/protobuf v1.31.0 go: downloading golang.org/x/sys v0.11.0 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e go: downloading golang.org/x/net v0.14.0 go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130 go: downloading golang.org/x/text v0.12.0 go: added github.com/apache/beam/sdks/v2 v2.50.0 go: added github.com/golang/protobuf v1.5.3 go: added golang.org/x/net v0.14.0 go: added golang.org/x/sys v0.11.0 go: added golang.org/x/text v0.12.0 go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230726155614-23370e0ffb3e go: added google.golang.org/grpc v1.57.0 go: added google.golang.org/protobuf v1.31.0 + go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses W0915 04:21:13.787449 37 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s + go-licenses csv github.com/apache/beam/sdks/v2/java/container + tee /output/licenses/list.csv W0915 04:21:21.973162 82 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0 github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0 google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :runners:spark:3:job-server:validatesPortableRunnerBatch > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker #1 [internal] load .dockerignore #1 transferring context: 2B done #1 ... #2 [internal] load build definition from Dockerfile #2 transferring dockerfile: 2.58kB done #2 DONE 2.2s #1 [internal] load .dockerignore #1 DONE 3.2s #3 [internal] load metadata for docker.io/library/eclipse-temurin:8 #3 DONE 2.1s #4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:ae78c894d048567fe780b577194f3409ed56ee8cb951d82c8ce66c41de46a9e4 #4 resolve docker.io/library/eclipse-temurin:8@sha256:ae78c894d048567fe780b577194f3409ed56ee8cb951d82c8ce66c41de46a9e4 0.0s done #4 CACHED #5 [internal] load build context #5 transferring context: 4.42MB 0.1s #5 transferring context: 47.26MB 1.0s done #5 DONE 1.0s #6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/ #6 DONE 2.1s #7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ #7 DONE 0.1s #8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/ #8 DONE 0.1s #9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/ #9 DONE 0.1s #10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/ #10 DONE 0.1s #11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ #11 DONE 0.1s #12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/ #12 DONE 0.1s #13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/ #13 DONE 0.2s #14 [10/16] COPY target/LICENSE /opt/apache/beam/ #14 DONE 0.1s #15 [11/16] COPY target/NOTICE /opt/apache/beam/ #15 DONE 0.1s #16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ #16 DONE 0.2s #17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/ #17 DONE 0.1s #18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #18 DONE 0.1s #19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #19 DONE 0.6s #20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/ #20 DONE 0.1s #21 exporting to image #21 exporting layers #21 exporting layers 0.5s done #21 writing image sha256:47278e86a79378362ca7deadd98aa3f6f886b72c75477570964eacb300328b3d done #21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done #21 DONE 0.5s > Task :runners:spark:3:job-server:validatesPortableRunnerBatch org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testCombineGloballyAsSingletonView FAILED java.lang.RuntimeException at CombineTest.java:1359 org.apache.beam.sdk.transforms.CombineTest$WindowingTests > testWindowedCombineGloballyAsSingletonView FAILED java.lang.RuntimeException at CombineTest.java:1402 [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-a39f504f-3844-4bbf-889a-5d55234d12b8 [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-ecc88b3b-306d-4e6c-9657-3b7c325da421 [pool-246-thread-2] WARN org.apache.beam.fn.harness.control.ExecutionStateSampler - Operation ongoing in bundle 4 for at least 27m47s without outputting or completing: at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at org.apache.beam.sdk.fn.CancellableQueue.take(CancellableQueue.java:95) at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:122) at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550) at org.apache.beam.fn.harness.FnHarness$$Lambda$1643/1080342532.apply(Unknown Source) at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150) at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115) at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver$$Lambda$1673/1547074703.run(Unknown Source) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) org.apache.beam.sdk.transforms.ParDoTest$TimestampTests > testParDoShiftTimestampUnlimited FAILED java.lang.RuntimeException at ParDoTest.java:2142 [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-6d183ca9-7938-441a-b782-39912200bd96 [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-a491072a-d5af-4a8b-8fe2-63778c535eae 234 tests completed, 3 failed, 1 skipped > Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED > Task :runners:spark:3:job-server:validatesPortableRunnerDocker FROM-CACHE FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:spark:3:job-server:validatesPortableRunnerBatch'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1h 46m 118 actionable tasks: 72 executed, 42 from cache, 4 up-to-date Publishing build scan... Publishing failed. The response from https://ge.apache.org/scans/publish/gradle/3.13.2/token was not from Gradle Enterprise. The specified server address may be incorrect, or your network environment may be interfering. Please report this problem to your Gradle Enterprise administrator via https://ge.apache.org/help and include the following via copy/paste: ---------- Gradle version: 7.6.2 Plugin version: 3.13.2 Request URL: https://ge.apache.org/scans/publish/gradle/3.13.2/token Request ID: 1fe74bd0-1742-4d5b-882f-8ae7256da3da Response status code: 502 Response content type: text/html ---------- Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
