See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/2520/display/redirect>
Changes:
------------------------------------------
[...truncated 45.20 KB...]
#10 writing image
sha256:e7805b2e27baf7d763fd78e7e326401b26bd39b413b5fd4805890931411fc58d done
#10 naming to docker.io/library/golicenses-java done
#10 DONE 0.0s
> Task :sdks:java:container:pullLicenses
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-23.2.1 setuptools-68.2.2 wheel-0.41.2
Collecting beautifulsoup4<5.0,>=4.9.0 (from -r
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt>
(line 19))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting pyyaml<7,>=6.0.1 (from -r
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt>
(line 20))
Obtaining dependency information for pyyaml<7,>=6.0.1 from
https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
(2.1 kB)
Collecting tenacity<9.0,>=6.1.0 (from -r
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt>
(line 21))
Obtaining dependency information for tenacity<9.0,>=6.1.0 from
https://files.pythonhosted.org/packages/f4/f1/990741d5bb2487d529d20a433210ffa136a367751e454214013b441c4575/tenacity-8.2.3-py3-none-any.whl.metadata
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting soupsieve>1.2 (from beautifulsoup4<5.0,>=4.9.0->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/requirement.txt>
(line 19))
Obtaining dependency information for soupsieve>1.2 from
https://files.pythonhosted.org/packages/4c/f3/038b302fdfbe3be7da016777069f26ceefe11a681055ea1f7817546508e3/soupsieve-2.5-py3-none-any.whl.metadata
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Using cached
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Installing collected packages: tenacity, soupsieve, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.12.2 pyyaml-6.0.1 soupsieve-2.5
tenacity-8.2.3
Executing python
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 126 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.418015 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.50.0
go: downloading github.com/apache/beam v2.50.0+incompatible
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:downloadCloudProfilerAgent
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
0version.txt
NOTICES
profiler_java_agent.so
100 4183k 100 4183k 0 0 21.1M 0 --:--:-- --:--:-- --:--:-- 21.1M
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.21.1 build -o ./build/target/linux_amd64/boot boot.go
boot_test.go pathingjar.go pathingjar_test.go
> Task :release:go-licenses:java:dockerRun
go: downloading google.golang.org/grpc v1.57.0
go: downloading google.golang.org/protobuf v1.31.0
go: downloading github.com/golang/protobuf v1.5.3
go: downloading golang.org/x/sys v0.11.0
go: downloading google.golang.org/genproto/googleapis/rpc
v0.0.0-20230726155614-23370e0ffb3e
go: downloading golang.org/x/net v0.14.0
go: downloading google.golang.org/genproto v0.0.0-20230706204954-ccb25ca9f130
go: downloading golang.org/x/text v0.12.0
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due
to the following reasons:
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:pullLicenses' without declaring an
explicit or implicit dependency. This can lead to incorrect results being
produced, depending on what order the tasks are executed. Please refer to
https://docs.gradle.org/7.6.2/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: added github.com/apache/beam/sdks/v2 v2.50.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.14.0
go: added golang.org/x/sys v0.11.0
go: added golang.org/x/text v0.12.0
go: added google.golang.org/genproto/googleapis/rpc
v0.0.0-20230726155614-23370e0ffb3e
go: added google.golang.org/grpc v1.57.0
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container
--save_path=/output/licenses
W0919 04:21:09.709335 31 library.go:101] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0919 04:21:17.383374 73 library.go:101] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
> Task :release:go-licenses:java:dockerRun
github.com/apache/beam/sdks/v2/go,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.50.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.3/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.14.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.11.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.12.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/23370e0ffb3e/googleapis/rpc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.57.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.31.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 ...
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 2.58kB done
#2 DONE 1.3s
#1 [internal] load .dockerignore
#1 DONE 2.5s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s
#4 [ 1/16] FROM
docker.io/library/eclipse-temurin:8@sha256:ae78c894d048567fe780b577194f3409ed56ee8cb951d82c8ce66c41de46a9e4
#4 resolve
docker.io/library/eclipse-temurin:8@sha256:ae78c894d048567fe780b577194f3409ed56ee8cb951d82c8ce66c41de46a9e4
0.0s done
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.26MB 1.0s done
#5 DONE 1.0s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 2.6s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.3s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.2s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar
/opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.2s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
#16 DONE 0.3s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
#19 DONE 1.4s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.5s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.3s done
#21 writing image
sha256:adc1d03d41f24b2a66677a4445af3472d89f6dda5690dafe6577f3d2ab4343f6 done
#21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done
#21 DONE 0.3s
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7e899209-c99f-4850-a477-fead5a42e5b2
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testMultiOutputParDoWithSideInputsIsCumulative FAILED
java.lang.RuntimeException at ParDoTest.java:1289
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b66facef-7671-45c7-a737-b7fd631608c1
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-56b9b574-7fbf-4a84-849f-cebb27823378
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-72886ac9-0db5-4827-b97e-bd6e14422cdd
234 tests completed, 1 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerBatch FAILED
> Task :runners:spark:3:job-server:validatesPortableRunnerDocker FROM-CACHE
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:spark:3:job-server:validatesPortableRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 37m 42s
118 actionable tasks: 72 executed, 42 from cache, 4 up-to-date
Publishing build scan...
Publishing build scan failed due to 'An unexpected error occurred creating your
build scan.
Please report this problem at https://ge.apache.org/help, quoting the following
reference code:
uzoxeqrpyu3vi' (2 retries remaining)...
Publishing build scan failed due to network error
'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
Publishing build scan failed due to 'An unexpected error occurred creating your
build scan.
Please report this problem at https://ge.apache.org/help, quoting the following
reference code:
lw7lslc3pl2ga' (1 retry remaining)...
Publishing build scan failed due to network error
'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
Publishing build scan failed due to network error
'java.net.SocketTimeoutException: Read timed out' (1 retry remaining)...
Publishing failed.
The response from https://ge.apache.org/scans/publish/gradle/3.13.2/upload was
not from Gradle Enterprise.
The specified server address may be incorrect, or your network environment may
be interfering.
Please report this problem to your Gradle Enterprise administrator via
https://ge.apache.org/help and include the following via copy/paste:
----------
Gradle version: 7.6.2
Plugin version: 3.13.2
Request URL: https://ge.apache.org/scans/publish/gradle/3.13.2/upload
Request ID: f7b6419b-d091-4eb6-a47b-b4c72f32aed8
Response status code: 502
Response content type: text/html
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
