See
<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/5890/display/redirect?page=changes>
Changes:
[noreply] Allow users to pass classloader to dynamically load JDBC drivers.
[noreply] Fix withCheckStopReadingFn to not cause the pipeline to crash (#22962)
------------------------------------------
[...truncated 3.18 MB...]
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processMapOfNestedIntField
WRITE 1000000 N/A
N/A ss 0.483 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processNestedBytesField
READ_ONCE 1000000 N/A
N/A ss 0.121 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processNestedBytesField
READ_REPEATED 1000000 N/A
N/A ss 0.273 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processNestedBytesField
WRITE 1000000 N/A
N/A ss 0.241 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processNestedIntField
READ_ONCE 1000000 N/A
N/A ss 0.263 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processNestedIntField
READ_REPEATED 1000000 N/A
N/A ss 0.322 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processNestedIntField
WRITE 1000000 N/A
N/A ss 0.250 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processStringBuilderField
READ_ONCE 1000000 N/A
N/A ss 0.088 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processStringBuilderField
READ_REPEATED 1000000 N/A
N/A ss 0.239 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processStringBuilderField
WRITE 1000000 N/A
N/A ss 0.198 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processStringField
READ_ONCE 1000000 N/A
N/A ss 0.048 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processStringField
READ_REPEATED 1000000 N/A
N/A ss 0.091 s/op
o.a.b.s.j.schemas.GetterBasedSchemaProviderBenchmark.processStringField
WRITE 1000000 N/A
N/A ss 0.194 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
512/1024 ss 0.015 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
640/1024 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
768/1024 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
896/1024 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
4096/8192 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
5120/8192 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
6144/8192 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
7168/8192 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
20480/65536 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
24576/65536 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
28672/65536 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
32768/65536 ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
131072/262144 ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
163840/262144 ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
196608/262144 ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
229376/262144 ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
524288/1048576 ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
655360/1048576 ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
786432/1048576 ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testCopyArray
N/A N/A N/A
917504/1048576 ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testNewArray
N/A N/A 1024
N/A ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testNewArray
N/A N/A 8192
N/A ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testNewArray
N/A N/A 65536
N/A ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testNewArray
N/A N/A 262144
N/A ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.NewVsCopy.testNewArray
N/A N/A 1048576
N/A ss ≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamFewLargeWrites
N/A N/A N/A N/A
ss 0.003 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamFewMixedWritesWithReuse
N/A N/A N/A N/A ss
≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamFewMixedWritesWithoutReuse
N/A N/A N/A N/A ss ≈
10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamFewSmallWrites
N/A N/A N/A N/A
ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamFewTinyWrites
N/A N/A N/A N/A
ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamManyLargeWrites
N/A N/A N/A N/A
ss 0.004 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamManyMixedWritesWithReuse
N/A N/A N/A N/A ss
0.018 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamManyMixedWritesWithoutReuse
N/A N/A N/A N/A ss
0.010 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamManySmallWrites
N/A N/A N/A N/A
ss 0.001 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testProtobufByteStringOutputStreamManyTinyWrites
N/A N/A N/A N/A
ss ≈ 10⁻³ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamFewLargeWrites
N/A N/A N/A N/A
ss 0.001 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamFewMixedWritesWithReuse
N/A N/A N/A N/A ss
≈ 10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamFewMixedWritesWithoutReuse
N/A N/A N/A N/A ss ≈
10⁻⁴ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamFewSmallWrites
N/A N/A N/A N/A
ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamFewTinyWrites
N/A N/A N/A N/A
ss ≈ 10⁻⁵ s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamManyLargeWrites
N/A N/A N/A N/A
ss 0.003 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamManyMixedWritesWithReuse
N/A N/A N/A N/A ss
0.006 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamManyMixedWritesWithoutReuse
N/A N/A N/A N/A ss
0.014 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamManySmallWrites
N/A N/A N/A N/A
ss 0.001 s/op
o.a.b.s.j.util.ByteStringOutputStreamBenchmark.testSdkCoreByteStringOutputStreamManyTinyWrites
N/A N/A N/A N/A
ss 0.001 s/op
> Task :sdks:java:container:pullLicenses
Copying already-fetched licenses from
<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/build/reports/dependency-license>
to
<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses>
> Task :sdks:java:core:jmh:spotbugsMain FROM-CACHE
> Task :sdks:java:core:jmh:spotbugsTest SKIPPED
> Task :sdks:java:core:jmh:test FROM-CACHE
> Task :sdks:java:core:jmh:check
> Task :sdks:java:core:jmh:build
> Task :sdks:java:core:jmh:buildDependents
> Task :sdks:java:io:azure:test FROM-CACHE
> Task :sdks:java:io:azure:check UP-TO-DATE
> Task :sdks:java:io:azure:build
> Task :sdks:java:io:azure:buildDependents
> Task :runners:samza:job-server:shadowDistZip
> Task :runners:samza:job-server:assemble
> Task :runners:samza:job-server:analyzeClassesDependencies FROM-CACHE
> Task :runners:samza:job-server:analyzeTestClassesDependencies SKIPPED
> Task :runners:samza:job-server:analyzeDependencies UP-TO-DATE
> Task :runners:samza:job-server:checkstyleMain SKIPPED
> Task :runners:samza:job-server:checkstyleTest SKIPPED
> Task :runners:samza:job-server:javadoc NO-SOURCE
> Task :runners:samza:job-server:spotbugsMain NO-SOURCE
> Task :runners:samza:job-server:spotbugsTest SKIPPED
> Task :runners:samza:job-server:test NO-SOURCE
> Task :runners:samza:job-server:check UP-TO-DATE
> Task :runners:samza:job-server:build
> Task :runners:samza:job-server:buildDependents
> Task :runners:samza:buildDependents
> Task :sdks:java:container:pullLicenses
Collecting pip
Using cached pip-22.2.2-py3-none-any.whl (2.0 MB)
Collecting setuptools
Using cached setuptools-65.3.0-py3-none-any.whl (1.2 MB)
Collecting wheel
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.2.2 setuptools-65.3.0 wheel-0.37.1
> Task :runners:spark:3:test
129 tests completed, 1 failed, 5 skipped
> Task :runners:spark:3:test FAILED
> Task :sdks:java:container:pullLicenses
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.2.post1 tenacity-5.1.5
Executing python
<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 240 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 7.664627 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go
boot_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due
to the following reasons:
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:downloadCloudProfilerAgent' without
declaring an explicit or implicit dependency. This can lead to incorrect
results being produced, depending on what order the tasks are executed. Please
refer to
https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:pullLicenses' without declaring an
explicit or implicit dependency. This can lead to incorrect results being
produced, depending on what order the tasks are executed. Please refer to
https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:extensions:sql:jdbc:shadowJarTest
> Task :sdks:java:io:kafka:check
> Task :sdks:java:io:kafka:build
> Task :sdks:java:extensions:sql:jdbc:preCommit
> Task :sdks:java:container:java8:docker
---> Running in 891c7859409e
Removing intermediate container 891c7859409e
---> 9f260ed1fad7
Step 4/21 : ARG pull_licenses
---> Running in a10ba4f3a1b6
Removing intermediate container a10ba4f3a1b6
---> 0be960f0f797
Step 5/21 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
---> 8671a7d174f4
Step 6/21 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> 504715eb5e45
Step 7/21 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> 957219f214be
Step 8/21 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> 100fe73905ce
Step 9/21 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> 62bcf5cc9e44
Step 10/21 : ADD target/jamm.jar /opt/apache/beam/jars/
---> d461a608fc8a
Step 11/21 : ADD target/linux_amd64/boot /opt/apache/beam/
---> e54e95575fad
Step 12/21 : COPY target/LICENSE /opt/apache/beam/
---> d3d2e301fda0
Step 13/21 : COPY target/NOTICE /opt/apache/beam/
---> 4364522458f8
Step 14/21 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> f573475b46cb
Step 15/21 : COPY target/LICENSE target/options/* /opt/apache/beam/options/
---> a415e34cf356
Step 16/21 : RUN rm /opt/apache/beam/options/LICENSE
---> Running in 0de3fb800e3e
Removing intermediate container 0de3fb800e3e
---> 26c523726f2d
Step 17/21 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> cf95c35a963a
Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 3d7f8d099705
Removing intermediate container 3d7f8d099705
---> 75ff16699d9a
Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in d51831b9827b
Removing intermediate container d51831b9827b
---> fe27b29c5897
Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/
---> c2d050f2a881
Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 39f359f8d4f3
Removing intermediate container 39f359f8d4f3
---> 917f816a6ff5
Successfully built 917f816a6ff5
Successfully tagged apache/beam_java8_sdk:2.42.0.dev
> Task :sdks:java:io:jdbc:check
> Task :sdks:java:io:jdbc:build
> Task :sdks:java:io:jdbc:buildDependents
> Task :sdks:java:testing:nexmark:check
> Task :sdks:java:testing:nexmark:build
> Task :sdks:java:testing:nexmark:buildDependents
> Task :sdks:java:extensions:sql:zetasql:buildDependents
> Task :sdks:java:extensions:sql:buildDependents
> Task :sdks:java:extensions:join-library:buildDependents
> Task :sdks:java:io:google-cloud-platform:buildDependents
> Task :sdks:java:io:mongodb:buildDependents
> Task :sdks:java:io:parquet:buildDependents
> Task :sdks:java:io:thrift:buildDependents
> Task :sdks:java:extensions:arrow:buildDependents
> Task :sdks:java:extensions:protobuf:buildDependents
> Task :sdks:java:io:hadoop-common:buildDependents
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:3:test'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/ws/src/runners/spark/3/build/reports/tests/test/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 23m 53s
1159 actionable tasks: 586 executed, 571 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pt53e76mfqdfo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]