See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1474/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Cleanup docs on Shared.
[noreply] Improvements to Beam/Spark quickstart. (#17129)
[chamikaramj] Disable BigQueryIOStorageWriteIT for Runner v2 test suite
------------------------------------------
[...truncated 54.37 KB...]
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.0.4 setuptools-62.0.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.2 tenacity-5.1.5
Executing python
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 225 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 8.122123 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ export GO111MODULE=off
+ GO111MODULE=off
+ go get github.com/apache/beam/sdks/java/container
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
b15b54a6eb25: Preparing
094c06f5a86a: Preparing
33fda11152a3: Preparing
f23da7a5e23b: Preparing
89b15af9c641: Preparing
8e4e27362140: Preparing
25178830291e: Preparing
a04c2765205a: Preparing
38e0fb57e055: Preparing
020502c14161: Preparing
59b51fa2cf05: Preparing
285206c1c67d: Preparing
0a3c620aa107: Preparing
6910c75652c9: Preparing
1cb21776c0f5: Preparing
7494d840ea88: Preparing
357cc1947e95: Preparing
b0dc1a441986: Preparing
7a7698da17f2: Preparing
d59769727d80: Preparing
348622fdcc61: Preparing
4ac8bc2cd0be: Preparing
8e4e27362140: Waiting
25178830291e: Waiting
a04c2765205a: Waiting
d59769727d80: Waiting
7494d840ea88: Waiting
348622fdcc61: Waiting
7a7698da17f2: Waiting
38e0fb57e055: Waiting
4ac8bc2cd0be: Waiting
357cc1947e95: Waiting
59b51fa2cf05: Waiting
285206c1c67d: Waiting
020502c14161: Waiting
b0dc1a441986: Waiting
6910c75652c9: Waiting
1cb21776c0f5: Waiting
0a3c620aa107: Waiting
b15b54a6eb25: Pushed
094c06f5a86a: Pushed
89b15af9c641: Pushed
f23da7a5e23b: Pushed
33fda11152a3: Pushed
25178830291e: Pushed
a04c2765205a: Pushed
020502c14161: Pushed
8e4e27362140: Pushed
285206c1c67d: Pushed
59b51fa2cf05: Pushed
7494d840ea88: Layer already exists
357cc1947e95: Layer already exists
b0dc1a441986: Layer already exists
7a7698da17f2: Layer already exists
38e0fb57e055: Pushed
d59769727d80: Layer already exists
348622fdcc61: Layer already exists
4ac8bc2cd0be: Layer already exists
6910c75652c9: Pushed
1cb21776c0f5: Pushed
0a3c620aa107: Pushed
20220409035736: digest:
sha256:f10e0e816dc4886017a30b9e2402e103e548d1bc79597b9ae0075b73fbe94ff2 size:
4935
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0409040010-3a214977
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0409040010-3a214977
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0409040010-3a214977
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0409040010-3a214977
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0409040008-fadbcd45
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0409040008-fadbcd45
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0409040008-fadbcd45
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0409040008-fadbcd45
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamIT >
testReadSpannerChangeStream FAILED
java.lang.IllegalArgumentException at SpannerChangeStreamIT.java:139
org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamTransactionBoundariesIT
> testTransactionBoundaries FAILED
java.lang.IllegalArgumentException at
SpannerChangeStreamTransactionBoundariesIT.java:145
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:264
47 tests completed, 3 failed, 3 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220409035736
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f10e0e816dc4886017a30b9e2402e103e548d1bc79597b9ae0075b73fbe94ff2
Deleted: sha256:bc7b86e367dec3bce85bb1121a6412ec12bc46b4ed1e7634d5c0d899f33efa93
Deleted: sha256:c8320e22734e8cb0b9f4c93a5624bafe03de329f127ee10f60e35f1ab1b49249
Deleted: sha256:bc3311812d5574082b44b233e427c17cbbeb89beea7fcfc7d4aa1155f43647e1
Deleted: sha256:af1ba0b1a5da9e68cb04d3e2d935ba656713fed5786c776fb02f381d9a2596b2
Deleted: sha256:c9d6636ee768917594e77206d5203e8add31b20aac5fdd8948611e81b8116d28
Deleted: sha256:fa694ffa209d9034a9f48c6dc68439126fe31e021410851fd90713c94b34d23e
Deleted: sha256:3f287315e1c8bd17db7d43d30012f10681b830872642299b046ad2d19aa269df
Deleted: sha256:7655f7dd4945ae832012a8eee50fd3b2bc476838373e73c243260b0183872ed7
Deleted: sha256:ca3bb715d88ed52899cd2e00af5f02de22289e1781fe96cde79b03ed331636be
Deleted: sha256:9708fe6e9b16acf0b0be0bb5b6e7677cb6fb1afc8f202526371d937326d79009
Deleted: sha256:a207afce534ede5b2d8541d12f80575a8116d628b1148c8ff1828bc3bdb2d081
Deleted: sha256:d3d6fe767f3f37e63ec175ac916db38b29147fefb5f45129fbc3bacae328def9
Deleted: sha256:237e508b3305b1aa0345a287294178db40b64ded15df21f658d50447a971e7f9
Deleted: sha256:b7815a04a785346d64390ea544945c4ef5244e8c216c159c2c87748096531881
Deleted: sha256:b829d05e50436635b46531dd3f18da42fe2ccdb359e9dcde90c1265203e29f02
Deleted: sha256:ac244f70ffdd1b1cd1d093fadfbcf93256d245d02e65d4ee4c20e644e8def412
Deleted: sha256:f708942d6874158dd38ae1b443da71463055cdfd6b36a6a289fa167d78648b64
Deleted: sha256:25525a73c9b070508ab5273c871f71c0451f44fe54b1bfad99b65c0346af9cdb
Deleted: sha256:661391caada559e9c1e23007f46d7085595ff722047d25964e445582764417c5
Deleted: sha256:57a5a6353c78097e50bf127252dc0495328c8f4cd607e1718db2f0fd8e10a9b8
Deleted: sha256:6b36d1a9f9b1f199c00c59e81b82ef3eb0530a922edac66647c962bcddb87e68
Deleted: sha256:8425d7a7d71ea502bb788fe0b6e7a7769c3f7a4661fe073f0f3f19d5d34c69e3
Deleted: sha256:71c5189aed38860c14d98b1aa35955405dd37e2d92f36df31dca14f7149a79a9
Deleted: sha256:22d8e6d97e3105ec4416f7d72a25461e2f9284aaf80a88d47021fd93c54d2d31
Deleted: sha256:0432bdc92531dae9d89327e8149bab3d025d8c53cf58550e5c08c44fe416f38e
Deleted: sha256:a87a2f971176ca024c1c6e0838ff93e62406c0d646ae1d1e647797cc4f54fa14
Deleted: sha256:31081a8512bbb569c7369f4dae549b641beafe63d2d0f3bb6ff2e581e228c024
Deleted: sha256:8f42dd50bc1856a8d782e15b98446a7f6141f323384f4d0909afa3ea0314d191
Deleted: sha256:38b822655872eeee14b539b4c68904b2f57669f77b36258d6d246d3b107da75d
Deleted: sha256:ba4d6d0270d98cf98d7cc612809696e4c92005fcac8a19e53a9398ff245dbbdd
Deleted: sha256:af42c62257d391f77ee1f37ae19dabf6028b303def4ece03f698f734ed52d16a
Deleted: sha256:508738c771b37d2c48ca99711bd31918b80dae6681f7500f7c02e84742e29530
Deleted: sha256:8c024412400bda4a444bf43ece5e5cb6921e4adcabd1d12ebe2a079653421e6d
Deleted: sha256:1e03977177e53ed9805e7ad4df3940dc8adef129592a497ad017d78f7a42f0fc
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220409035736]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f10e0e816dc4886017a30b9e2402e103e548d1bc79597b9ae0075b73fbe94ff2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220409035736]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f10e0e816dc4886017a30b9e2402e103e548d1bc79597b9ae0075b73fbe94ff2])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f10e0e816dc4886017a30b9e2402e103e548d1bc79597b9ae0075b73fbe94ff2
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f10e0e816dc4886017a30b9e2402e103e548d1bc79597b9ae0075b73fbe94ff2
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f10e0e816dc4886017a30b9e2402e103e548d1bc79597b9ae0075b73fbe94ff2].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 24m 38s
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/yhpeyfrolambg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
