See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1470/display/redirect?page=changes>
Changes:
[johnjcasey] [BEAM-10529] add java and generic components of nullable xlang
tests
[johnjcasey] [BEAM-10529] fix test case
[johnjcasey] [BEAM-10529] add coders and typehints to support nullable xlang
coders
[johnjcasey] [BEAM-10529] update external builder to support nullable coder
[johnjcasey] [BEAM-10529] clean up coders.py
[johnjcasey] [BEAM-10529] add coder translation test
[johnjcasey] [BEAM-10529] add additional check to typecoder to not accidentally
[johnjcasey] [BEAM-10529] add test to retrieve nullable coder from typehint
[johnjcasey] [BEAM-10529] run spotless
[johnjcasey] [BEAM-10529] add go nullable coder
[johnjcasey] [BEAM-10529] cleanup extra println
[johnjcasey] [BEAM-10529] improve comments, clean up python
[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow
jobs -
[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow
jobs -
[noreply] [BEAM-14259, BEAM-14266] Remove unused function, replace use of ptypes
[noreply] [BEAM-14274] Fix staticcheck warnings in pipelinex (#17311)
[noreply] [BEAM-13857] Switched Go IT script to using Go flags for expansion
------------------------------------------
[...truncated 54.03 KB...]
Collecting pip
Using cached pip-22.0.4-py3-none-any.whl (2.1 MB)
Collecting setuptools
Using cached setuptools-62.0.0-py3-none-any.whl (1.1 MB)
Collecting wheel
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.0.4 setuptools-62.0.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.11.0-py3-none-any.whl (71 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.0 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.2 tenacity-5.1.5
Executing python
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 225 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 9.762307 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
d01f215cc752: Preparing
678e73503b42: Preparing
8e8ad3da121a: Preparing
fd62704dd9a6: Preparing
e0898b68c824: Preparing
d6b243dfc8c6: Preparing
70877a679a6b: Preparing
f75f3012d362: Preparing
6a3eadcb7753: Preparing
d6b243dfc8c6: Waiting
a59966308eb6: Preparing
70877a679a6b: Waiting
73863f2e9f8d: Preparing
f75f3012d362: Waiting
08a5648d3d97: Preparing
c6225f8c5845: Preparing
73863f2e9f8d: Waiting
a59966308eb6: Waiting
afbe62d8db4d: Preparing
c6225f8c5845: Waiting
cad115732eba: Preparing
7494d840ea88: Preparing
357cc1947e95: Preparing
cad115732eba: Waiting
afbe62d8db4d: Waiting
b0dc1a441986: Preparing
7494d840ea88: Waiting
7a7698da17f2: Preparing
d59769727d80: Preparing
357cc1947e95: Waiting
348622fdcc61: Preparing
b0dc1a441986: Waiting
7a7698da17f2: Waiting
4ac8bc2cd0be: Preparing
d59769727d80: Waiting
348622fdcc61: Waiting
4ac8bc2cd0be: Waiting
678e73503b42: Pushed
8e8ad3da121a: Pushed
fd62704dd9a6: Pushed
e0898b68c824: Pushed
d01f215cc752: Pushed
70877a679a6b: Pushed
a59966308eb6: Pushed
f75f3012d362: Pushed
d6b243dfc8c6: Pushed
6a3eadcb7753: Pushed
73863f2e9f8d: Pushed
08a5648d3d97: Pushed
7494d840ea88: Layer already exists
357cc1947e95: Layer already exists
b0dc1a441986: Layer already exists
7a7698da17f2: Layer already exists
d59769727d80: Layer already exists
348622fdcc61: Layer already exists
4ac8bc2cd0be: Layer already exists
cad115732eba: Pushed
afbe62d8db4d: Pushed
c6225f8c5845: Pushed
20220408035737: digest:
sha256:7d56a71f02a1b6e015041be8664b76ea81b327f4a371acd25710269ed30cada3 size:
4935
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0408040007-7c7080cb
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0408040007-7c7080cb
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0408040007-7c7080cb
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0408040007-7c7080cb
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0408040006-d3bcbabc
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0408040006-d3bcbabc
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0408040006-d3bcbabc
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0408040006-d3bcbabc
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageWriteIT >
testBigQueryStorageWrite30MProto FAILED
java.lang.RuntimeException at BigQueryIOStorageWriteIT.java:101
org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamIT >
testReadSpannerChangeStream FAILED
java.lang.IllegalArgumentException at SpannerChangeStreamIT.java:139
org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamTransactionBoundariesIT
> testTransactionBoundaries FAILED
java.lang.IllegalArgumentException at
SpannerChangeStreamTransactionBoundariesIT.java:145
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:264
49 tests completed, 4 failed, 3 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408035737
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d56a71f02a1b6e015041be8664b76ea81b327f4a371acd25710269ed30cada3
Deleted: sha256:dd7ace85ed4ac96e28be7235c5bf7c9b6bf071eed9082ae2140c1bd590383c77
Deleted: sha256:3f5d2b9921eabd2d37ec9be21e852927dad0e94f3b9aab681a5913eb34a39a17
Deleted: sha256:6308480ecede7874f1747af123d4cdb3c9595b3d0bba94b988d592f7e5dad812
Deleted: sha256:52c60c5b502cefc09be385681136238a5001ae10b27c1d102f0a9505bc4651fb
Deleted: sha256:17288553b460da995e8e683c2a95b1a2e27e0ba01a885f7e31b43c2233169f7e
Deleted: sha256:d876fcbf4247846b874b37972f58e6b962e37f8e7961f06373cf2bea17053570
Deleted: sha256:7970fded7f93df565d1cf39b36b02310912f70db24ccff64ec37e1db10905a85
Deleted: sha256:fe19bc0cca95373e109b01783ab86188fcbbb7a07df4470b88ccaa2c1c465a90
Deleted: sha256:96e961e68651d6096133e8c38747816b5bce6d8d445c76f6c353468d1fc58561
Deleted: sha256:b64871a529c78167f33ad4478690d628cb2d281986c6e6a6b5d9f39533196ac5
Deleted: sha256:fb095be2610687da46664358a798142c4bcb05e40ea5b954854301be766a8723
Deleted: sha256:689d041f4d876be6268cfc55272fee0167e36990a0aba78bafe1ed0e0b6f8159
Deleted: sha256:b45ad97049e7b26d9bb18f5d817db085d3f8cd1fa62bbad6dd89c38142aa56a9
Deleted: sha256:0053bcef659da318f78ccf60b3f426c6fbf2dfeaab44b57c9426a3c6c2f918fe
Deleted: sha256:f63f113fc3cbaefa478f32c0976a6df7649569a3036dbc828df76762628c4106
Deleted: sha256:1ac0fe59edc59606522d13a3820b1d39e372b00a3bdaee77c0188b781320c3d9
Deleted: sha256:1a66a99a92caedb12c388f652a800c20d3a17f4f7d368d3444e55c934db22bc3
Deleted: sha256:95990310df07f40ac15ac17754aaa869533739e5dafadeb4ed7b7975d1bc2e67
Deleted: sha256:665e3ce0775e07a3de9825358c500a8de4889c771cf0621ce1b8f43ec52daf10
Deleted: sha256:0c60c6f20b067077c53107aee57c116528da1ad1d3ea20fab8bd309edcdf1ad3
Deleted: sha256:63c162d6cb989dd9f73f8e366a4374fffd5336396b00fbd546a76f5b54940121
Deleted: sha256:9438e65bcc754a540c246f57b5dd10d1f48dc89b4f288f8634c52006e783be82
Deleted: sha256:4d73c737c1292cdd369c007a497519da1b2b333ae718e3f4b3a93aea7f079599
Deleted: sha256:617160d00a4a4aa1ee0d5a1807a9806116c7605c4cc81127c74f7e6ab257ed21
Deleted: sha256:61813ea2fd7778629b08e5acfc9beb1f0884080f44ad38bb4b981a69360e74d1
Deleted: sha256:ac8abcc03326d54f98313c7179edb7c1d1251f3c659bbc29157a4a25105e9fd2
Deleted: sha256:ec7365bd2ddae48b7b0acab7fc969f1cc1c4f430e03db63542923545d67dc20f
Deleted: sha256:c1af766b9d61685cc0a9f9f6302c37ac01ea3ed4178d05c90101398afc3bcac8
Deleted: sha256:360b3a1a1e94682f24cff34905a4bbdfaf8056458810db18568532c12f90603c
Deleted: sha256:5e242fc81a0151d2ac4178d27d09d795134d0bac30fa861923de85070406363c
Deleted: sha256:bde5a6024e807b7e7b793e4f89aa69f0d3559d602fada05d99e9cf7efe48d1e2
Deleted: sha256:857674e01046845fcea5d9eb1d4ed832a7272d6dd3522e19d3dd37e142858078
Deleted: sha256:bcf336073f5c2e9bf601376d65b578d9970c4d7a5a6a80765d5888cb01d28f9f
Deleted: sha256:0cb6817429c2e1b7e7f4cdff8a54f133fc34e699907091d3cbd55578c80986cb
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408035737]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d56a71f02a1b6e015041be8664b76ea81b327f4a371acd25710269ed30cada3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408035737]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d56a71f02a1b6e015041be8664b76ea81b327f4a371acd25710269ed30cada3])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d56a71f02a1b6e015041be8664b76ea81b327f4a371acd25710269ed30cada3
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d56a71f02a1b6e015041be8664b76ea81b327f4a371acd25710269ed30cada3
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7d56a71f02a1b6e015041be8664b76ea81b327f4a371acd25710269ed30cada3].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 35m 21s
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/nk7c5ty6nostw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
