See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1445/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-14225] load balance jenkins jobs
[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by
[noreply] [BEAM-14192] Update legacy container version (#17210)
[noreply] Fix mishandling of API with BQIO (#17211)
[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features
------------------------------------------
[...truncated 54.49 KB...]
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.0.4 setuptools-61.3.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.1 tenacity-5.1.5
Executing python
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 224 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 8.038344 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
61ec6357dc99: Preparing
2a4e369c158f: Preparing
320061579d7a: Preparing
aaad475cbe9f: Preparing
dacdee7ba71d: Preparing
be46be2052bc: Preparing
60c2dae3eebe: Preparing
08605be4f846: Preparing
19d5a00108bd: Preparing
9a48c0b38315: Preparing
52067abf54f2: Preparing
b906682774c1: Preparing
aebf7561d6fe: Preparing
17a3099613a2: Preparing
fa561b8d332b: Preparing
7494d840ea88: Preparing
357cc1947e95: Preparing
b0dc1a441986: Preparing
7a7698da17f2: Preparing
d59769727d80: Preparing
348622fdcc61: Preparing
4ac8bc2cd0be: Preparing
be46be2052bc: Waiting
60c2dae3eebe: Waiting
52067abf54f2: Waiting
fa561b8d332b: Waiting
b0dc1a441986: Waiting
9a48c0b38315: Waiting
7a7698da17f2: Waiting
b906682774c1: Waiting
7494d840ea88: Waiting
17a3099613a2: Waiting
357cc1947e95: Waiting
19d5a00108bd: Waiting
aebf7561d6fe: Waiting
4ac8bc2cd0be: Waiting
d59769727d80: Waiting
08605be4f846: Waiting
348622fdcc61: Waiting
dacdee7ba71d: Pushed
320061579d7a: Pushed
2a4e369c158f: Pushed
aaad475cbe9f: Pushed
61ec6357dc99: Pushed
60c2dae3eebe: Pushed
08605be4f846: Pushed
9a48c0b38315: Pushed
19d5a00108bd: Pushed
be46be2052bc: Pushed
b906682774c1: Pushed
7494d840ea88: Layer already exists
357cc1947e95: Layer already exists
52067abf54f2: Pushed
b0dc1a441986: Layer already exists
7a7698da17f2: Layer already exists
d59769727d80: Layer already exists
348622fdcc61: Layer already exists
4ac8bc2cd0be: Layer already exists
17a3099613a2: Pushed
fa561b8d332b: Pushed
aebf7561d6fe: Pushed
20220401215759: digest:
sha256:2dd2f2cec1c1b375651b427d62f9ed8a29f8f6935f614245f74020379fee0529 size:
4935
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0401220005-8d6cb6c2
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0401220005-8d6cb6c2
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0401220005-8d6cb6c2
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0401220005-8d6cb6c2
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0401220005-c26a2a52
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0401220005-c26a2a52
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0401220005-c26a2a52
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0401220005-c26a2a52
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageWriteIT >
testBigQueryStorageWrite30MProto FAILED
java.lang.RuntimeException at BigQueryIOStorageWriteIT.java:101
org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamIT >
testReadSpannerChangeStream FAILED
java.lang.IllegalArgumentException at SpannerChangeStreamIT.java:139
org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamTransactionBoundariesIT
> testTransactionBoundaries FAILED
java.lang.IllegalArgumentException at
SpannerChangeStreamTransactionBoundariesIT.java:145
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:264
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED
java.lang.RuntimeException at SpannerReadIT.java:288
49 tests completed, 5 failed, 3 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220401215759
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dd2f2cec1c1b375651b427d62f9ed8a29f8f6935f614245f74020379fee0529
Deleted: sha256:1adf16d9eb34950334f5cd0840c7902599aed753504f258dc6761652d8ea9e99
Deleted: sha256:081df7791917cdd347252c94691e3e1f7a34af2f34833938268295333d6006ad
Deleted: sha256:60da0c986d63fda50bf265b8b048ea04ca57c1ffd8a7f528c604a7f5da88f1f6
Deleted: sha256:9265abb9fbe560be3c25e6671fa90b2a104c711c5586a1419668b3f5dd00533b
Deleted: sha256:4e9171c951f13e0c64c57a7808a675f05505f3560930877d27f6e325ec465f63
Deleted: sha256:64e2bdd2a986542b4c1df733cfd5a54ef1ba06c6e4929fdae5bebeb8f5f310c6
Deleted: sha256:e6cd8b2e3b278539e02ca47b48256e194d3bf3b2a513a256de99a1ca6aa7d7ef
Deleted: sha256:d70ad97b81c3119890c26a0f98fcf81d8bfaac36a32755d5cf04de90b48dae36
Deleted: sha256:54f58d2c6bb7bbf5ce0f5bc5c1fa98cc1256585842132bfea8c54b4ef2aefb0b
Deleted: sha256:c262ff0a1d59635d878603b5e5717217308bfc256a5ef88e83c4ba03b13641a0
Deleted: sha256:bae96d8bd09df74b1dc2179b256b632ecfb4fa2758e9f51a18fdfa6c59248a55
Deleted: sha256:e47e1f255bcb55388e58bc8a9007286d5a3139e5360e3c80901ec16a9ee3ecd4
Deleted: sha256:7af08f3a491da3b111f382b71092d40ff261effc5bd5ae237b402ddda2e20312
Deleted: sha256:f001741f4a770627c594c2677eb93d2d2734f149eedae197bc010f137b2a01e9
Deleted: sha256:68ad2a635b66a849b5caba301a8876863a841424f9d21b629581bc22ca45ebfa
Deleted: sha256:781a096291e261b86ae5cbeaa2793e846e823343dfcca854be1df83f3347f658
Deleted: sha256:cdb76717a25331b4158b8e76e9132cefa0ecc3c3a8d0f847b23b49345ed4cf76
Deleted: sha256:a85deaa50aaf9b051960a40498746c1b34509d29855b419956dff57ae4a408f5
Deleted: sha256:fb4cec8b9a2b5f98d5d815dbfef7a6007a1967061591ff1999d2d6cd19c9c096
Deleted: sha256:3db6f27e75b15c9beb2e23bb03218ba922299d3d3e6c0dfc38b0bdda9329009a
Deleted: sha256:439a7553e9f1a43c04c87c6fbc6216475fd980f0c62f62423ea461917289328c
Deleted: sha256:d42bf54f601362d623ba071a97676ed3eb695a9ca98b836d5933774a6851fdb3
Deleted: sha256:9586ecbf78abf4fcd1f0f5555c7f8804fe502c70c4eba976028f27bd9851a6e2
Deleted: sha256:5dcb70c682b302ce50b5b66f7149e37881a498bf52d894fc54d6a57d176f29dc
Deleted: sha256:1cf0151fd4fe852a827232f204ca777888321d1c4d9f167453e7ed2641dd1036
Deleted: sha256:dade1ae69d6e8d9bb03d083817fce8e13c46ea9f43cd1ba0eae0189a92a124b8
Deleted: sha256:06a5bde783ee765f309a2b010e5184aaa9f68ae3b7f3137ce73b768522328cc8
Deleted: sha256:dcc8fca06ae2078564a9f763acc43a4ae2442498c3a2e042e1975af35de3064b
Deleted: sha256:9c32f3f63489c4e599fbf7c2b41713d5904b288f4ee94eb9ce2e19d7bd1068a6
Deleted: sha256:d437e04057e7c31d1bb472e2f12e26fe5cabb1bd33d4180010357747bef34021
Deleted: sha256:1e9f92b6d51468c1773208c02ec0d2c8102aa47c780771cb1e4c1f72b431142a
Deleted: sha256:c37161e3ca89adc13e5c19767e97f5a1ec84dba9f05b62a165c7eb01af449f0c
Deleted: sha256:bed7cf80cce121e6764d3ed86358d47a699b874b7a9449769ff49e6d1b688ba8
Deleted: sha256:8ba7e0fc06380c9079f7ca65834c2ac4dfd4663dcd896443fe1ee89aab0f0c19
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220401215759]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dd2f2cec1c1b375651b427d62f9ed8a29f8f6935f614245f74020379fee0529]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220401215759]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dd2f2cec1c1b375651b427d62f9ed8a29f8f6935f614245f74020379fee0529])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dd2f2cec1c1b375651b427d62f9ed8a29f8f6935f614245f74020379fee0529
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dd2f2cec1c1b375651b427d62f9ed8a29f8f6935f614245f74020379fee0529
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2dd2f2cec1c1b375651b427d62f9ed8a29f8f6935f614245f74020379fee0529].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 8m 35s
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/7u5vi3mlgsljk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
