See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1161/display/redirect?page=changes>
Changes:
[mmack] [BEAM-8806] Integration test for SqsIO using Localstack
[noreply] Merge pull request #16507: [BEAM-13137] Fixes ES utest size flakiness
------------------------------------------
[...truncated 52.12 KB...]
> Task :sdks:java:container:pullLicenses
Uninstalling pip-20.2.3:
Successfully uninstalled pip-20.2.3
Attempting uninstall: setuptools
Found existing installation: setuptools 49.2.1
Uninstalling setuptools-49.2.1:
Successfully uninstalled setuptools-49.2.1
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :examples:java:compileJava FROM-CACHE
> Task :examples:java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar
> Task :examples:java:jar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :examples:java:compileTestJava FROM-CACHE
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :sdks:java:io:google-cloud-platform:testJar
> Task :sdks:java:container:pullLicenses
Successfully installed pip-21.3.1 setuptools-60.5.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, tenacity, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.1 tenacity-5.1.5
Executing
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python>
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
INFO:root:Pulling license for 213 dependencies using 16 threads.
INFO:root:pull_licenses_java.py succeed. It took 10.72836 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
4a9c70268cd1: Preparing
1500deef78d3: Preparing
5eb79da2d379: Preparing
069e04e17b54: Preparing
e0d50a7ae610: Preparing
21ab473e7ccb: Preparing
bb9e6dac6701: Preparing
036bac4c48bd: Preparing
1f39411ed182: Preparing
20cec2e33829: Preparing
92d4d9ad4c32: Preparing
98f4507e4d5a: Preparing
2ec34e0c1c42: Preparing
bff9fe6e429c: Preparing
7c245b2fe4f1: Preparing
f9e18e59a565: Preparing
26a504e63be4: Preparing
8bf42db0de72: Preparing
31892cc314cb: Preparing
11936051f93b: Preparing
21ab473e7ccb: Waiting
bb9e6dac6701: Waiting
036bac4c48bd: Waiting
1f39411ed182: Waiting
20cec2e33829: Waiting
92d4d9ad4c32: Waiting
98f4507e4d5a: Waiting
2ec34e0c1c42: Waiting
bff9fe6e429c: Waiting
7c245b2fe4f1: Waiting
f9e18e59a565: Waiting
26a504e63be4: Waiting
8bf42db0de72: Waiting
31892cc314cb: Waiting
11936051f93b: Waiting
e0d50a7ae610: Pushed
1500deef78d3: Pushed
5eb79da2d379: Pushed
069e04e17b54: Pushed
4a9c70268cd1: Pushed
21ab473e7ccb: Pushed
036bac4c48bd: Pushed
20cec2e33829: Pushed
98f4507e4d5a: Pushed
bff9fe6e429c: Layer already exists
7c245b2fe4f1: Layer already exists
f9e18e59a565: Layer already exists
1f39411ed182: Pushed
26a504e63be4: Layer already exists
8bf42db0de72: Layer already exists
11936051f93b: Layer already exists
31892cc314cb: Layer already exists
bb9e6dac6701: Pushed
2ec34e0c1c42: Pushed
92d4d9ad4c32: Pushed
20220117120052: digest:
sha256:4d68525de458dfed133d1d4f3ed5db5f5904c2a8899ec5160546b73555d7d1a8 size:
4520
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0117120435-bbaa54d7
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0117120435-bbaa54d7
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1642421055479.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0117120435-bbaa54d7
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0117120435-bbaa54d7
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1642421055479.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0117120436-ac5f644
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0117120436-ac5f644
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1642421055540.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0117120436-ac5f644
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0117120436-ac5f644
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1642421055540.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:264
38 tests completed, 1 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220117120052
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d68525de458dfed133d1d4f3ed5db5f5904c2a8899ec5160546b73555d7d1a8
Deleted: sha256:0378bca6d1e7e768f9ccf4f8552573c2c4638b8cf3b08bc8a647a8195e27dd8a
Deleted: sha256:6d260ca144a01faa9f92b088e9459b0ce06588dcfe425aca0c1fbb287374cc45
Deleted: sha256:e2903f7e5eb0f80988c86b211c1b3784f1f4a22638b70e02d2ff67f4dc3323d1
Deleted: sha256:4eceb3fac152f437efb0b3d9f2ec3287627b3202360b835c1cbff7f84c080f2f
Deleted: sha256:dd37a4af4814541b66e29e42b38eaf7cad2a3e8d4ac3a1c7db7f2184c89c6616
Deleted: sha256:b0a1804a6852fbe879af30662245bcf6e2f5f06c05bb4af5f3d1ac238107fd87
Deleted: sha256:c6a2d69eb413e24fc0997855378e8a57f94ee34f2912c01409d0f1c6bfa4a1e7
Deleted: sha256:7d452c292e8d69cca5258bb8eebeab226c0d6f93c8eeccfbee15db65fec2747c
Deleted: sha256:40cba736960d3149d4c4dda0fd499e37a69abc865fa4c556b4e2688be6ec6430
Deleted: sha256:6623d45f5721b909a7db21ccb5209d8af2f94b75a19b670ea9457a05a7a46fde
Deleted: sha256:781b3803c4e2854955adb9470394d8f520afe95086d8e9cc9691c3ce8d9790b1
Deleted: sha256:63890c82b9a2a905a30a807be6d8aee5bfc16e00e64a879ccca95606628e165f
Deleted: sha256:1cbd7ec25e757970b7dc5ad57aa8dc645e5ac1989dbe768f069b3aa4151a71b7
Deleted: sha256:2464b9eecb7310e2c7e97cf7ce0b56d1715bd66666e9f29149905029db384bd9
Deleted: sha256:dcfc69fb5c086577de808d1ce91eca4e7ada5b2767dcb7ee3889280416182692
Deleted: sha256:1ee32a44121484de1931c339f654b32787f30b7b27acb2d811436a4a303a46c5
Deleted: sha256:4074854ba02147f2e5ed8b49de58119ff4a6bc4e590d3fec3a5866eb353fd735
Deleted: sha256:36eb6460442e2d9d8db6cc971dd58cdf27e74ced141148afe12a7b21749bbf5d
Deleted: sha256:ce931d54fd7a7c27ed7f2cddc78cc0969f10c48da595758234b0be6037e60741
Deleted: sha256:453d6d4711949aedd415849c93acefa752ade6d4a0adb920718e5841e77e3f06
Deleted: sha256:b2d327621269347a0005121a1ca71aed2e47c8cb0c30d3f536a370ce7a12d0bd
Deleted: sha256:bc0a87576e50b433a5ad684c8869079dc5f295c91364ab8f1c3133267235b24f
Deleted: sha256:9dec464a6843adb001a2d0977b4c81fba427c972eb1563200b989228b2f3421e
Deleted: sha256:ceed54fa2ffbd92e074933abfe1f4ef348ea31ff8ea95ba24e418eb782690f08
Deleted: sha256:7f5c00ac93852686a9ecc235440c7eb373408553050ea8e30bffd2e2ab9653a7
Deleted: sha256:22b0daf1877c896c3e290e327a587897a5261f2a30d208ff56a379b82bf30292
Deleted: sha256:316827163d842ecaf7b99eff9eb9f7eb549f174707e1c0c3e397bfe16ac730a2
Deleted: sha256:a525b7e0b46d9a664aa363b8f2a4b62f207c8a6b310a8d90d59b118df0e1d203
Deleted: sha256:933f16cb2b254073b3ba27d651c5f712efbb573d285dba9efdcf387c7a5d467d
Deleted: sha256:70b8f6b61d18201a371ceb268a0bf8a22a6ad08c74362af17f7f95cd298ab003
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220117120052]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d68525de458dfed133d1d4f3ed5db5f5904c2a8899ec5160546b73555d7d1a8]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220117120052]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d68525de458dfed133d1d4f3ed5db5f5904c2a8899ec5160546b73555d7d1a8])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d68525de458dfed133d1d4f3ed5db5f5904c2a8899ec5160546b73555d7d1a8
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d68525de458dfed133d1d4f3ed5db5f5904c2a8899ec5160546b73555d7d1a8
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d68525de458dfed133d1d4f3ed5db5f5904c2a8899ec5160546b73555d7d1a8].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 42m
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://scans.gradle.com/s/6nxm76hf6pwby
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]