See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/1784/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12645] Fix code-cov flakes due to monorepo. (#16925)
------------------------------------------
[...truncated 46.73 KB...]
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for grpc-core-1.43.2:
https://opensource.org/licenses/Apache-2.0. Retrying...
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for google-auth-library-credentials-1.3.0:
http://opensource.org/licenses/BSD-3-Clause. Retrying...
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 82.116394 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/sdks/java/container/build/target/third_party_licenses.>
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
> Task :sdks:java:container:pullLicenses
Finished license_scripts.sh
> Task :sdks:java:container:java11:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java11:copyGolangLicenses
> Task :sdks:java:container:java11:dockerPrepare
> Task :sdks:java:container:java11:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
38bb87b6f0da: Preparing
5ec562f2b35d: Preparing
c90ddf8637d1: Preparing
a622c073dddc: Preparing
277b93733bc1: Preparing
4cb0cc07b7a1: Preparing
b6a6297ec011: Preparing
aac0dce0f7f4: Preparing
97b11fa4c5cd: Preparing
96391edb9ad8: Preparing
3fe4567df3f1: Preparing
a551e321594d: Preparing
252b74a8101b: Preparing
fe4f44af763d: Preparing
7c072cee6a29: Preparing
1e5fdc3d671c: Preparing
4cb0cc07b7a1: Waiting
613ab28cf833: Preparing
bed676ceab7a: Preparing
6398d5cccd2c: Preparing
0b0f2f2f5279: Preparing
97b11fa4c5cd: Waiting
b6a6297ec011: Waiting
aac0dce0f7f4: Waiting
96391edb9ad8: Waiting
3fe4567df3f1: Waiting
a551e321594d: Waiting
252b74a8101b: Waiting
fe4f44af763d: Waiting
7c072cee6a29: Waiting
1e5fdc3d671c: Waiting
613ab28cf833: Waiting
bed676ceab7a: Waiting
6398d5cccd2c: Waiting
0b0f2f2f5279: Waiting
5ec562f2b35d: Pushed
277b93733bc1: Pushed
c90ddf8637d1: Pushed
a622c073dddc: Pushed
38bb87b6f0da: Pushed
4cb0cc07b7a1: Pushed
aac0dce0f7f4: Pushed
96391edb9ad8: Pushed
97b11fa4c5cd: Pushed
fe4f44af763d: Layer already exists
7c072cee6a29: Layer already exists
1e5fdc3d671c: Layer already exists
b6a6297ec011: Pushed
613ab28cf833: Layer already exists
bed676ceab7a: Layer already exists
0b0f2f2f5279: Layer already exists
6398d5cccd2c: Layer already exists
a551e321594d: Pushed
252b74a8101b: Pushed
3fe4567df3f1: Pushed
20220223180113: digest:
sha256:39f35e37b227a7d10000a89649c7c85db93ee8e993943aa1607093992ce969ae size:
4520
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0223180450-eb2bb41e
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0223180450-eb2bb41e
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1645639483234.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0223180450-eb2bb41e
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0223180450-eb2bb41e
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1645639483234.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0223180450-396de593
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0223180450-396de593
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1645639483287.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0223180450-396de593
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0223180450-396de593
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1645639483287.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
java.lang.RuntimeException at BigQuerySamplesIT.java:121
8 tests completed, 1 failed
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220223180113
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:39f35e37b227a7d10000a89649c7c85db93ee8e993943aa1607093992ce969ae
Deleted: sha256:7684734ce8178d369f4f8608c2fd696b6ae77a2f4b978b04063bc2d1e6d98010
Deleted: sha256:1c7b151c36732b1ecb85b80b462823beb406c6cf6c2d50b61e90083dc40a4e3a
Deleted: sha256:cbfde87f2d46fbc5dd5e4e01aec8fb1234dcc77da06ec5503acefc448ee32f82
Deleted: sha256:825b09753840fbc60a385b3138ae31ac7afe87f4e958a508f6c0553a483702b9
Deleted: sha256:3b7a9608a46b53f0f494369e8c46e009c35fbbc7718e67accc7e08a3770abf02
Deleted: sha256:56cb35e81d33ce4b780e65287adb572db7c3b3e8c30e6aa40d6b580d3e96757c
Deleted: sha256:20db9c57d85b9781a2e992c8824cde28fe79da4b1282bf5960c09aa930ea7aea
Deleted: sha256:daacdbb3a3c59fddd6c41bf323827bf3f99b3d5f70fee4d9ca8e6cf93e68e1e9
Deleted: sha256:5f7738446b729b02c15fc8bbb0f319200ebed0442e1fab16e1f78b6f380d8f0b
Deleted: sha256:f40743ddbed3e26a85c3bf37be5bde4f8384dc812d89542b45ecc3962a066499
Deleted: sha256:d939474b3fb414fbd3a2c74a08df51769a35c99cf82dad71780e049415ec144b
Deleted: sha256:cca897fcf8f92c4f7e601f467c4ca15f98142e890de2d4297258ec4beede07a2
Deleted: sha256:58a8f0435ab337f8ecc8d9e73b7e40ae236333e01a1efc3e5f5ae63a398526df
Deleted: sha256:9328a8a1a314704f128b0f05f684e6d855bae47bbd25ef619cad7520ec672ba7
Deleted: sha256:f7ef2d8a5022d5ee2983f30498dedaaaa3ac38dd80f13881cf516774b9349da9
Deleted: sha256:599c9360154f70338a871ae32e4e7b9ce68b877a0859e4e4d533a009cae8e1fe
Deleted: sha256:623fe388713953e98f19a93ef3ebb6f97f0f8a1fd9f74e17f7aa1baed74bdeea
Deleted: sha256:56db208cac9e3a1f2ec0d18a1df4baead9dc5bd47b66669499bb516130f71f5b
Deleted: sha256:9dfe39fec2b17b6654a5b225fd1e659d7ddecb8dac2fc123f036c2f3423e0181
Deleted: sha256:feb89bd1c8d321abb86421c5ae3f1f9b9ee90b508f4cbd08620dda332a9e0ff4
Deleted: sha256:bdf8e9b858fbb4a1f8dda96620a126fb4fddba7087d480c6ac192350ee0c373b
Deleted: sha256:71e0072cc3366fb81a5cf952925ae3aa80cae4d860cedf4f5f0ab72f670b6a2d
Deleted: sha256:8ccfb308fda408198f9fdb2557c1ed27d734f65940068021e5faf7017e23372f
Deleted: sha256:6123c1e2264d1a77f8f1f85a68c2b59e956a02b4b6e03b3f982eca11a52f230b
Deleted: sha256:30c7bedfe48c084e7dfa17691c6fa91a9f68abd70d7f7d3f36aa57517ee00457
Deleted: sha256:be5a6f682caf7276aa82a7bb9e70b481cdb00d158fe505c2c000ec95726c5882
Deleted: sha256:1a946bf329406001ec66061ae3da436d0da7cc5d64d73d0c462f0731d6981c2b
Deleted: sha256:326b8e983e78e6176db1a78b75e25df1dfabb1ebca829fb4968662f6479d8c57
Deleted: sha256:b6606f264ea9f15df8937a388571bfa59d49259395a282b8b2db3fdae646e933
Deleted: sha256:99c99bfff9aa276e1cbc937f3dfc59397394949b987305ecef2084226799e7d9
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220223180113]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b28e2a55bed5514bb2ff0b4b0c30e4cb0b7fb915a23775d45db4929382eeeb98]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220223180113]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b28e2a55bed5514bb2ff0b4b0c30e4cb0b7fb915a23775d45db4929382eeeb98])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b28e2a55bed5514bb2ff0b4b0c30e4cb0b7fb915a23775d45db4929382eeeb98
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b28e2a55bed5514bb2ff0b4b0c30e4cb0b7fb915a23775d45db4929382eeeb98
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b28e2a55bed5514bb2ff0b4b0c30e4cb0b7fb915a23775d45db4929382eeeb98].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 32m 53s
88 actionable tasks: 53 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rfyogmjb6qxs6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
