See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1855/display/redirect?page=changes>
Changes:
[egalpin] Use default context output rather than outputWithTimestamp for
[stranniknm] Palo Alto case study - fix link
[rogelio.hernandez] [BEAM-12777] Removed current docs version redirect
------------------------------------------
[...truncated 68.50 KB...]
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for grpc-auth-1.43.2:
https://opensource.org/licenses/Apache-2.0. Retrying...
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for grpc-auth-1.43.2:
https://opensource.org/licenses/Apache-2.0. Retrying...
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 85.528159 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
5c324e4d2f3f: Preparing
e7358bba475f: Preparing
4107b9b9e742: Preparing
86e1929ca6b5: Preparing
7bbc1f4e413c: Preparing
6678a66f4d4f: Preparing
7cba26f07e5d: Preparing
7d96a4c2e81c: Preparing
ab95aea5be7c: Preparing
d3a585790bc8: Preparing
5a24464b956f: Preparing
feade76e385a: Preparing
8986f06f2cc0: Preparing
f53ed9ea8a10: Preparing
6be21046fcff: Preparing
1e5fdc3d671c: Preparing
613ab28cf833: Preparing
bed676ceab7a: Preparing
6398d5cccd2c: Preparing
0b0f2f2f5279: Preparing
ab95aea5be7c: Waiting
d3a585790bc8: Waiting
5a24464b956f: Waiting
feade76e385a: Waiting
8986f06f2cc0: Waiting
f53ed9ea8a10: Waiting
6678a66f4d4f: Waiting
6be21046fcff: Waiting
7cba26f07e5d: Waiting
7d96a4c2e81c: Waiting
6398d5cccd2c: Waiting
1e5fdc3d671c: Waiting
0b0f2f2f5279: Waiting
bed676ceab7a: Waiting
e7358bba475f: Pushed
7bbc1f4e413c: Pushed
86e1929ca6b5: Pushed
4107b9b9e742: Pushed
5c324e4d2f3f: Pushed
6678a66f4d4f: Pushed
7d96a4c2e81c: Pushed
feade76e385a: Pushed
d3a585790bc8: Pushed
7cba26f07e5d: Pushed
5a24464b956f: Pushed
ab95aea5be7c: Pushed
f53ed9ea8a10: Layer already exists
6be21046fcff: Layer already exists
613ab28cf833: Layer already exists
1e5fdc3d671c: Layer already exists
6398d5cccd2c: Layer already exists
bed676ceab7a: Layer already exists
0b0f2f2f5279: Layer already exists
8986f06f2cc0: Pushed
20220301180115: digest:
sha256:1118696392d2ef762cdab3b00f4ce67f98840b5ce6784f12423491b8489d2f7f size:
4520
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0301180457-828b03fa
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0301180457-828b03fa
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1646157892369.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0301180457-828b03fa
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0301180457-828b03fa
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1646157892369.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0301180457-2dbaae81
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0301180457-2dbaae81
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1646157892360.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0301180457-2dbaae81
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0301180457-2dbaae81
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1646157892360.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
java.lang.RuntimeException at BigQuerySamplesIT.java:108
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApi FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
8 tests completed, 3 failed
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220301180115
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1118696392d2ef762cdab3b00f4ce67f98840b5ce6784f12423491b8489d2f7f
Deleted: sha256:e5382874de77c467c3d03d0b770d018d7c19026ef82b9e00135a008760e9b9d5
Deleted: sha256:45b6f06cbf7f8b7531ae948965f6c708b43c160827a75fd8a716cda2c587b26a
Deleted: sha256:5ecb4d23189a9a27f1e6a8fdd2a6612439ed2a4935b3aa6b97be5bf3f797d1c7
Deleted: sha256:9fb3251687340353e08a91aa288b5dc5f2cbeec9ff7663bc5489be2fb06b6b13
Deleted: sha256:dcdc34b8199daf3ebfd005b0a0be79f2610878a788f6c3692603d72762b311d6
Deleted: sha256:30a3b6cd04ec9e93b13128b6fe5d3f24ba39dd77d025257f7c995b3420b24fba
Deleted: sha256:59a63fae443b20b199ae481a4e85e4835418cee9334e6949be048b50f4022b78
Deleted: sha256:5203f603d4b6804c6c12c51a0db40c90925e877ede9554dcacd76653a55bd13d
Deleted: sha256:0a21d37a9443325528bbfe73b75d2c9e25ef301c92e56cf9d3e373f0efd99974
Deleted: sha256:dd7c0f6378f70605ee827e91ade74863a4fda0062fab40baad51f38449f7feea
Deleted: sha256:b174c3bbe1ffe97160b06c27f38f2639793313dbe56851cb60344b37505c73f8
Deleted: sha256:19df46be6a3f1cf54ced33859eb390fed738f2a57cb4102ae0cf03b1ba5ce476
Deleted: sha256:ad4f864b19c50a141de32cb55e1186f51e78e6abd1387efbb2aa22334362c6a8
Deleted: sha256:db631b6622b07a37ca6e4bcfbc1959ffb8651eb7381aa0107b6f78d10a387e42
Deleted: sha256:3a7098407f6d9641c26e9974d4bfef2bc77f82ac3f8501a33605cbf54c9ea309
Deleted: sha256:18f3d92835d236362dd15fa3e86227f8fb9e5407ed1b0d9c36f98ea7f71bbfe9
Deleted: sha256:2d7fcf62d8fc708dd7670f91a651415ef41cac7eec6d3c14023f41bce57c66a2
Deleted: sha256:bc317a97c2fcf71cc61906f579b9efef161b29ea09f25157a98c5cc195e3eda7
Deleted: sha256:3c47e12f4f8acd3d34e0e76c3864a743a933d44818b25ce03e5a2beaa597f4a8
Deleted: sha256:10125430cf076d4ffb0fc105860eca2e3f47cd7ea490dd27aada964dfc1af0b5
Deleted: sha256:efcfba1ffee126ed770809bd000759eecec16606393745c95dcd31dd4d63bb17
Deleted: sha256:65d63a2b2ec3cf5e1deb906cea1bdb4d5afa2bc4c330cf65154b94cdb287dfc2
Deleted: sha256:1aedb98dc50f2cb1072dc8381bb1aae1ae2b2fe6edeb7c92f774bc45250112b0
Deleted: sha256:800a4f827bc820dd0cc92a447bfd2928ab884bee87f9f79826530591afb7322d
Deleted: sha256:6a2335823de0a6d63572e629b3d1c9bb39b47335564c5f7fa224c901277e11b3
Deleted: sha256:4b319856a65050fc4cd64ee041a6c8272cdca6d604902b55361e320c80e4d1b3
Deleted: sha256:411653baace8ddc1dc02bd35919559a41cc83e95f3ffcf1412271c2b34959dd7
Deleted: sha256:f7d3dba60af1c344cc63c117301fec8cf174412cf6c20338e97160b85e376927
Deleted: sha256:ee23111465ceb87ce58ed45bc8ac4ae39326ebc11f0d4d9fa2c378d92d069dcd
Deleted: sha256:ce11cf83cc679e598324c91265dedc09db29c45647c8f70796fb84f20a7fba43
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220301180115]
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 294
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 34m 35s
112 actionable tasks: 73 executed, 35 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/u7m2usalm3cyq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
