See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/1790/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13679] playground - move quick start category to the top
(#16808)
[noreply] Update license_script.sh (#16789)
[noreply] [BEAM-13908] [Coverage] Better testing coverage for gcpopts (#16816)
[noreply] Merge pull request #16809 from [BEAM-12164] Added integration test for
------------------------------------------
[...truncated 42.70 KB...]
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.0.3 setuptools-60.8.2 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.1 tenacity-5.1.5
Executing python
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 220 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 29.48456 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ tee /output/licenses/list.csv
+ go-licenses csv github.com/apache/beam/sdks/java/container
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
c367ec3baa3e: Preparing
18f3b74c60f4: Preparing
7644b6798372: Preparing
679de3266499: Preparing
6a425a5e15d2: Preparing
3f9065c75f17: Preparing
2d6b705ef526: Preparing
1f0f3ad3372a: Preparing
e3ca3e271516: Preparing
746bca0dd669: Preparing
adce98262a3d: Preparing
ff8b2c62764c: Preparing
8466f8577e10: Preparing
f53ed9ea8a10: Preparing
6be21046fcff: Preparing
1e5fdc3d671c: Preparing
613ab28cf833: Preparing
bed676ceab7a: Preparing
6398d5cccd2c: Preparing
0b0f2f2f5279: Preparing
ff8b2c62764c: Waiting
8466f8577e10: Waiting
f53ed9ea8a10: Waiting
6be21046fcff: Waiting
1e5fdc3d671c: Waiting
613ab28cf833: Waiting
bed676ceab7a: Waiting
6398d5cccd2c: Waiting
0b0f2f2f5279: Waiting
3f9065c75f17: Waiting
1f0f3ad3372a: Waiting
2d6b705ef526: Waiting
e3ca3e271516: Waiting
746bca0dd669: Waiting
adce98262a3d: Waiting
6a425a5e15d2: Pushed
18f3b74c60f4: Pushed
7644b6798372: Pushed
c367ec3baa3e: Pushed
679de3266499: Pushed
3f9065c75f17: Pushed
1f0f3ad3372a: Pushed
e3ca3e271516: Pushed
746bca0dd669: Pushed
ff8b2c62764c: Pushed
f53ed9ea8a10: Layer already exists
6be21046fcff: Layer already exists
1e5fdc3d671c: Layer already exists
2d6b705ef526: Pushed
613ab28cf833: Layer already exists
bed676ceab7a: Layer already exists
0b0f2f2f5279: Layer already exists
6398d5cccd2c: Layer already exists
8466f8577e10: Pushed
adce98262a3d: Pushed
20220211060107: digest:
sha256:2302dde1a5b08956ac7b9549c1087d2c8116d657280665e853ef6ef069279398 size:
4520
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0211060502-4f498d12
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0211060502-4f498d12
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1644559492771.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0211060502-4f498d12
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0211060502-4f498d12
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1644559492771.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0211060501-def8e3e0
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0211060501-def8e3e0
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1644559492347.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0211060501-def8e3e0
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0211060501-def8e3e0
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1644559492347.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2EBigQueryTornadoesWithExport FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
java.lang.RuntimeException at BigQuerySamplesIT.java:108
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApi FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
8 tests completed, 4 failed
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220211060107
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2302dde1a5b08956ac7b9549c1087d2c8116d657280665e853ef6ef069279398
Deleted: sha256:1316360e42336d9c7af7d3e52427083384f5fa13c2855f3e633e053227bd3d15
Deleted: sha256:0f49467bfb3ea8ee5bd97c852df979491edb85e49748a9f8313a2a04f50cd0b4
Deleted: sha256:98891fe1f1a6ba2b83dd742b6d1957bb968aa7353b8d7704d6907543530362fd
Deleted: sha256:68c02a84f86da622238073f40b26e2d60587ee58fa34f4546af694b69875b6b7
Deleted: sha256:fca4d481428151f50d2c918b4259398c93e7dc26c42cd874a37b02e1a3302917
Deleted: sha256:fa57d8a8d9ad6da114bb43d444adc14848af2d5e5681b61bd6e1f5e6995e86bf
Deleted: sha256:3475d9dd14de350d31dab7b67d9c7deeaff774c9472b2e0bb3b8a76fcbf6407a
Deleted: sha256:390a77bfc95f60a7044452b5a74a68abcc1552e31c67daa4a1d6b299df1d1de9
Deleted: sha256:0dafa4336ff9698501b3df6b91864e8ab713f1c8150b439b767198b3556fb31d
Deleted: sha256:a069634b2c3ccfc48577843c20c5008406e80d0ca010accfba7585dd48246b4c
Deleted: sha256:ded4b9af79dea02bdcc511ed8e589293a1666e5dc287476326e5ecc6b4462ed5
Deleted: sha256:5738e9df22133f0236ac299a3efac638a331fd2da860ff5e6d5b2680f7797893
Deleted: sha256:af24e1ccbe84f6837e5df1a7befbee4327e29b33e21fe67924b7904fbe53b6fd
Deleted: sha256:dba212489bd3185ba8efb8fa6e7ac05beab16c62ae9dfc83f81b973aef0ffa8f
Deleted: sha256:2694bd1f3f2f5b958e5e8cb0426ecde4495337718a681b8b7bc28b2f90210b4f
Deleted: sha256:297de60cdab807feb61c7eb7c50fc0a3fa0705ea99da9a71d6484555b15fe74b
Deleted: sha256:919cd1019eae98c6657e4c569f9d1a57fcf9cfc209b7f85f2337cfb2e644af29
Deleted: sha256:c82417dd1851e06f85f42c3e4625555513fabdb26a0e7a71a6f17c88bf78a75d
Deleted: sha256:9395a279460a957af0e116c4c2e672283350e4a984728f5172feb4917db1000d
Deleted: sha256:640e7c4090f079a8088435768c1cde65471aff248f44c0d7edc394fd1c30fdab
Deleted: sha256:639e994f8d88e7b5203f873aaeccd7f4da6b23c8eed252b1cad0671d453348c3
Deleted: sha256:15f6ede87ceaf23a1aef3db2603cc875e1afc9acdcfe903a8e40285ffc499b4b
Deleted: sha256:7efbf83ffef7df5f71820cf44a238fac8b9d80e95f3aa48a7fe078b51345a04c
Deleted: sha256:cb62b1f1e486e5037d518053b56b7cf611dfd52ba44a7d337d025c4622a4a802
Deleted: sha256:208c510f1a990f48cf8116a77f540101c8512853f107a4acf453ec23dc9ad4c1
Deleted: sha256:9ac8d4319a33136700f171bc0b5672b8cff5328f7d3824e5de270f06ba657389
Deleted: sha256:3ed6d10b6e5297266ae42cedfb3c1aed093c5fca4946cc5dc48f9d80d97d8928
Deleted: sha256:00ded68ef057652cc64da24cb2e3d712de554235f75b1f68557bebc0defa73a1
Deleted: sha256:2a46d70b9853e022c9b5001aef5ce7d195bd05d20a6f254ac2dda9ae3ffb591f
Deleted: sha256:b52b39bf7dec329d8edef14dcf5eca44c2c71ee625c4f68accf43984f4a09b2c
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220211060107]
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 294
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 38m 45s
112 actionable tasks: 73 executed, 35 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/qfhtrslkxcv22
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
