See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1767/display/redirect?page=changes>
Changes:
[noreply] Modified KafkaIO.Read SDF->Legacy forced override to fail if
configured
------------------------------------------
[...truncated 52.29 KB...]
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.1.2 setuptools-62.6.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.2.post1 tenacity-5.1.5
Executing python
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 242 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 7.740079 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due
to the following reasons:
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:downloadCloudProfilerAgent' without
declaring an explicit or implicit dependency. This can lead to incorrect
results being produced, depending on what order the tasks are executed. Please
refer to
https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
- Gradle detected a problem with the following location:
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target'.>
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:pullLicenses' without declaring an
explicit or implicit dependency. This can lead to incorrect results being
produced, depending on what order the tasks are executed. Please refer to
https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
> Task :release:go-licenses:java:dockerRun
go: downloading github.com/golang/protobuf v1.5.2
go: downloading google.golang.org/grpc v1.44.0
go: downloading google.golang.org/protobuf v1.27.1
go: downloading google.golang.org/genproto v0.0.0-20220302033224-9aa15565e42a
go: downloading golang.org/x/net v0.0.0-20220225172249-27dd8689420f
go: downloading golang.org/x/sys v0.0.0-20220227234510-4e6760a101f9
go: downloading golang.org/x/text v0.3.7
go: added github.com/apache/beam/sdks/v2 v2.39.0
go: added github.com/golang/protobuf v1.5.2
go: added golang.org/x/net v0.0.0-20220225172249-27dd8689420f
go: added golang.org/x/sys v0.0.0-20220227234510-4e6760a101f9
go: added golang.org/x/text v0.3.7
go: added google.golang.org/genproto v0.0.0-20220302033224-9aa15565e42a
go: added google.golang.org/grpc v1.44.0
go: added google.golang.org/protobuf v1.27.1
+ go-licenses save github.com/apache/beam/sdks/v2/java/container
--save_path=/output/licenses
W0621 03:58:47.342653 29 library.go:94] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0621 03:58:53.205821 188 library.go:94] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
5a7c2666c144: Preparing
ac325a8f2bdb: Preparing
7c064349a17d: Preparing
09ee1669238f: Preparing
36205183b2e6: Preparing
69425263b1bc: Preparing
957f961d607c: Preparing
30b8f9c29465: Preparing
901d0e063771: Preparing
9de1403f1658: Preparing
66d941ca2ac8: Preparing
80175212ac20: Preparing
9092535dddb0: Preparing
d560817b10fe: Preparing
9702c574bf5d: Preparing
1cc35fbb41f8: Preparing
075d20daa2c3: Preparing
817e710a8d04: Preparing
ee509ed6e976: Preparing
9177197c67d0: Preparing
7dbadf2b9bd8: Preparing
e7597c345c2e: Preparing
9092535dddb0: Waiting
d560817b10fe: Waiting
901d0e063771: Waiting
9702c574bf5d: Waiting
957f961d607c: Waiting
9177197c67d0: Waiting
30b8f9c29465: Waiting
69425263b1bc: Waiting
ee509ed6e976: Waiting
7dbadf2b9bd8: Waiting
9de1403f1658: Waiting
66d941ca2ac8: Waiting
80175212ac20: Waiting
075d20daa2c3: Waiting
817e710a8d04: Waiting
7c064349a17d: Pushed
ac325a8f2bdb: Pushed
09ee1669238f: Pushed
36205183b2e6: Pushed
5a7c2666c144: Pushed
957f961d607c: Pushed
30b8f9c29465: Pushed
80175212ac20: Pushed
901d0e063771: Pushed
9de1403f1658: Pushed
66d941ca2ac8: Pushed
69425263b1bc: Pushed
075d20daa2c3: Layer already exists
1cc35fbb41f8: Layer already exists
817e710a8d04: Layer already exists
ee509ed6e976: Layer already exists
9177197c67d0: Layer already exists
7dbadf2b9bd8: Layer already exists
e7597c345c2e: Layer already exists
d560817b10fe: Pushed
9702c574bf5d: Pushed
9092535dddb0: Pushed
20220621035735: digest:
sha256:55aeca4bde1976a806fe0a9195b98bcc75f505615f99e248390641d0f35eb860 size:
4935
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0621035948-cfa3abed
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0621035948-cfa3abed
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0621035948-cfa3abed
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0621035948-cfa3abed
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0621035948-f0552290
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0621035948-f0552290
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0621035948-f0552290
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0621035948-f0552290
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220621035735
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55aeca4bde1976a806fe0a9195b98bcc75f505615f99e248390641d0f35eb860
Deleted: sha256:94a22d55a8f2a6717475d7b2c4193a1d27045143b81f35423b8cd3b5e6d7adb9
Deleted: sha256:1a4730a64489625ffb7feca331da35e08d8387058f25234f5651ea4ba44bb2e1
Deleted: sha256:48755d74963b0513f9e84abeb64904b7e2b143aa367680f1c264d1c185990f72
Deleted: sha256:31e6fd63507b080d2903546ddffccb1f1519771212184859d2c4407fb8022adc
Deleted: sha256:201acd654364f46ab8ff87d6a3e5c259451a028dcca84a394d5841081617a58c
Deleted: sha256:87e447b331500e53e4ce6c2c097e78b9c280622d8c531d0de87056a1984ea4a6
Deleted: sha256:01eab4319113c8948ba34035d210d6e0fe6e54044597ce6ce127d6b661a134ff
Deleted: sha256:13b78efbe41e5ffa77048041a761716a3e4bdca800e944658f5bf51e0f26b16d
Deleted: sha256:65b374db61889a025ac0b03de4a70bf9e652a2ec4f05c5f8e38d63f3e9a1be73
Deleted: sha256:9b109dc76625d6803e83e1efd0885e3f6c8cce3e90c832e2f3ef88a4e42ae937
Deleted: sha256:9569160a78ac5603d96884cbddb680c123d7a30b7e52b1175ebc8635ff709a38
Deleted: sha256:694b9b184188fd0e7db7e12c6d19be49b6d6ece53738ddae88ad34fcc55170c1
Deleted: sha256:21044dda1a6075a0b4ff23af8a0e8f467edfedd1f42a46fb33505948d4187f8e
Deleted: sha256:89a569bc468f330b3dccf546754773f089a2c48cc80b8d56f46f764ecedbe817
Deleted: sha256:cdb74d20d544ecf3ae353de06b87e7465dda4a5d86df4f6d395ca62709a348ac
Deleted: sha256:d86cda308acc77da25b48b9592f4203f89f7fc0c207d2a0ebb3be0a63a8cf656
Deleted: sha256:01766229b33aaf116bb92213576ba62e5243228d9de0ec5514981157f7fa0cd3
Deleted: sha256:03100f25f0dd80e45d161008b20a8afba8142cb7ee9d36cfb38ea072d098dbf8
Deleted: sha256:437c458f7f5a5bf107acf433ed01a9b529214650e066bd4f93b74b4a7832dd4a
Deleted: sha256:bfd86d9b77039fb87d4204c1e8a6793aa45174d82db1d3858aa766f52d6264d0
Deleted: sha256:d206ede3434f080ec4054c7e3ff58a44149604558cb1178ad01f67d14771440d
Deleted: sha256:9c30352819b32ac01a0569e992f7170a0bf080ac84026637e9ef7a09a83395b0
Deleted: sha256:39b9eb8331928ab0b0e4a62133553187b7a7192d68eb03ad12c41d328f634825
Deleted: sha256:6a648b8b6a3c9609d43f64a415ea20af37c82911c6ab7bda60e7cf2cd68b5f23
Deleted: sha256:9c0d268b8d9acf270c7b0d1af65a3aacbbea7200b7eb7959b41bb31801497d1c
Deleted: sha256:eab5fb6bdcc64b88db7947c6d68d9758876097c304ddaa3e5b0d18048ecee03c
Deleted: sha256:33d91f7d42901501ad3e04bc0063d00ddb5d709921f8f8a738ec703e5df1b9ac
Deleted: sha256:069ef0817f7d8e84d1e144d79eff20b6b66cf98c1746234348a3be85a0934d1c
Deleted: sha256:0b1706864aaddbdcb694258a85ee3dbcc0eda52c9fb7fafd4a668481b571a37d
Deleted: sha256:f3603c94651654a7e6398d936dcf11de58a6c1900f040218021b0159bef574d7
Deleted: sha256:f3d5f7fe1101bbb7e9f675f5ae130aa2e58fb9531dd0d996d5401f7930915bc1
Deleted: sha256:60d58b03e1ce560d8e5469d18e757b1d661e5a84c097c871c7c627f292c3e2e0
Deleted: sha256:7e08a4bd49886dd0f94e8c6bb0b60f89b1a95ab66dd0249f2d5a661aa4b32f7c
Deleted: sha256:f647a5fce535747ef60581d172da317109dedb94476767aa85f3642f5998b2a8
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220621035735]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55aeca4bde1976a806fe0a9195b98bcc75f505615f99e248390641d0f35eb860]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220621035735]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:55aeca4bde1976a806fe0a9195b98bcc75f505615f99e248390641d0f35eb860])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dab2e113ebcc2757e914678a8110ed70809b86d404cc2f5c1246bcd4b999ddbb
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dab2e113ebcc2757e914678a8110ed70809b86d404cc2f5c1246bcd4b999ddbb
ERROR: (gcloud.container.images.delete) Not found: response:
{'docker-distribution-api-version': 'registry/2.0', 'content-type':
'application/json', 'date': 'Tue, 21 Jun 2022 05:49:53 GMT', 'server': 'Docker
Registry', 'cache-control': 'private', 'x-xss-protection': '0',
'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status':
'404', 'content-length': '168', '-content-encoding': 'gzip'}
Failed to compute blob liveness for manifest:
'sha256:dab2e113ebcc2757e914678a8110ed70809b86d404cc2f5c1246bcd4b999ddbb': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
> Task :runners:google-cloud-dataflow-java:postCommitRunnerV2
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 298
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 52m 31s
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/5gqutbkmq3cha
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
