See 
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/304/display/redirect>

Changes:


------------------------------------------
[...truncated 78.21 KB...]
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:python:container:py36:dockerPrepare
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 
18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: 
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker


> Task :sdks:python:container:py36:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 
18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: 
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python]
269b88ed1cc9: Preparing
9980c6af31fe: Preparing
9c5abcfcac54: Preparing
b9e378032a1a: Preparing
1a32c7033d19: Preparing
9acd32eb8ebe: Preparing
773c5f5dfe65: Preparing
660079b69244: Preparing
b256ea37525f: Preparing
4ce6ed9712ab: Preparing
81782bf47a6d: Preparing
6801585edacc: Preparing
8f48b68f6dc5: Preparing
f744adac1780: Preparing
c86e2d4af62f: Preparing
aa4c808c19f6: Preparing
8ba9f690e8ba: Preparing
3e607d59ef9f: Preparing
1e18e7e1fcc2: Preparing
c3a0d593ed24: Preparing
26a504e63be4: Preparing
8bf42db0de72: Preparing
31892cc314cb: Preparing
11936051f93b: Preparing
4ce6ed9712ab: Waiting
26a504e63be4: Waiting
aa4c808c19f6: Waiting
81782bf47a6d: Waiting
8bf42db0de72: Waiting
31892cc314cb: Waiting
6801585edacc: Waiting
8ba9f690e8ba: Waiting
11936051f93b: Waiting
3e607d59ef9f: Waiting
8f48b68f6dc5: Waiting
1e18e7e1fcc2: Waiting
c86e2d4af62f: Waiting
f744adac1780: Waiting
9acd32eb8ebe: Waiting
c3a0d593ed24: Waiting
773c5f5dfe65: Waiting
b256ea37525f: Waiting
660079b69244: Waiting
9c5abcfcac54: Pushed
1a32c7033d19: Pushed
269b88ed1cc9: Pushed
b9e378032a1a: Pushed
9980c6af31fe: Pushed
9acd32eb8ebe: Pushed
773c5f5dfe65: Pushed
b256ea37525f: Pushed
4ce6ed9712ab: Pushed
81782bf47a6d: Pushed
f744adac1780: Pushed
aa4c808c19f6: Layer already exists
8ba9f690e8ba: Layer already exists
3e607d59ef9f: Layer already exists
1e18e7e1fcc2: Layer already exists
c3a0d593ed24: Layer already exists
26a504e63be4: Layer already exists
8bf42db0de72: Layer already exists
c86e2d4af62f: Pushed
31892cc314cb: Layer already exists
11936051f93b: Layer already exists
660079b69244: Pushed
6801585edacc: Pushed
8f48b68f6dc5: Pushed
20220414045236: digest: 
sha256:7402bf9de998b27bdd2c930f51e0fcd33584b22ef4d240e49156647f29fd33a6 size: 
5361

> Task :runners:google-cloud-dataflow-java:setupXVR

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 43193
Launching Python expansion service @ 34519

> Task 
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: 
>>> --runner=TestDataflowRunner --project=apache-beam-testing 
>>> --region=us-central1 
>>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220414045236
>>>  --experiments=use_runner_v2 --experiments=shuffle_mode=appliance 
>>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --numprocesses=8 --timeout=4500 
>>> --log-cli-level=INFO
>>>   collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: 
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python,>
 inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.6.15 (default, Jan 15 2022, 19:47:13)  -- [GCC 9.3.0]
[gw2] Python 3.6.15 (default, Jan 15 2022, 19:47:13)  -- [GCC 9.3.0]
[gw1] Python 3.6.15 (default, Jan 15 2022, 19:47:13)  -- [GCC 9.3.0]
[gw3] Python 3.6.15 (default, Jan 15 2022, 19:47:13)  -- [GCC 9.3.0]
[gw4] Python 3.6.15 (default, Jan 15 2022, 19:47:13)  -- [GCC 9.3.0]
[gw5] Python 3.6.15 (default, Jan 15 2022, 19:47:13)  -- [GCC 9.3.0]
[gw6] Python 3.6.15 (default, Jan 15 2022, 19:47:13)  -- [GCC 9.3.0]
[gw7] Python 3.6.15 (default, Jan 15 2022, 19:47:13)  -- [GCC 9.3.0]
gw0 [10] / gw1 [10] / gw2 [10] / gw3 [10] / gw4 [10] / gw5 [10] / gw6 [10] / 
gw7 [10]

scheduling tests via LoadScheduling

apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key
 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key
 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key
 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput
 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence
 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform
 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally
 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder
 
[gw5] PASSED 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key
 
[gw4] PASSED 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally
 
[gw2] PASSED 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder
 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix
 
[gw3] PASSED 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key
 
[gw6] PASSED 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key
 
[gw0] PASSED 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence
 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition
 
[gw1] PASSED 
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform
 
[gw7] PASSED 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput
 
[gw2] PASSED 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix
 
[gw0] PASSED 
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition
 

=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
  
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54:
 DeprecationWarning: invalid escape sequence \c
    self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf'))  # pylint: 
disable=anomalous-backslash-in-string

apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
  
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62:
 DeprecationWarning: invalid escape sequence \d
    self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'),  # 
pylint: disable=anomalous-backslash-in-string

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: 
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml>
 -
================== 10 passed, 10 warnings in 1172.08 seconds ===================

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1725773.
Stopping expansion service pid: 1725774.

> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE

> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220414045236
Untagged: 
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7402bf9de998b27bdd2c930f51e0fcd33584b22ef4d240e49156647f29fd33a6
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220414045236]
- referencing digest: 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7402bf9de998b27bdd2c930f51e0fcd33584b22ef4d240e49156647f29fd33a6]

Deleted 
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220414045236] 
(referencing 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7402bf9de998b27bdd2c930f51e0fcd33584b22ef4d240e49156647f29fd33a6])].
Removing untagged image 
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7402bf9de998b27bdd2c930f51e0fcd33584b22ef4d240e49156647f29fd33a6
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7402bf9de998b27bdd2c930f51e0fcd33584b22ef4d240e49156647f29fd33a6
Deleted 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:7402bf9de998b27bdd2c930f51e0fcd33584b22ef4d240e49156647f29fd33a6].

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220414045236
Untagged: 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4ff2bcc883707388ab3abf13070a9eef4967ea83201fdf4266c6951c849a712
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220414045236]
- referencing digest: 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4ff2bcc883707388ab3abf13070a9eef4967ea83201fdf4266c6951c849a712]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220414045236] 
(referencing 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4ff2bcc883707388ab3abf13070a9eef4967ea83201fdf4266c6951c849a712])].
Removing untagged image 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4ff2bcc883707388ab3abf13070a9eef4967ea83201fdf4266c6951c849a712
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4ff2bcc883707388ab3abf13070a9eef4967ea83201fdf4266c6951c849a712
Deleted 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4ff2bcc883707388ab3abf13070a9eef4967ea83201fdf4266c6951c849a712].
Removing untagged image 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9b8deecee146597e33f5a92b99f1c01668cc3ff97eec1bbae41b8a4590bcdd69
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9b8deecee146597e33f5a92b99f1c01668cc3ff97eec1bbae41b8a4590bcdd69
ERROR: (gcloud.container.images.delete) Not found: response: 
{'docker-distribution-api-version': 'registry/2.0', 'content-type': 
'application/json', 'date': 'Thu, 14 Apr 2022 05:22:54 GMT', 'server': 'Docker 
Registry', 'cache-control': 'private', 'x-xss-protection': '0', 
'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 
'404', 'content-length': '168', '-content-encoding': 'gzip'}
Failed to compute blob liveness for manifest: 
'sha256:9b8deecee146597e33f5a92b99f1c01668cc3ff97eec1bbae41b8a4590bcdd69': None

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED

FAILURE: Build failed with an exception.

* Where:
Build file 
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
 line: 297

* What went wrong:
Execution failed for task 
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with 
> non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

See 
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during 
this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 30m 31s
139 actionable tasks: 97 executed, 36 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/44jhie7ktv3mo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to