See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/777/display/redirect?page=changes>
Changes: [chamikaramj] Update vendored gRPC version for SpannerTransformRegistrarTest [noreply] [Playground] Share any code feature frontend (#22477) [noreply] Remove subprocess.PIPE usage by using a temp file (#22654) [noreply] [#22647] Upgrade org.apache.samza to 1.6 (#22648) ------------------------------------------ [...truncated 1004.56 KB...] Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-3.5.4 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mINFO:root:Successfully pulled licenses for 135 dependencies [0mSkip pulling license for bs4 Removing intermediate container 66fa386ac96c ---> d64c17829ca2 Step 29/32 : FROM beam ---> 8f8f8fb3337e Step 30/32 : ARG pull_licenses ---> Running in 82c6ab702bca Removing intermediate container 82c6ab702bca ---> 5579f6708e72 Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> 04a925be69f3 Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 49bd6a9d2537 Removing intermediate container 49bd6a9d2537 ---> ee36dc7dc635 Successfully built ee36dc7dc635 Successfully tagged apache/beam_python3.9_sdk:2.42.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] f9973aa5351d: Preparing c7e646ac1d96: Preparing 21fb60871563: Preparing ade35acbf50b: Preparing b9f977e8253f: Preparing c22731c85f46: Preparing 37bc2ef6b1e9: Preparing c6a37ed65dfe: Preparing 502d3fa4201f: Preparing 9c28bbf60478: Preparing 30a14c009fa7: Preparing 566521c1872e: Preparing bcd163e6de05: Preparing 4748898c8238: Preparing c6ca1fda7aff: Preparing e3e1e8ae0ad9: Preparing be73944855a3: Preparing 2143381c9922: Preparing 12228ba7a3b1: Preparing 9b55156abf26: Preparing 293d5db30c9f: Preparing 03127cdb479b: Preparing 9c742cd6c7a5: Preparing c22731c85f46: Waiting c6ca1fda7aff: Waiting 9b55156abf26: Waiting 293d5db30c9f: Waiting 37bc2ef6b1e9: Waiting 2143381c9922: Waiting 03127cdb479b: Waiting c6a37ed65dfe: Waiting 12228ba7a3b1: Waiting e3e1e8ae0ad9: Waiting 502d3fa4201f: Waiting 9c742cd6c7a5: Waiting 9c28bbf60478: Waiting be73944855a3: Waiting bcd163e6de05: Waiting 566521c1872e: Waiting 30a14c009fa7: Waiting 4748898c8238: Waiting ade35acbf50b: Pushed 21fb60871563: Pushed f9973aa5351d: Pushed b9f977e8253f: Pushed c7e646ac1d96: Pushed c6a37ed65dfe: Pushed 502d3fa4201f: Pushed 37bc2ef6b1e9: Pushed bcd163e6de05: Pushed 4748898c8238: Pushed 30a14c009fa7: Pushed e3e1e8ae0ad9: Layer already exists c6ca1fda7aff: Layer already exists 2143381c9922: Layer already exists 12228ba7a3b1: Layer already exists 9b55156abf26: Layer already exists be73944855a3: Layer already exists 293d5db30c9f: Layer already exists 03127cdb479b: Layer already exists 9c742cd6c7a5: Layer already exists c22731c85f46: Pushed 9c28bbf60478: Pushed 566521c1872e: Pushed 20220811052249: digest: sha256:39b022be22173a80e127d42e09634e295ff9f6663aa56fddade5f4ea73be5c29 size: 5156 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 45443 Launching Python expansion service @ 39109 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220811052249 >>> --experiments=shuffle_mode=appliance >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz> >>> pytest options: --capture=no --numprocesses=8 --timeout=4500 >>> --log-cli-level=INFO >>> collect markers: -m=uses_java_expansion_service ============================= test session starts ============================== platform linux -- Python 3.9.10, pytest-7.1.2, pluggy-1.0.0 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python,> configfile: pytest.ini plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [gw0] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw1] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw2] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw3] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw4] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw5] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw6] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw7] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] gw0 [10] / gw1 [10] / gw2 [10] / gw3 [10] / gw4 [10] / gw5 [10] / gw6 [10] / gw7 [10] scheduling tests via LoadScheduling apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence [gw5] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key [gw0] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition [gw3] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key [gw7] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput [gw4] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally [gw2] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform [gw1] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix [gw6] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key [gw0] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition [gw1] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix =============================== warnings summary =============================== ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =========== 10 passed, 2 skipped, 17 warnings in 1041.03s (0:17:21) ============ > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 3926690. Stopping expansion service pid: 3926691. > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220811052249 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:39b022be22173a80e127d42e09634e295ff9f6663aa56fddade5f4ea73be5c29 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220811052249] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:39b022be22173a80e127d42e09634e295ff9f6663aa56fddade5f4ea73be5c29] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220811052249] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:39b022be22173a80e127d42e09634e295ff9f6663aa56fddade5f4ea73be5c29])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:39b022be22173a80e127d42e09634e295ff9f6663aa56fddade5f4ea73be5c29 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:39b022be22173a80e127d42e09634e295ff9f6663aa56fddade5f4ea73be5c29 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:39b022be22173a80e127d42e09634e295ff9f6663aa56fddade5f4ea73be5c29]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220811052249 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0ac798ebe18e88741085651310782dc24b79069ca7d02dfd592de6a53d43ced9 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220811052249] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0ac798ebe18e88741085651310782dc24b79069ca7d02dfd592de6a53d43ced9] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220811052249] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0ac798ebe18e88741085651310782dc24b79069ca7d02dfd592de6a53d43ced9])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0ac798ebe18e88741085651310782dc24b79069ca7d02dfd592de6a53d43ced9 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0ac798ebe18e88741085651310782dc24b79069ca7d02dfd592de6a53d43ced9 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0ac798ebe18e88741085651310782dc24b79069ca7d02dfd592de6a53d43ced9]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dc69be5d832d981b51fe7759376c0d89a5e4777b8cbe180d6bc446a1ad862d14 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:dc69be5d832d981b51fe7759376c0d89a5e4777b8cbe180d6bc446a1ad862d14 ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Thu, 11 Aug 2022 05:50:39 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'} Failed to compute blob liveness for manifest: 'sha256:dc69be5d832d981b51fe7759376c0d89a5e4777b8cbe180d6bc446a1ad862d14': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 298 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 27m 51s 129 actionable tasks: 25 executed, 104 up-to-date Publishing build scan... https://gradle.com/s/aanr5pureo5uu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
