See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/131/display/redirect?page=changes>
Changes: [noreply] [BEAM-13903] Improve coverage of metricsx package (#16994) [noreply] [BEAM-13892] Improve coverage of avroio package (#16990) ------------------------------------------ [...truncated 459.73 KB...] ---> 442242c5db5d Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> 5116b84f74bf Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 2d0a80bcb7a3 Removing intermediate container 2d0a80bcb7a3 ---> 7b3ac9c9a72d Successfully built 7b3ac9c9a72d Successfully tagged apache/beam_python3.9_sdk:2.38.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 15a113920f04: Preparing 6557363e3b39: Preparing 1fa34aff3368: Preparing d2e86b0238ce: Preparing 2289eb508e0e: Preparing eb4b73c64119: Preparing 65ac786d3e5e: Preparing 573c26211026: Preparing 4b8761ae2193: Preparing 73a312736851: Preparing 301967b0b6af: Preparing ba5f69292f54: Preparing 9f64480c4eaa: Preparing 8b92a42c504d: Preparing 51b6fa1fd78a: Preparing b2d9faeb9a38: Preparing c8e787ed62ea: Preparing 3738fd399239: Preparing 182f3ce3bf27: Preparing 316e3949bffa: Preparing e3f84a8cee1f: Preparing 73a312736851: Waiting 48144a6f44ae: Preparing 301967b0b6af: Waiting ba5f69292f54: Waiting 26d5108b2cba: Preparing 89fda00479fc: Preparing 51b6fa1fd78a: Waiting b2d9faeb9a38: Waiting 316e3949bffa: Waiting 8b92a42c504d: Waiting 48144a6f44ae: Waiting 9f64480c4eaa: Waiting c8e787ed62ea: Waiting e3f84a8cee1f: Waiting eb4b73c64119: Waiting 573c26211026: Waiting 26d5108b2cba: Waiting 65ac786d3e5e: Waiting 3738fd399239: Waiting 4b8761ae2193: Waiting 89fda00479fc: Waiting d2e86b0238ce: Pushed 1fa34aff3368: Pushed 2289eb508e0e: Pushed 15a113920f04: Pushed eb4b73c64119: Pushed 65ac786d3e5e: Pushed 6557363e3b39: Pushed 4b8761ae2193: Pushed 301967b0b6af: Pushed 73a312736851: Pushed 8b92a42c504d: Pushed b2d9faeb9a38: Layer already exists 51b6fa1fd78a: Pushed c8e787ed62ea: Layer already exists 182f3ce3bf27: Layer already exists 3738fd399239: Layer already exists 316e3949bffa: Layer already exists e3f84a8cee1f: Layer already exists 48144a6f44ae: Layer already exists 26d5108b2cba: Layer already exists 89fda00479fc: Layer already exists 573c26211026: Pushed ba5f69292f54: Pushed 9f64480c4eaa: Pushed 20220303060540: digest: sha256:e1c8a5031f5fbc2e2a3cff7ef477404cba066cfc4672d60e4fcbae662d4c7b29 size: 5361 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Stopping expansion service pid: 1313942. Stopping expansion service pid: 1313943. Launching Java expansion service @ 36603 Launching Python expansion service @ 44501 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220303060540 >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz> >>> pytest options: --capture=no --numprocesses=8 --timeout=4500 >>> --log-cli-level=INFO >>> collect markers: -m=xlang_sql_expansion_service ============================= test session starts ============================== platform linux -- Python 3.9.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [gw0] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw1] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw3] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw7] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw4] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw6] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw2] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw5] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] gw0 [9] / gw1 [9] / gw2 [9] / gw3 [9] / gw4 [9] / gw5 [9] / gw6 [9] / gw7 [9] scheduling tests via LoadScheduling apache_beam/transforms/sql_test.py::SqlTransformTest::test_project apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter apache_beam/transforms/sql_test.py::SqlTransformTest::test_map apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql apache_beam/transforms/sql_test.py::SqlTransformTest::test_row [gw1] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter [gw7] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map [gw2] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join [gw4] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project [gw3] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data [gw6] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row [gw5] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql [gw0] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data E0303 06:31:55.418317978 1315225 fork_posix.cc:70] Fork support is only compatible with the epoll1 and poll polling strategies [gw0] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data =============================== warnings summary =============================== <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54: DeprecationWarning: invalid escape sequence \c <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62: DeprecationWarning: invalid escape sequence \d <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> - =================== 9 passed, 26 warnings in 1529.85 seconds =================== > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220303060540 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e1c8a5031f5fbc2e2a3cff7ef477404cba066cfc4672d60e4fcbae662d4c7b29 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220303060540] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e1c8a5031f5fbc2e2a3cff7ef477404cba066cfc4672d60e4fcbae662d4c7b29] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220303060540] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:e1c8a5031f5fbc2e2a3cff7ef477404cba066cfc4672d60e4fcbae662d4c7b29])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f8e4b9ec44f0f260a45651955dda7a98a5c596502d15db33867e0c9ed350b02d Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:f8e4b9ec44f0f260a45651955dda7a98a5c596502d15db33867e0c9ed350b02d ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Thu, 03 Mar 2022 06:43:57 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'} Failed to compute blob liveness for manifest: 'sha256:f8e4b9ec44f0f260a45651955dda7a98a5c596502d15db33867e0c9ed350b02d': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220303060540 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9d16ad9bc5e4428eb24befdcfe9cd59c330e485843e09550976c8ba1684d3ea0 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220303060540] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9d16ad9bc5e4428eb24befdcfe9cd59c330e485843e09550976c8ba1684d3ea0] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220303060540] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9d16ad9bc5e4428eb24befdcfe9cd59c330e485843e09550976c8ba1684d3ea0])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9d16ad9bc5e4428eb24befdcfe9cd59c330e485843e09550976c8ba1684d3ea0 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9d16ad9bc5e4428eb24befdcfe9cd59c330e485843e09550976c8ba1684d3ea0 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9d16ad9bc5e4428eb24befdcfe9cd59c330e485843e09550976c8ba1684d3ea0]. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 338 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerPythonImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 38m 44s 153 actionable tasks: 105 executed, 42 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/gqrxek2fyzpgw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
