See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/496/display/redirect?page=changes>
Changes: [noreply] [BEAM-11167] Updates dill package to version 0.3.5.1 (#17669) [noreply] [BEAM-6258] Use gRPC 1.33.1 as min version to ensure that we pickup ------------------------------------------ [...truncated 502.64 KB...] 3e14281c4ea0: Preparing b758be939380: Preparing d90eceb34234: Preparing 20be8897c1be: Preparing 171b18fec329: Preparing 0a7e0ba6c54d: Preparing c6679bcc482d: Preparing aedb4b362167: Preparing 285c8ba236e9: Preparing 13b045a1dfd2: Preparing 9c3180280a73: Waiting 2fbabeba902e: Preparing ee509ed6e976: Preparing 7c6c22c0b642: Waiting 9177197c67d0: Preparing 7dbadf2b9bd8: Preparing e7597c345c2e: Preparing ce981f79e59d: Waiting c435a7afdb66: Waiting ee509ed6e976: Waiting 9177197c67d0: Waiting 13b045a1dfd2: Waiting 2fbabeba902e: Waiting 3e14281c4ea0: Waiting 285c8ba236e9: Waiting 171b18fec329: Waiting 7dbadf2b9bd8: Waiting e7597c345c2e: Waiting 20be8897c1be: Waiting 0a7e0ba6c54d: Waiting d90eceb34234: Waiting c6679bcc482d: Waiting aedb4b362167: Waiting b758be939380: Waiting bcba08f26a12: Pushed 8357968b593e: Pushed a3e369d16c27: Pushed 6d446760e26d: Pushed a1131716b437: Pushed ce981f79e59d: Pushed 9c3180280a73: Pushed c435a7afdb66: Pushed 3e14281c4ea0: Pushed b758be939380: Pushed 171b18fec329: Pushed c6679bcc482d: Layer already exists 0a7e0ba6c54d: Pushed aedb4b362167: Layer already exists 285c8ba236e9: Layer already exists 13b045a1dfd2: Layer already exists ee509ed6e976: Layer already exists 9177197c67d0: Layer already exists 7dbadf2b9bd8: Layer already exists 2fbabeba902e: Layer already exists e7597c345c2e: Layer already exists 7c6c22c0b642: Pushed d90eceb34234: Pushed 20be8897c1be: Pushed 20220603121726: digest: sha256:49653e3e572c3543cb9a8680b253e942be159090d01e88b51cd62f3f85627fc8 size: 5361 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 42309 Launching Python expansion service @ 37517 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220603121726 >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz> >>> pytest options: --capture=no --numprocesses=8 --timeout=4500 >>> --log-cli-level=INFO >>> collect markers: -m=xlang_sql_expansion_service ============================= test session starts ============================== platform linux -- Python 3.9.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [gw0] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw2] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw3] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw1] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw5] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw4] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw6] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw7] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] gw0 [9] / gw1 [9] / gw2 [9] / gw3 [9] / gw4 [9] / gw5 [9] / gw6 [9] / gw7 [9] scheduling tests via LoadScheduling apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter apache_beam/transforms/sql_test.py::SqlTransformTest::test_row apache_beam/transforms/sql_test.py::SqlTransformTest::test_map apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data apache_beam/transforms/sql_test.py::SqlTransformTest::test_project [gw5] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project [gw0] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data [gw4] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row [gw7] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql [gw3] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data [gw1] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map [gw2] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter [gw6] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join [gw0] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data =============================== warnings summary =============================== <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54 <unknown>:54: DeprecationWarning: invalid escape sequence \c <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62 <unknown>:62: DeprecationWarning: invalid escape sequence \d <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html warnings.warn( <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html warnings.warn( apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> - ============= 9 passed, 1 skipped, 50 warnings in 1127.43 seconds ============== > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 1498188. Stopping expansion service pid: 1498189. > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220603121726 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49653e3e572c3543cb9a8680b253e942be159090d01e88b51cd62f3f85627fc8 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220603121726] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49653e3e572c3543cb9a8680b253e942be159090d01e88b51cd62f3f85627fc8] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220603121726] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49653e3e572c3543cb9a8680b253e942be159090d01e88b51cd62f3f85627fc8])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49653e3e572c3543cb9a8680b253e942be159090d01e88b51cd62f3f85627fc8 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49653e3e572c3543cb9a8680b253e942be159090d01e88b51cd62f3f85627fc8 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:49653e3e572c3543cb9a8680b253e942be159090d01e88b51cd62f3f85627fc8]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220603121726 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:784dad6957169932be37f7d79b7057c1da996bdee6cff400155b5953b3b5a105 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220603121726] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:784dad6957169932be37f7d79b7057c1da996bdee6cff400155b5953b3b5a105] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220603121726] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:784dad6957169932be37f7d79b7057c1da996bdee6cff400155b5953b3b5a105])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3802cae83d5aca300f96c15760ae582be2b5a03cbe4bb7611b8eec59cc36f0c0 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3802cae83d5aca300f96c15760ae582be2b5a03cbe4bb7611b8eec59cc36f0c0 ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Fri, 03 Jun 2022 12:47:06 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'} Failed to compute blob liveness for manifest: 'sha256:3802cae83d5aca300f96c15760ae582be2b5a03cbe4bb7611b8eec59cc36f0c0': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 297 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 29m 42s 168 actionable tasks: 114 executed, 48 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/dwa7fgg3pm6qi Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
