See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/8678/display/redirect>
Changes: ------------------------------------------ [...truncated 105.43 KB...] [gw0] [ 25%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build [gw0] [ 50%] FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker [gw0] [ 75%] FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it > Task :sdks:python:test-suites:dataflow:py36:validatesContainer [gw0] [ 25%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build [gw0] [ 50%] FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker [gw0] [ 75%] FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it > Task :sdks:python:test-suites:dataflow:py37:validatesContainer [gw0] [ 25%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_fnapi_it apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build [gw0] [ 50%] FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker [gw0] [ 75%] FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it > Task :sdks:python:test-suites:dataflow:py38:validatesContainer [gw0] [100%] PASSED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it =================================== FAILURES =================================== ____ WordCountIT.test_wordcount_it_with_prebuilt_sdk_container_cloud_build _____ [gw0] linux -- Python 3.8.9 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/bin/python3.8> self = <apache_beam.examples.wordcount_it_test.WordCountIT testMethod=test_wordcount_it_with_prebuilt_sdk_container_cloud_build> @pytest.mark.it_validatescontainer def test_wordcount_it_with_prebuilt_sdk_container_cloud_build(self): > self._run_wordcount_it( wordcount.run, experiment='beam_fn_api', prebuild_sdk_container_engine='cloud_build') apache_beam/examples/wordcount_it_test.py:64: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ apache_beam/examples/wordcount_it_test.py:107: in _run_wordcount_it run_wordcount( apache_beam/examples/wordcount.py:89: in run output | 'Write' >> WriteToText(known_args.output) apache_beam/pipeline.py:596: in __exit__ self.result = self.run() apache_beam/pipeline.py:546: in run return Pipeline.from_runner_api( apache_beam/pipeline.py:573: in run return self.runner.run_pipeline(self, self._options) apache_beam/runners/dataflow/test_dataflow_runner.py:53: in run_pipeline self.result = super().run_pipeline(pipeline, options) apache_beam/runners/dataflow/dataflow_runner.py:459: in run_pipeline environments.DockerEnvironment.from_options(options)) apache_beam/transforms/environments.py:340: in from_options prebuilt_container_image = SdkContainerImageBuilder.build_container_image( apache_beam/runners/portability/sdk_container_builder.py:139: in build_container_image return builder._build() apache_beam/runners/portability/sdk_container_builder.py:89: in _build self._prepare_dependencies() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <apache_beam.runners.portability.sdk_container_builder._SdkContainerImageCloudBuilder object at 0x7feda51ca3d0> def _prepare_dependencies(self): with tempfile.TemporaryDirectory() as tmp: artifacts = Stager.create_job_resources(self._options, tmp) resources = Stager.extract_staging_tuple_iter(artifacts) # make a copy of the staged artifacts into the temp source folder. file_names = [] > for path, name in resources: E ValueError: too many values to unpack (expected 2) apache_beam/runners/portability/sdk_container_builder.py:100: ValueError ____ WordCountIT.test_wordcount_it_with_prebuilt_sdk_container_local_docker ____ [gw0] linux -- Python 3.8.9 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/bin/python3.8> self = <apache_beam.examples.wordcount_it_test.WordCountIT testMethod=test_wordcount_it_with_prebuilt_sdk_container_local_docker> @pytest.mark.it_validatescontainer def test_wordcount_it_with_prebuilt_sdk_container_local_docker(self): > self._run_wordcount_it( wordcount.run, experiment='beam_fn_api', prebuild_sdk_container_engine='local_docker') apache_beam/examples/wordcount_it_test.py:57: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ apache_beam/examples/wordcount_it_test.py:107: in _run_wordcount_it run_wordcount( apache_beam/examples/wordcount.py:89: in run output | 'Write' >> WriteToText(known_args.output) apache_beam/pipeline.py:596: in __exit__ self.result = self.run() apache_beam/pipeline.py:546: in run return Pipeline.from_runner_api( apache_beam/pipeline.py:573: in run return self.runner.run_pipeline(self, self._options) apache_beam/runners/dataflow/test_dataflow_runner.py:53: in run_pipeline self.result = super().run_pipeline(pipeline, options) apache_beam/runners/dataflow/dataflow_runner.py:459: in run_pipeline environments.DockerEnvironment.from_options(options)) apache_beam/transforms/environments.py:340: in from_options prebuilt_container_image = SdkContainerImageBuilder.build_container_image( apache_beam/runners/portability/sdk_container_builder.py:139: in build_container_image return builder._build() apache_beam/runners/portability/sdk_container_builder.py:89: in _build self._prepare_dependencies() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <apache_beam.runners.portability.sdk_container_builder._SdkContainerImageLocalBuilder object at 0x7feda5044f70> def _prepare_dependencies(self): with tempfile.TemporaryDirectory() as tmp: artifacts = Stager.create_job_resources(self._options, tmp) resources = Stager.extract_staging_tuple_iter(artifacts) # make a copy of the staged artifacts into the temp source folder. file_names = [] > for path, name in resources: E ValueError: too many values to unpack (expected 2) apache_beam/runners/portability/sdk_container_builder.py:100: ValueError =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml> - =============== 2 failed, 2 passed, 3 warnings in 886.46 seconds =============== cleanup_container Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20211231-121314730711710 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:c69ea1bb182528dc2c408260bc675eef75c9d23d863cae0d663aab04d9bc4e40 docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:c69ea1bb182528dc2c408260bc675eef75c9d23d863cae0d663aab04d9bc4e40 Associated tags: - 20211231-121314730711710 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20211231-121314730711710 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20211231-121314730711710]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:c69ea1bb182528dc2c408260bc675eef75c9d23d863cae0d663aab04d9bc4e40]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Removed the container > Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py36:validatesContainer cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:d57d9ab6fbbb5aa36cfe9adfea39a2c51f6d0a5e4ac850f30cd2ae83220843b3 Associated tags: - 20211231-121314763245979 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20211231-121314763245979 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20211231-121314763245979]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:d57d9ab6fbbb5aa36cfe9adfea39a2c51f6d0a5e4ac850f30cd2ae83220843b3]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" > Task :sdks:python:test-suites:dataflow:py36:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py37:validatesContainer cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:c8fde8765b2815f9e4245b6ac294e61ca6a1e83d8b588d1781ca354e75ee1470 Associated tags: - 20211231-121314850314337 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20211231-121314850314337 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20211231-121314850314337]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:c8fde8765b2815f9e4245b6ac294e61ca6a1e83d8b588d1781ca354e75ee1470]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" > Task :sdks:python:test-suites:dataflow:py37:validatesContainer FAILED FAILURE: Build completed with 3 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 321 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 321 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py36:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 321 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py37:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 30m 36s 51 actionable tasks: 41 executed, 4 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/rjouvkexw373k Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
