See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/8236/display/redirect>
Changes: ------------------------------------------ [...truncated 124.08 KB...] apache_beam/runners/dataflow/test_dataflow_runner.py:69: AssertionError ______________ ExerciseMetricsPipelineTest.test_metrics_fnapi_it _______________ [gw0] linux -- Python 3.8.5 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/bin/python3.8> self = <apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest testMethod=test_metrics_fnapi_it> @pytest.mark.it_postcommit @pytest.mark.it_validatescontainer def test_metrics_fnapi_it(self): > result = self.run_pipeline(experiment='beam_fn_api') apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py:43: in run_pipeline return dataflow_exercise_metrics_pipeline.apply_and_run(p) apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline.py:176: in apply_and_run result = pipeline.run() apache_beam/pipeline.py:539: in run return Pipeline.from_runner_api( apache_beam/pipeline.py:566: in run return self.runner.run_pipeline(self, self._options) apache_beam/runners/dataflow/test_dataflow_runner.py:65: in run_pipeline self.result.wait_until_finish(duration=wait_duration) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <DataflowPipelineResult <Job clientRequestId: '20210912002232041030-5768' createTime: '2021-09-12T00:22:33.348250Z' ...021-09-12T00:22:33.348250Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7fd27ce07400> duration = None def wait_until_finish(self, duration=None): if not self.is_in_terminal_state(): if not self.has_job: raise IOError('Failed to get the Dataflow job id.') thread = threading.Thread( target=DataflowRunner.poll_for_job_completion, args=(self._runner, self, duration)) # Mark the thread as a daemon thread so a keyboard interrupt on the main # thread will terminate everything. This is also the reason we will not # use thread.join() to wait for the polling thread. thread.daemon = True thread.start() while thread.is_alive(): time.sleep(5.0) # TODO: Merge the termination code in poll_for_job_completion and # is_in_terminal_state. terminated = self.is_in_terminal_state() assert duration or terminated, ( 'Job did not reach to a terminal state after waiting indefinitely.') if terminated and self.state != PipelineState.DONE: # TODO(BEAM-1290): Consider converting this to an error log based on # theresolution of the issue. > raise DataflowRuntimeException( 'Dataflow pipeline failed. State: %s, Error:\n%s' % (self.state, getattr(self._runner, 'last_error_msg', None)), self) E apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: E Workflow failed. apache_beam/runners/dataflow/dataflow_runner.py:1632: DataflowRuntimeException =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml> - ==================== 4 failed, 3 warnings in 482.84 seconds ==================== cleanup_container Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210912-001421369868966 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:ef0e09b0f634a355c243e6c698b0225cc14df729faa86f1d262e1e25a5a4178c docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:247fd4ad-d696-4550-a2d8-1e7a469fcc74 Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a3b2c61828581b6fe2759ee28a719cbb0acd34ab35930b27bb37f7f09dabea49 Deleted: sha256:c83cdae7a1313b816f2431ccc23b9b2df8b76558f00726b26b51fa7391d12b58 Deleted: sha256:2ef176ae5d77506c363c6f8e495b34598402d988c99c179883b40ee9b6186ed9 Deleted: sha256:b637ffa693f2369372d3f54189340a9bd92d5d37748c8e64ff1fbc5e57cc2ca0 Deleted: sha256:f4caffa1a451c27cdd986796ac823f82cc6464f8477b4c7551408789dc18675e Deleted: sha256:2b97d51cc523552faf35ac704dc36ae03afb238095a219bd8c92d16cd689cba2 Deleted: sha256:aa6cf5fc68671a1cadd6355318f77776744654edba1dda13bf0aaee8656e957f Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:ef0e09b0f634a355c243e6c698b0225cc14df729faa86f1d262e1e25a5a4178c Associated tags: - 20210912-001421369868966 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210912-001421369868966 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210912-001421369868966]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:ef0e09b0f634a355c243e6c698b0225cc14df729faa86f1d262e1e25a5a4178c]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a3b2c61828581b6fe2759ee28a719cbb0acd34ab35930b27bb37f7f09dabea49 Associated tags: - 247fd4ad-d696-4550-a2d8-1e7a469fcc74 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:247fd4ad-d696-4550-a2d8-1e7a469fcc74]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a3b2c61828581b6fe2759ee28a719cbb0acd34ab35930b27bb37f7f09dabea49]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:51e3f23910adf6a08ee3ce194ebe065971437ab4eef595e67318a25de95c0905 Associated tags: - 9055bce4-08d2-4518-b2a5-fecbba058051 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:9055bce4-08d2-4518-b2a5-fecbba058051]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:51e3f23910adf6a08ee3ce194ebe065971437ab4eef595e67318a25de95c0905]. Removed the container > Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py37:validatesContainer cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:176092d6b02ef70bb7e0e0fa882a7940d427db72466cd7135382f5c9ff6e44f5 Associated tags: - 20210912-001421498675863 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210912-001421498675863 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210912-001421498675863]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:176092d6b02ef70bb7e0e0fa882a7940d427db72466cd7135382f5c9ff6e44f5]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:590aef15ea6a1c3389ac92dc14844f4fd2046288f904b03879ed016c20f18049 Associated tags: - c48a91ae-e955-4bb6-93a6-472e12359e37 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:c48a91ae-e955-4bb6-93a6-472e12359e37]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:590aef15ea6a1c3389ac92dc14844f4fd2046288f904b03879ed016c20f18049]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:bcf856e26453069a61ea96fbe09fae6dc133b6f0f369ef4f99586a5122d7574c Associated tags: - 288f8aa8-aec5-4cb2-84e2-0f2c3870ab80 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:288f8aa8-aec5-4cb2-84e2-0f2c3870ab80]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:bcf856e26453069a61ea96fbe09fae6dc133b6f0f369ef4f99586a5122d7574c]. > Task :sdks:python:test-suites:dataflow:py37:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py36:validatesContainer [gw0] [ 50%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker [gw0] [ 75%] PASSED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it [gw0] [100%] PASSED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.6_sdk.xml> - =================== 4 passed, 2 warnings in 2020.04 seconds ==================== echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" >>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST cleanup_container Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210912-001421469578424 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:9fa5e941834cbdb041d19125609b2964f18e1e3851a9a05d8ce5a31016792a6f docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:afb58967-2118-4b7d-b91d-0cf3c7da113b Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:6b4186250067ae2e466f57376d8dccd76d3b020a6af5a086c21e20b9ba40f8ae Deleted: sha256:c68be6663be28de0cfb68466e2cfcf498da8e03af1e0ccf08f20f9d57616b163 Deleted: sha256:81e2c59bac27e641db3d4488994480fea8fb6afa68e2af70fe1b6089cf77f40a Deleted: sha256:279634064d178ad954410ad1f509fbaff035d931cad4b60fbbadb441321dda86 Deleted: sha256:adf447a0241b9e08449960a2707e00bfbb78510f4de12304b4b2ebe38dd09d2d Deleted: sha256:9899f8e8a33f7d92f3d29506f6d0e751b731b82af072a7060ff6be1c74b71c1e Deleted: sha256:8f432af6817fa8d876b0019da15f319bc0fe2cfa3125dfcfbbd1829af3930a90 Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:9fa5e941834cbdb041d19125609b2964f18e1e3851a9a05d8ce5a31016792a6f Associated tags: - 20210912-001421469578424 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210912-001421469578424 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210912-001421469578424]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:9fa5e941834cbdb041d19125609b2964f18e1e3851a9a05d8ce5a31016792a6f]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:6b4186250067ae2e466f57376d8dccd76d3b020a6af5a086c21e20b9ba40f8ae Associated tags: - afb58967-2118-4b7d-b91d-0cf3c7da113b Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:afb58967-2118-4b7d-b91d-0cf3c7da113b]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:6b4186250067ae2e466f57376d8dccd76d3b020a6af5a086c21e20b9ba40f8ae]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:bbff8b932523f9ff054c80fab330e4be1dce32dc761a9fefaec2673692f3fb87 Associated tags: - 5d54961c-d9cc-440c-abab-87f2b55523cd Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:5d54961c-d9cc-440c-abab-87f2b55523cd]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:bbff8b932523f9ff054c80fab330e4be1dce32dc761a9fefaec2673692f3fb87]. Removed the container FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 276 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 276 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py37:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 49m 39s 44 actionable tasks: 40 executed, 4 up-to-date Publishing build scan... https://gradle.com/s/roppwbqingc3k Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
