See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9989/display/redirect>
Changes: ------------------------------------------ [...truncated 1.96 MB...] echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:d3feefe16fcf614b3755cd6c91fb3ad0db6a9f3d48fbee18c50ab51bf30db8b3 Associated tags: - 20221127-105518283755138 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221127-105518283755138 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221127-105518283755138]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:d3feefe16fcf614b3755cd6c91fb3ad0db6a9f3d48fbee18c50ab51bf30db8b3]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:b4cf6ddf0b048a003c34a1699126ca73a81a1b303cd9669ecb6ed9a5fef72af2 Associated tags: - 4279cab0-bd64-438c-a325-be24ff0081b4 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:4279cab0-bd64-438c-a325-be24ff0081b4]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:b4cf6ddf0b048a003c34a1699126ca73a81a1b303cd9669ecb6ed9a5fef72af2]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:89a19120818e9762e2c4b4fb01d188252d60c263259ae62ec712e8045e582303 Associated tags: - 6461ff37-aa1e-4915-b069-9acbc08c708b Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:6461ff37-aa1e-4915-b069-9acbc08c708b]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:89a19120818e9762e2c4b4fb01d188252d60c263259ae62ec712e8045e582303]. > Task :sdks:python:test-suites:dataflow:py39:validatesContainer echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:d50d8bc87cebdcbf7ff9e827af64d025686332e4d4a86371eb6630e32102523d Associated tags: - 20221127-105518502933022 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221127-105518502933022 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221127-105518502933022]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:d50d8bc87cebdcbf7ff9e827af64d025686332e4d4a86371eb6630e32102523d]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:9dfba73e95eb1747943f683ae05ec8c47f48688219bea6fabaccab14b69c8b5c Associated tags: - 7274c05a-cad2-4755-9caa-879c66fc588e Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:7274c05a-cad2-4755-9caa-879c66fc588e]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:9dfba73e95eb1747943f683ae05ec8c47f48688219bea6fabaccab14b69c8b5c]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:4fe01c7954be3cdbda146fe9d0cfd918ad68a96ec67eedb15e85e29c88b4b052 Associated tags: - e0dc9f22-e8ff-4909-8e82-321c66da185d Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:e0dc9f22-e8ff-4909-8e82-321c66da185d]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:4fe01c7954be3cdbda146fe9d0cfd918ad68a96ec67eedb15e85e29c88b4b052]. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer [gw0] [100%] FAILED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it =================================== FAILURES =================================== ______________ ExerciseMetricsPipelineTest.test_metrics_fnapi_it _______________ [gw0] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/bin/python3.8> self = <apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest testMethod=test_metrics_fnapi_it> @pytest.mark.it_postcommit @pytest.mark.it_validatescontainer def test_metrics_fnapi_it(self): > result = self.run_pipeline(experiment='beam_fn_api') apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py:57: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py:43: in run_pipeline return dataflow_exercise_metrics_pipeline.apply_and_run(p) apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline.py:176: in apply_and_run result = pipeline.run() apache_beam/pipeline.py:550: in run return Pipeline.from_runner_api( apache_beam/pipeline.py:577: in run return self.runner.run_pipeline(self, self._options) apache_beam/runners/dataflow/test_dataflow_runner.py:66: in run_pipeline self.result.wait_until_finish(duration=wait_duration) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <DataflowPipelineResult <Job clientRequestId: '20221127113744650703-9503' createTime: '2022-11-27T11:37:45.741849Z' ...022-11-27T11:37:45.741849Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7f3ac71e3250> duration = None def wait_until_finish(self, duration=None): if not self.is_in_terminal_state(): if not self.has_job: raise IOError('Failed to get the Dataflow job id.') consoleUrl = ( "Console URL: https://console.cloud.google.com/"; f"dataflow/jobs/<RegionId>/{self.job_id()}" "?project=<ProjectId>") thread = threading.Thread( target=DataflowRunner.poll_for_job_completion, args=(self._runner, self, duration)) # Mark the thread as a daemon thread so a keyboard interrupt on the main # thread will terminate everything. This is also the reason we will not # use thread.join() to wait for the polling thread. thread.daemon = True thread.start() while thread.is_alive(): time.sleep(5.0) # TODO: Merge the termination code in poll_for_job_completion and # is_in_terminal_state. terminated = self.is_in_terminal_state() assert duration or terminated, ( 'Job did not reach to a terminal state after waiting indefinitely. ' '{}'.format(consoleUrl)) # TODO(https://github.com/apache/beam/issues/21695): Also run this check # if wait_until_finish was called after the pipeline completed. if terminated and self.state != PipelineState.DONE: # TODO(BEAM-1290): Consider converting this to an error log based on # theresolution of the issue. _LOGGER.error(consoleUrl) > raise DataflowRuntimeException( 'Dataflow pipeline failed. State: %s, Error:\n%s' % (self.state, getattr(self._runner, 'last_error_msg', None)), self) E apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: E Workflow failed. apache_beam/runners/dataflow/dataflow_runner.py:1596: DataflowRuntimeException =============================== warnings summary =============================== ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/typehints/pandas_type_compatibility_test.py:67 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. }).set_index(pd.Int64Index(range(123, 223), name='an_index')), apache_beam/typehints/pandas_type_compatibility_test.py:90 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(123, 223), name='an_index'), apache_beam/typehints/pandas_type_compatibility_test.py:91 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(475, 575), name='another_index'), -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml> - =========================== short test summary info ============================ FAILED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. ======= 1 failed, 4 passed, 5 skipped, 6 warnings in 3341.19s (0:55:41) ======== cleanup_container Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221127-105518556238958 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:14f33dd0324dfd6a7a2c0b24ac8aa7f1f9b8f90f3689301b0a63c58b8123c93f Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:9dcb9a13-80a2-4eb5-8302-0fb810e5ba1a Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:3771192701367544b35fc1b47216483bbf571a49ea47d6e21fcb526a0a83d324 Deleted: sha256:ee0ad486abb7536b57e001772ebeaeeb6a8f1379b0c69123104d289cbca633df Deleted: sha256:629545a2f9ddbac6c6a379a733b68272547a8d5296ad35f705d759e564196b46 Deleted: sha256:fa1fe21973025ba8a11335cb95d14070ee1bda0fdbd8c95c3afe87d7ea3f0823 Deleted: sha256:42f39bf7f35babf7df3986c34b2cddb235709c760280cb95604f32f76df3c1e6 Deleted: sha256:ccdb684d9961cfa9b238ae410296059072cbdaea47825b0c9b3b25096810ef09 Deleted: sha256:8fd323ab72cbf7f57d6226dac89ffb66ee1ab573c2f717f3eae7b94d9214ea99 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:14f33dd0324dfd6a7a2c0b24ac8aa7f1f9b8f90f3689301b0a63c58b8123c93f Associated tags: - 20221127-105518556238958 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221127-105518556238958 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221127-105518556238958]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:14f33dd0324dfd6a7a2c0b24ac8aa7f1f9b8f90f3689301b0a63c58b8123c93f]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:3771192701367544b35fc1b47216483bbf571a49ea47d6e21fcb526a0a83d324 Associated tags: - 9dcb9a13-80a2-4eb5-8302-0fb810e5ba1a Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:9dcb9a13-80a2-4eb5-8302-0fb810e5ba1a]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:3771192701367544b35fc1b47216483bbf571a49ea47d6e21fcb526a0a83d324]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:050e3838711443d5b492af57f5b393e0b80d718d38a9fb462414ad6376321f44 Associated tags: - e7acbded-637a-4973-8aef-828b762f5d06 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:e7acbded-637a-4973-8aef-828b762f5d06]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:050e3838711443d5b492af57f5b393e0b80d718d38a9fb462414ad6376321f44]. Removed the container > Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py310:validatesContainer echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:8e71b891143a97ee5c0cc3c53fdcaf288cf670acbb7657705815af25c7b0fdaa Associated tags: - 20221127-105518703722431 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221127-105518703722431 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221127-105518703722431]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:8e71b891143a97ee5c0cc3c53fdcaf288cf670acbb7657705815af25c7b0fdaa]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:1c2182daf41f96879fedafbc3e6419e61f47caf8a1ac28e9a5ddd39c520fb274 Associated tags: - cd198b0c-6ff6-4628-94f1-f878f0525a44 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:cd198b0c-6ff6-4628-94f1-f878f0525a44]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:1c2182daf41f96879fedafbc3e6419e61f47caf8a1ac28e9a5ddd39c520fb274]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:ae881d7fc8435f4374bdef406a497b55bbb2368d41c82c12d6909a7d9465ae1c Associated tags: - d644578e-23bd-4563-bbec-fe552c74f4b0 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:d644578e-23bd-4563-bbec-fe552c74f4b0]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:ae881d7fc8435f4374bdef406a497b55bbb2368d41c82c12d6909a7d9465ae1c]. FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 363 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 25m 4s 62 actionable tasks: 51 executed, 4 from cache, 7 up-to-date Publishing build scan... https://gradle.com/s/5jaq7ruk5jf24 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
