See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9764/display/redirect>
Changes: ------------------------------------------ [...truncated 1.36 MB...] <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/api_core/grpc_helpers.py>:37: DeprecationWarning: Support for grpcio-gcp is deprecated. This feature will be removed from `google-api-core` after January 1, 2024. If you need to continue to use this feature, please pin to a specific version of `google-api-core`. warnings.warn( ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/typehints/pandas_type_compatibility_test.py:66 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. }).set_index(pd.Int64Index(range(123, 223), name='an_index')), apache_beam/typehints/pandas_type_compatibility_test.py:89 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(123, 223), name='an_index'), apache_beam/typehints/pandas_type_compatibility_test.py:90 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(475, 575), name='another_index'), -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml> - ============ 4 passed, 3 skipped, 8 warnings in 2068.31s (0:34:28) ============= >>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221002-045227064454371 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:506dff284294105de6bdd24aa6f781f54e69e333f0d6869e000a2c09a77e1a35 Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:bfa32b2c-be16-4382-84c7-a37b2640c373 Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a0595861e68d78127a7a82f7d0509b41e6c401d1e16165217ef519e879af58ac Deleted: sha256:ef6426807c64fb95152af12c51eac2b4496f36c08bea8978c932d2f134d67782 Deleted: sha256:30e1996a122308e6285971edd0e42260c2b50a6d390575539a1b39b6ac4ef082 Deleted: sha256:fbfd6cb005bf5ba9d11a8aa5dc20f36fda097d2170e46de7c2534dd4abc7a6b2 Deleted: sha256:5623bc42d55deba59077bfb8937037245fd3725d11fa5b33e4fcf73fca9a9d1e Deleted: sha256:fd1daefaef42d04c521682e74fc725f088e69422ae0a6b63c0232139a642d3e8 Deleted: sha256:305b7ef9aaa704225b47e923af33659596806872350c2e9a20dd715310f7aae9 Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:506dff284294105de6bdd24aa6f781f54e69e333f0d6869e000a2c09a77e1a35 Associated tags: - 20221002-045227064454371 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221002-045227064454371 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221002-045227064454371]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:506dff284294105de6bdd24aa6f781f54e69e333f0d6869e000a2c09a77e1a35]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a0595861e68d78127a7a82f7d0509b41e6c401d1e16165217ef519e879af58ac Associated tags: - bfa32b2c-be16-4382-84c7-a37b2640c373 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:bfa32b2c-be16-4382-84c7-a37b2640c373]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a0595861e68d78127a7a82f7d0509b41e6c401d1e16165217ef519e879af58ac]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:56e68bbeaee120032ff59c188207a4a1194acef2dfeb6cf1072ea7abaf707dc7 Associated tags: - e84b1fc8-c4b7-4388-aed2-f9dadc5093cc Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:e84b1fc8-c4b7-4388-aed2-f9dadc5093cc]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:56e68bbeaee120032ff59c188207a4a1194acef2dfeb6cf1072ea7abaf707dc7]. Removed the container > Task :sdks:python:test-suites:dataflow:py37:validatesContainer echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:faefebeff90985365590dbae4435abb57a7a7af6a4fcfec10cedf724e95b290e Associated tags: - 20221002-045227221964190 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221002-045227221964190 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221002-045227221964190]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:faefebeff90985365590dbae4435abb57a7a7af6a4fcfec10cedf724e95b290e]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:3fb5419e33d12130e1f77e85a89e4396fb311c2db9c6bc8b8bbd0ef4e76e0c62 Associated tags: - 12e5cff2-94da-4419-8925-134f03e4f8bd Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:12e5cff2-94da-4419-8925-134f03e4f8bd]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:3fb5419e33d12130e1f77e85a89e4396fb311c2db9c6bc8b8bbd0ef4e76e0c62]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:072215bd7d4d16646784db8b97a9ca06048dbdf45a8142ebf7c48c8ad2c6805d Associated tags: - 7d44a9f3-f468-427f-9fa8-f574838c0779 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:7d44a9f3-f468-427f-9fa8-f574838c0779]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:072215bd7d4d16646784db8b97a9ca06048dbdf45a8142ebf7c48c8ad2c6805d]. > Task :sdks:python:test-suites:dataflow:py39:validatesContainer [gw0] [100%] PASSED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it =================================== FAILURES =================================== ____ WordCountIT.test_wordcount_it_with_prebuilt_sdk_container_cloud_build _____ [gw0] linux -- Python 3.9.10 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/bin/python3.9> self = <apache_beam.examples.wordcount_it_test.WordCountIT testMethod=test_wordcount_it_with_prebuilt_sdk_container_cloud_build> @pytest.mark.it_validatescontainer def test_wordcount_it_with_prebuilt_sdk_container_cloud_build(self): > self._run_wordcount_it( wordcount.run, experiment='beam_fn_api', prebuild_sdk_container_engine='cloud_build') apache_beam/examples/wordcount_it_test.py:103: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ apache_beam/examples/wordcount_it_test.py:146: in _run_wordcount_it run_wordcount( apache_beam/examples/wordcount.py:106: in run output | 'Write' >> WriteToText(known_args.output) apache_beam/pipeline.py:597: in __exit__ self.result = self.run() apache_beam/pipeline.py:547: in run return Pipeline.from_runner_api( apache_beam/pipeline.py:574: in run return self.runner.run_pipeline(self, self._options) apache_beam/runners/dataflow/test_dataflow_runner.py:66: in run_pipeline self.result.wait_until_finish(duration=wait_duration) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <DataflowPipelineResult <Job clientRequestId: '20221002050839500759-9986' createTime: '2022-10-02T05:08:43.019328Z' ...022-10-02T05:08:43.019328Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7f2dd933b0a0> duration = None def wait_until_finish(self, duration=None): if not self.is_in_terminal_state(): if not self.has_job: raise IOError('Failed to get the Dataflow job id.') consoleUrl = ( "Console URL: https://console.cloud.google.com/" f"dataflow/jobs/<RegionId>/{self.job_id()}" "?project=<ProjectId>") thread = threading.Thread( target=DataflowRunner.poll_for_job_completion, args=(self._runner, self, duration)) # Mark the thread as a daemon thread so a keyboard interrupt on the main # thread will terminate everything. This is also the reason we will not # use thread.join() to wait for the polling thread. thread.daemon = True thread.start() while thread.is_alive(): > time.sleep(5.0) E Failed: Timeout >900.0s apache_beam/runners/dataflow/dataflow_runner.py:1658: Failed =============================== warnings summary =============================== ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py>:37: DeprecationWarning: Support for grpcio-gcp is deprecated. This feature will be removed from `google-api-core` after January 1, 2024. If you need to continue to use this feature, please pin to a specific version of `google-api-core`. warnings.warn( ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/typehints/pandas_type_compatibility_test.py:66 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. }).set_index(pd.Int64Index(range(123, 223), name='an_index')), apache_beam/typehints/pandas_type_compatibility_test.py:89 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(123, 223), name='an_index'), apache_beam/typehints/pandas_type_compatibility_test.py:90 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(475, 575), name='another_index'), -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.9_sdk.xml> - =========================== short test summary info ============================ FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build ======= 1 failed, 3 passed, 3 skipped, 8 warnings in 2218.68s (0:36:58) ======== cleanup_container Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221002-045227055807463 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:7d0965650dd9ec6556e8ec141273af9a7bf0f0877e60262f2d73db55f4fb418e Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:0792c749-d9e4-44fb-ab94-471377a13ff7 Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:76f113a30c2e0316abc83ebc9d283ac40d701912a5270c77e9189d1455ac445e Deleted: sha256:5480cdeec50323ff44305025195d061a1712ea8f185e6a46b1be27d63f49bb49 Deleted: sha256:afd669ebda3768c6ed98b7c5fc2030b046437478ea007658ac9fefbce6cf271a Deleted: sha256:8d44983e7bdb3ef189c54d3fbf764ede5b4fd4e704b9529cad7f607aed6af344 Deleted: sha256:6832a7dc3995d084a530bbe2def6aef47c12f9c0a3ab01f4815201a52d7d782b Deleted: sha256:c8515d86090eab154ce99c158ff37ee63608567dcde560d99525a10094e0c692 Deleted: sha256:5e6604cef8dea7764f6a719940bc7e33a129a89b2c8bd19b0139cbec93eb75bd Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:7d0965650dd9ec6556e8ec141273af9a7bf0f0877e60262f2d73db55f4fb418e Associated tags: - 20221002-045227055807463 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221002-045227055807463 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221002-045227055807463]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:7d0965650dd9ec6556e8ec141273af9a7bf0f0877e60262f2d73db55f4fb418e]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:76f113a30c2e0316abc83ebc9d283ac40d701912a5270c77e9189d1455ac445e Associated tags: - 0792c749-d9e4-44fb-ab94-471377a13ff7 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:0792c749-d9e4-44fb-ab94-471377a13ff7]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:76f113a30c2e0316abc83ebc9d283ac40d701912a5270c77e9189d1455ac445e]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:f9114f44a19651c084974681bbedb22dbc5ff7e5398eaed861fbf32e67fec6f2 Associated tags: - eba84d11-3a84-43b8-ab7c-6e80513bedde Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:eba84d11-3a84-43b8-ab7c-6e80513bedde]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:f9114f44a19651c084974681bbedb22dbc5ff7e5398eaed861fbf32e67fec6f2]. Removed the container > Task :sdks:python:test-suites:dataflow:py39:validatesContainer FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 359 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py39:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 51m 36s 51 actionable tasks: 41 executed, 4 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/qpwkqijaaadeg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
