See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/7620/display/redirect?page=changes>
Changes: [suztomo] Moving from vendored gRPC 1.26 to 1.36 [Ismaël Mejía] Update httplib2 to version 1.19.1 on Python container [Ismaël Mejía] Update website build dependencies [noreply] [BEAM-9185] Publish pre-release python artifacts (RCs) to PyPI (#14325) ------------------------------------------ [...truncated 114.84 KB...] > Task :sdks:python:test-suites:dataflow:py38:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 4.921418047121905 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1617215458568/results*-of-* Traceback for above exception (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 260, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 122, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 7.053379237661139 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1617215458568/results*-of-* Traceback for above exception (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 260, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 122, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 11.834472316488402 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1617215458568/results*-of-* Traceback for above exception (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 260, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 122, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 21.214264599554195 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1617215458568/results*-of-* Traceback for above exception (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 260, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 122, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) > Task :sdks:python:test-suites:dataflow:py37:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. > Task :sdks:python:test-suites:dataflow:py37:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. > Task :sdks:python:test-suites:dataflow:py37:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok ---------------------------------------------------------------------- XML: nosetests-beam_python3.6_sdk.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 4 tests in 1452.771s OK echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:77993f7201a75005e2942c1abe77a818e322fbb558bdfb300f0a11ad7b8b9d9c Associated tags: - 20210331-182632300674746 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210331-182632300674746 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210331-182632300674746]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:77993f7201a75005e2942c1abe77a818e322fbb558bdfb300f0a11ad7b8b9d9c]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:52ffb16394e4ca601c3ebfa58cd695b9d0277d6cb973a028d42199fc496c7cbc Associated tags: - 4955a043-2072-4c15-9624-12501d488789 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:4955a043-2072-4c15-9624-12501d488789]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:52ffb16394e4ca601c3ebfa58cd695b9d0277d6cb973a028d42199fc496c7cbc]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:ce460e801697fe409ca9bb1432c094cfe3a148019ac081ee1722ba1c8274cee4 Associated tags: - 7ae38d92-b5b2-4924-b53b-c48c5c9dc4c6 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:7ae38d92-b5b2-4924-b53b-c48c5c9dc4c6]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:ce460e801697fe409ca9bb1432c094cfe3a148019ac081ee1722ba1c8274cee4]. > Task :sdks:python:test-suites:dataflow:py37:validatesContainer test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok ---------------------------------------------------------------------- XML: nosetests-beam_python3.7_sdk.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 4 tests in 1497.505s OK echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:552d1031976a081d6e76e8e12fdc8f0d8143aa163c4a9ba8841f4e2c01b8fc79 Associated tags: - 20210331-182632443176574 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210331-182632443176574 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210331-182632443176574]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:552d1031976a081d6e76e8e12fdc8f0d8143aa163c4a9ba8841f4e2c01b8fc79]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:8f1f1747d949a541b19e6c142308b6dd636b5192e66109b53d6dc915c5c13978 Associated tags: - d0929615-b944-4798-9f4a-e7f50ddcb1bc Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:d0929615-b944-4798-9f4a-e7f50ddcb1bc]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:8f1f1747d949a541b19e6c142308b6dd636b5192e66109b53d6dc915c5c13978]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:395d9cb36b1f00044dafeaa049992934683b46977cc9af194dcc01187e3db755 Associated tags: - 476715de-be23-4a8d-859d-b28dc8b49b34 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:476715de-be23-4a8d-859d-b28dc8b49b34]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:395d9cb36b1f00044dafeaa049992934683b46977cc9af194dcc01187e3db755]. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok ====================================================================== ERROR: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py";,> line 57, in test_wordcount_fnapi_it self._run_wordcount_it(wordcount.run, experiment='beam_fn_api') File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py";,> line 112, in _run_wordcount_it run_wordcount( File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py";,> line 94, in run output | 'Write' >> WriteToText(known_args.output) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,> line 582, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,> line 529, in run return Pipeline.from_runner_api( File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,> line 561, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py";,> line 72, in run_pipeline hc_assert_that(self.result, pickler.loads(on_success_matcher)) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hamcrest/core/assert_that.py";,> line 44, in assert_that _assert_match(actual=arg1, matcher=arg2, reason=arg3) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hamcrest/core/assert_that.py";,> line 52, in _assert_match if not matcher.matches(actual): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hamcrest/core/core/allof.py";,> line 19, in matches if not matcher.matches(item): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hamcrest/core/base_matcher.py";,> line 28, in matches match_result = self._matches(item) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 142, in _matches read_lines = self._read_with_retry() File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 273, in wrapper raise_with_traceback(exn, exn_traceback) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/future/utils/__init__.py";,> line 446, in raise_with_traceback raise exc.with_traceback(traceback) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 260, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 122, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1617215458568/results*-of-* -------------------- >> begin captured stdout << --------------------- Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-03-31_11_31_00-14937335647233303051?project=apache-beam-testing --------------------- >> end captured stdout << ---------------------- ---------------------------------------------------------------------- XML: nosetests-beam_python3.8_sdk.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 4 tests in 1541.611s FAILED (errors=1) cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:e712676c2b81cdd85f914f18dd4bd9dfaca6886b4cddc8761010bd646d0c48b6 Associated tags: - 20210331-182632443297099 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210331-182632443297099 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210331-182632443297099]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:e712676c2b81cdd85f914f18dd4bd9dfaca6886b4cddc8761010bd646d0c48b6]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:372f2d17c9f1c20f0c26fdaa7361b821406ac5416a0df5ade29d4cd56ea80755 Associated tags: - 99fc1b43-03e2-407c-a268-ff07ddd65471 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:99fc1b43-03e2-407c-a268-ff07ddd65471]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:372f2d17c9f1c20f0c26fdaa7361b821406ac5416a0df5ade29d4cd56ea80755]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a70c3c3b1227f4d88cb572a0b7fb5f50b622975bd1dbac619e1df7800df2c391 Associated tags: - 2c97b256-4241-45ec-a755-d037fdfd62e3 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:2c97b256-4241-45ec-a755-d037fdfd62e3]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:a70c3c3b1227f4d88cb572a0b7fb5f50b622975bd1dbac619e1df7800df2c391]. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 248 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 55m 48s 51 actionable tasks: 47 executed, 4 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/bfnzqxrbboif6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
