See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/7754/display/redirect?page=changes>
Changes: [Alan Myrvold] [BEAM-10912] Increase Jenkins job logs retention from 14 to 30 days [Pablo Estrada] Revert "Merge pull request #13617 from [BEAM-11289] [Python] Integrate [Pablo Estrada] Revert type: ignore caused by PR 13617 ------------------------------------------ [...truncated 115.69 KB...] WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 3.699920817034947 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-* Traceback for above exception (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 253, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 120, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 8.595824543540447 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-* Traceback for above exception (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 253, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 120, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 16.119571492984747 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-* Traceback for above exception (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 253, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 120, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) WARNING:apache_beam.utils.retry:Retry with exponential backoff: waiting for 27.72818587758053 seconds before retrying _read_with_retry because we caught exception: OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-* Traceback for above exception (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 253, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 120, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) > Task :sdks:python:test-suites:dataflow:py37:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. > Task :sdks:python:test-suites:dataflow:py37:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. > Task :sdks:python:test-suites:dataflow:py37:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. > Task :sdks:python:test-suites:dataflow:py38:validatesContainer WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter. > Task :sdks:python:test-suites:dataflow:py37:validatesContainer test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok ---------------------------------------------------------------------- XML: nosetests-beam_python3.7_sdk.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 4 tests in 1495.767s OK echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:0af981543860b0ba67a8254d037376332f49531985b28c5653b09eb03b4fa408 Associated tags: - 20210504-062111518716913 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210504-062111518716913 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20210504-062111518716913]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:0af981543860b0ba67a8254d037376332f49531985b28c5653b09eb03b4fa408]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:11c5536dbd457e567be5e986374d54f481059580d9613639166063fde144b533 Associated tags: - 1bdcd92a-c9de-4164-9855-60a3381bc8e5 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:1bdcd92a-c9de-4164-9855-60a3381bc8e5]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:11c5536dbd457e567be5e986374d54f481059580d9613639166063fde144b533]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:9c7e69bab81452d8a05d559bc811064e0083661c3fac6d149304153d6c1c40bb Associated tags: - 16d7a75f-b6e8-4485-8991-adafd2224f24 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:16d7a75f-b6e8-4485-8991-adafd2224f24]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:9c7e69bab81452d8a05d559bc811064e0083661c3fac6d149304153d6c1c40bb]. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok ====================================================================== ERROR: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py";,> line 55, in test_wordcount_fnapi_it self._run_wordcount_it(wordcount.run, experiment='beam_fn_api') File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py";,> line 112, in _run_wordcount_it save_main_session=False, File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py";,> line 89, in run output | 'Write' >> WriteToText(known_args.output) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,> line 582, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,> line 537, in run self._options).run(False) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,> line 561, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py";,> line 69, in run_pipeline hc_assert_that(self.result, pickler.loads(on_success_matcher)) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/hamcrest/core/assert_that.py";,> line 44, in assert_that _assert_match(actual=arg1, matcher=arg2, reason=arg3) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/hamcrest/core/assert_that.py";,> line 52, in _assert_match if not matcher.matches(actual): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/hamcrest/core/core/allof.py";,> line 19, in matches if not matcher.matches(item): File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/hamcrest/core/base_matcher.py";,> line 28, in matches match_result = self._matches(item) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 140, in _matches read_lines = self._read_with_retry() File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 266, in wrapper raise exn.with_traceback(exn_traceback) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 253, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py";,> line 120, in _read_with_retry raise IOError('No such file or directory: %s' % self.file_path) OSError: No such file or directory: gs://temp-storage-for-end-to-end-tests/output/1620109417443/results*-of-* -------------------- >> begin captured stdout << --------------------- Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-03_23_23_39-8035051870230003291?project=apache-beam-testing --------------------- >> end captured stdout << ---------------------- ---------------------------------------------------------------------- XML: nosetests-beam_python3.6_sdk.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 4 tests in 1528.812s FAILED (errors=1) cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:7ccc1ec1eb5b971437d4a44b17f67c1052d2d946a519675d0e557d85f316f299 Associated tags: - 20210504-062113534638794 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210504-062113534638794 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20210504-062113534638794]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:7ccc1ec1eb5b971437d4a44b17f67c1052d2d946a519675d0e557d85f316f299]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:e8b9ddbc3c1d08bcb507b250f6db171fe3ecbc6ef792d1bc6f8f73365c1bc73a Associated tags: - e292b0fe-d546-47ba-896e-2f3fcff196f0 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:e292b0fe-d546-47ba-896e-2f3fcff196f0]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:e8b9ddbc3c1d08bcb507b250f6db171fe3ecbc6ef792d1bc6f8f73365c1bc73a]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:f3941fb25a62bf5cc98b3ec4d1d87c9a1659be59d276f22e5b8823b728486e65 Associated tags: - a10b5beb-218c-494b-b78d-224582c263ac Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:a10b5beb-218c-494b-b78d-224582c263ac]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:f3941fb25a62bf5cc98b3ec4d1d87c9a1659be59d276f22e5b8823b728486e65]. > Task :sdks:python:test-suites:dataflow:py36:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py38:validatesContainer test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_cloud_build (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_wordcount_it_with_prebuilt_sdk_container_local_docker (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok ---------------------------------------------------------------------- XML: nosetests-beam_python3.8_sdk.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 4 tests in 1537.852s OK echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST" cleanup_container docker images --format '{{.Repository}}:{{.Tag}}' | grep $PREBUILD_SDK_CONTAINER_REGISTRY_PATH Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:951c8a95b8f0db3499347fcf8e98aa1e92bcb3ce71c7e17ad5ecbbf64bb32054 Associated tags: - 20210504-062149670848720 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210504-062149670848720 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20210504-062149670848720]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:951c8a95b8f0db3499347fcf8e98aa1e92bcb3ce71c7e17ad5ecbbf64bb32054]. gcloud container images list-tags $PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk --format="get(digest)" Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:747eb88e5941333e6e866f4e60aab632150b50da9425295dd15779ca0f84127c Associated tags: - 3b32b753-89f6-4e22-8871-c19129103eca Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:3b32b753-89f6-4e22-8871-c19129103eca]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:747eb88e5941333e6e866f4e60aab632150b50da9425295dd15779ca0f84127c]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:d60b76ba58c1c26c6df08f408d1fe89a4376c2f7a7302190e02c58641014ad61 Associated tags: - 26ab4f49-3031-4675-86dc-23d3536b4c00 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:26ab4f49-3031-4675-86dc-23d3536b4c00]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:d60b76ba58c1c26c6df08f408d1fe89a4376c2f7a7302190e02c58641014ad61]. FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 248 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py36:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 49m 2s 51 actionable tasks: 47 executed, 4 up-to-date Publishing build scan... https://gradle.com/s/acwii7iodsdtk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
