See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/2458/display/redirect?page=changes>
Changes: [ruwan.lambrichts] Clarify additional_bq_parameters argument [esert] Bump a throttling counter on BigQueryRead retries due to [noreply] [BEAM-5097] Increment counter for "small words" in go SDK example ------------------------------------------ [...truncated 216.04 KB...] [1m def __ProcessHttpResponse(self, method_config, http_response, request):[0m [1m """Process the given http response."""[0m [1m if http_response.status_code not in (http_client.OK,[0m [1m http_client.CREATED,[0m [1m http_client.NO_CONTENT):[0m [1m> raise exceptions.HttpError.FromResponse([0m [1m http_response, method_config=method_config, request=request)[0m [1m[31mE apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2021-09-09_23_57_49-13970793522758530662?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Fri, 10 Sep 2021 07:07:51 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '400', 'content-length': '316', '-content-encoding': 'gzip'}>, content <{[0m [1m[31mE "error": {[0m [1m[31mE "code": 400,[0m [1m[31mE "message": "(dfeda32b2621dab6): Workflow modification failed. Causes: (3b902cf7dc17aebe): Operation cancel not allowed for job 2021-09-09_23_57_49-13970793522758530662. Job is not yet ready for canceling. Please retry in a few minutes.",[0m [1m[31mE "status": "FAILED_PRECONDITION"[0m [1m[31mE }[0m [1m[31mE }[0m [1m[31mE >[0m [1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py[0m:603: HttpBadRequestError ------------------------------ Captured log call ------------------------------- [32mINFO [0m apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:'] [32mINFO [0m apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz";> to staging location. [33mWARNING [0m root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter. [32mINFO [0m root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev [32mINFO [0m root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809 [32mINFO [0m root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment [32mINFO [0m apache_beam.internal.gcp.auth:auth.py:106 Setting socket default timeout to 60 seconds. [32mINFO [0m apache_beam.internal.gcp.auth:auth.py:108 socket default timeout is 60.0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/requirements.txt... [32mINFO [0m oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token [32mINFO [0m oauth2client.transport:transport.py:157 Attempting refresh to obtain initial access_token [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/requirements.txt in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/pbr-5.6.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/pbr-5.6.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/mock-2.0.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/mock-2.0.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/six-1.16.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/six-1.16.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/soupsieve-2.2.1.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/soupsieve-2.2.1.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/PyHamcrest-1.10.1.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/PyHamcrest-1.10.1.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/parameterized-0.7.5.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/parameterized-0.7.5.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/beautifulsoup4-4.9.3.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/beautifulsoup4-4.9.3.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/beautifulsoup4-4.10.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/beautifulsoup4-4.10.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/dataflow_python_sdk.tar... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/dataflow_python_sdk.tar in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/dataflow-worker.jar... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/dataflow-worker.jar in 4 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/pipeline.pb... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910065743-388911.1631257063.389076/pipeline.pb in 0 seconds. [33mWARNING [0m apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20'] [33mWARNING [0m apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20'] [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job clientRequestId: '20210910065743390297-9101' createTime: '2021-09-10T06:57:50.619687Z' currentStateTime: '1970-01-01T00:00:00Z' id: '2021-09-09_23_57_49-13970793522758530662' location: 'us-central1' name: 'beamapp-jenkins-0910065743-388911' projectId: 'apache-beam-testing' stageStates: [] startTime: '2021-09-10T06:57:50.619687Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)> [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-09_23_57_49-13970793522758530662] [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-09_23_57_49-13970793522758530662 [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-09_23_57_49-13970793522758530662?project=apache-beam-testing [31m[1m_______________ CombineFnLifecycleTest.test_non_liftable_combine _______________[0m [gw0] linux -- Python 3.8.5 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8> self = <apache_beam.transforms.combinefn_lifecycle_test.CombineFnLifecycleTest testMethod=test_non_liftable_combine> [1m @skip_unless_v2[0m [1m def test_non_liftable_combine(self):[0m [1m> run_combine(self.pipeline, lift_combiners=False)[0m [1m[31mapache_beam/transforms/combinefn_lifecycle_test.py[0m:69: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [1m[31mapache_beam/transforms/combinefn_lifecycle_pipeline.py[0m:124: in run_combine [1m assert_that(pcoll, equal_to([(expected_result, expected_result)]))[0m [1m[31mapache_beam/pipeline.py[0m:586: in __exit__ [1m self.result = self.run()[0m [1m[31mapache_beam/testing/test_pipeline.py[0m:112: in run [1m result = super(TestPipeline, self).run([0m [1m[31mapache_beam/pipeline.py[0m:565: in run [1m return self.runner.run_pipeline(self, self._options)[0m [1m[31mapache_beam/runners/dataflow/test_dataflow_runner.py[0m:72: in run_pipeline [1m self.result.cancel()[0m [1m[31mapache_beam/runners/dataflow/dataflow_runner.py[0m:1650: in cancel [1m if not self._runner.dataflow_client.modify_job_state([0m [1m[31mapache_beam/utils/retry.py[0m:253: in wrapper [1m return fun(*args, **kwargs)[0m [1m[31mapache_beam/runners/dataflow/internal/apiclient.py[0m:860: in modify_job_state [1m self._client.projects_locations_jobs.Update(request)[0m [1m[31mapache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py[0m:1058: in Update [1m return self._RunMethod([0m [1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py[0m:731: in _RunMethod [1m return self.ProcessHttpResponse(method_config, http_response, request)[0m [1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py[0m:737: in ProcessHttpResponse [1m self.__ProcessHttpResponse(method_config, http_response, request))[0m _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <apache_beam.runners.dataflow.internal.clients.dataflow.dataflow_v1b3_client.DataflowV1b3.ProjectsLocationsJobsService object at 0x7f8eedbe9f40> method_config = <ApiMethodInfo relative_path: 'v1b3/projects/{projectId}/locations/{location}/jobs/{jobId}' method_id: 'dataflow.pro...DataflowProjectsLocationsJobsUpdateRequest' response_type_name: 'Job' request_field: 'job' supports_download: False> http_response = Response(info={'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Fri, 1...is.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2021-09-10_00_08_46-10804524149224577070?alt=json') request = <DataflowProjectsLocationsJobsUpdateRequest job: <Job requestedState: RequestedStateValueValuesEnum(JOB_STATE_CANCEL...les: []> jobId: '2021-09-10_00_08_46-10804524149224577070' location: 'us-central1' projectId: 'apache-beam-testing'> [1m def __ProcessHttpResponse(self, method_config, http_response, request):[0m [1m """Process the given http response."""[0m [1m if http_response.status_code not in (http_client.OK,[0m [1m http_client.CREATED,[0m [1m http_client.NO_CONTENT):[0m [1m> raise exceptions.HttpError.FromResponse([0m [1m http_response, method_config=method_config, request=request)[0m [1m[31mE apitools.base.py.exceptions.HttpBadRequestError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2021-09-10_00_08_46-10804524149224577070?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Fri, 10 Sep 2021 07:18:52 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '400', 'content-length': '315', '-content-encoding': 'gzip'}>, content <{[0m [1m[31mE "error": {[0m [1m[31mE "code": 400,[0m [1m[31mE "message": "(74e0a7d7a90da795): Workflow modification failed. Causes: (ce7d64d92bb8061): Operation cancel not allowed for job 2021-09-10_00_08_46-10804524149224577070. Job is not yet ready for canceling. Please retry in a few minutes.",[0m [1m[31mE "status": "FAILED_PRECONDITION"[0m [1m[31mE }[0m [1m[31mE }[0m [1m[31mE >[0m [1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py[0m:603: HttpBadRequestError ------------------------------ Captured log call ------------------------------- [33mWARNING [0m apache_beam.transforms.core:core.py:2337 GroupByKey: Unsafe trigger `AfterCount(5)` detected (reason: CONDITION_NOT_GUARANTEED|MAY_FINISH). This is being allowed because --allow_unsafe_triggers is set. This could lead to missing or incomplete groups. [33mWARNING [0m apache_beam.transforms.core:core.py:2337 GroupByKey: Unsafe trigger `AfterCount(5)` detected (reason: CONDITION_NOT_GUARANTEED|MAY_FINISH). This is being allowed because --allow_unsafe_triggers is set. This could lead to missing or incomplete groups. [32mINFO [0m apache_beam.runners.portability.stager:stager.py:644 Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/bin/python3.8',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:'] [32mINFO [0m apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/build/apache-beam.tar.gz";> to staging location. [33mWARNING [0m root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter. [32mINFO [0m root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev [32mINFO [0m root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809 [32mINFO [0m root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/requirements.txt... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/requirements.txt in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/pbr-5.6.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/pbr-5.6.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/mock-2.0.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/mock-2.0.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/six-1.16.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/six-1.16.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/soupsieve-2.2.1.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/soupsieve-2.2.1.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/PyHamcrest-1.10.1.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/PyHamcrest-1.10.1.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/parameterized-0.7.5.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/parameterized-0.7.5.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/beautifulsoup4-4.9.3.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/beautifulsoup4-4.9.3.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/beautifulsoup4-4.10.0.tar.gz... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/beautifulsoup4-4.10.0.tar.gz in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/dataflow_python_sdk.tar... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/dataflow_python_sdk.tar in 0 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/dataflow-worker.jar... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/dataflow-worker.jar in 4 seconds. [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/pipeline.pb... [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0910070840-344406.1631257720.344572/pipeline.pb in 0 seconds. [33mWARNING [0m apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20'] [33mWARNING [0m apache_beam.options.pipeline_options:pipeline_options.py:309 Discarding unparseable args: ['--sleep_secs=20'] [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job clientRequestId: '20210910070840345666-2535' createTime: '2021-09-10T07:08:47.861174Z' currentStateTime: '1970-01-01T00:00:00Z' id: '2021-09-10_00_08_46-10804524149224577070' location: 'us-central1' name: 'beamapp-jenkins-0910070840-344406' projectId: 'apache-beam-testing' stageStates: [] startTime: '2021-09-10T07:08:47.861174Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)> [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-10_00_08_46-10804524149224577070] [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-10_00_08_46-10804524149224577070 [32mINFO [0m apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_00_08_46-10804524149224577070?project=apache-beam-testing [33m=============================== warnings summary ===============================[0m <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> - [31m[1m======== 2 failed, 29 passed, 1 skipped, 8 warnings in 2645.47 seconds =========[0m > Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests > FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 149 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerBatchTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 181 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 40m 57s 84 actionable tasks: 56 executed, 28 from cache Publishing build scan... https://gradle.com/s/7a2fm4gydsdnc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
