See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/545/display/redirect>
Changes: ------------------------------------------ [...truncated 722.68 KB...] INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:00.260Z: JOB_MESSAGE_BASIC: Finished operation ExternalTransform(beam:transforms:xlang:test:comgl)/Combine.perKey(SumLong)/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:00.320Z: JOB_MESSAGE_BASIC: Executing operation ExternalTransform(beam:transforms:xlang:test:comgl)/Combine.perKey(SumLong)/GroupByKey/Read+ExternalTransform(beam:transforms:xlang:test:comgl)/Combine.perKey(SumLong)/Combine.GroupedValues+ExternalTransform(beam:transforms:xlang:test:comgl)/Combine.perKey(SumLong)/Combine.GroupedValues/Extract+ExternalTransform(beam:transforms:xlang:test:comgl)/Values/Values/Map/ParMultiDo(Anonymous)+ExternalTransform(beam:transforms:xlang:test:comgl)/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)/ParMultiDo(VoidKeyToMultimapMaterialization)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write+ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow+ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow.out0/Reshard/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:01.211Z: JOB_MESSAGE_BASIC: Finished operation check_even/Create/Impulse+check_even/Create/FlatMap(<lambda at core.py:2963>)+check_even/Create/Map(decode)+check_even/Group/pair_with_0+check_even/Group/Flatten/OutputIdentity+check_even/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:02.582Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:02.641Z: JOB_MESSAGE_DEBUG: Executing success step success42 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:02.816Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:02.845Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:02.875Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:07.195Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition)+check_even/WindowInto(WindowIntoFn)+check_odd/WindowInto(WindowIntoFn)+check_even/ToVoidKey+check_even/Group/pair_with_1+check_even/Group/Flatten/OutputIdentity+check_even/Group/GroupByKey/Write+check_odd/ToVoidKey+check_odd/Group/pair_with_1+check_odd/Group/Flatten/OutputIdentity+check_odd/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:07.246Z: JOB_MESSAGE_BASIC: Executing operation check_even/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:07.291Z: JOB_MESSAGE_BASIC: Finished operation check_even/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:07.367Z: JOB_MESSAGE_BASIC: Executing operation check_even/Group/GroupByKey/Read+check_even/Group/Map(_merge_tagged_vals_under_key)+check_even/Unkey+check_even/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:06.953Z: JOB_MESSAGE_BASIC: Finished operation ExternalTransform(beam:transforms:xlang:test:comgl)/Combine.perKey(SumLong)/GroupByKey/Read+ExternalTransform(beam:transforms:xlang:test:comgl)/Combine.perKey(SumLong)/Combine.GroupedValues+ExternalTransform(beam:transforms:xlang:test:comgl)/Combine.perKey(SumLong)/Combine.GroupedValues/Extract+ExternalTransform(beam:transforms:xlang:test:comgl)/Values/Values/Map/ParMultiDo(Anonymous)+ExternalTransform(beam:transforms:xlang:test:comgl)/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)/ParMultiDo(VoidKeyToMultimapMaterialization)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write+ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow+ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow.out0/Reshard/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:07.039Z: JOB_MESSAGE_BASIC: Executing operation ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow.out0/Reshard/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:07.080Z: JOB_MESSAGE_BASIC: Finished operation ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow.out0/Reshard/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:07.145Z: JOB_MESSAGE_BASIC: Executing operation ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow.out0/Reshard/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:13.360Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Create/Impulse+check_odd/Create/FlatMap(<lambda at core.py:2963>)+check_odd/Create/Map(decode)+check_odd/Group/pair_with_0+check_odd/Group/Flatten/OutputIdentity+check_odd/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:13.414Z: JOB_MESSAGE_BASIC: Executing operation check_odd/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:13.466Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:13.524Z: JOB_MESSAGE_BASIC: Executing operation check_odd/Group/GroupByKey/Read+check_odd/Group/Map(_merge_tagged_vals_under_key)+check_odd/Unkey+check_odd/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:23.568Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:23.627Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:23.666Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:25.679Z: JOB_MESSAGE_BASIC: Finished operation check_even/Group/GroupByKey/Read+check_even/Group/Map(_merge_tagged_vals_under_key)+check_even/Unkey+check_even/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:28.744Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Group/GroupByKey/Read+check_odd/Group/Map(_merge_tagged_vals_under_key)+check_odd/Unkey+check_odd/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:28.808Z: JOB_MESSAGE_DEBUG: Executing success step success43 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:28.877Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:28.919Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:28.954Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-03-28_17_15_48-17152763496511442004 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.390Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.439Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.495Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:49.450Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:49.496Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:49.528Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.030Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.074Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.130Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.634Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.674Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:23:47.700Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-03-28_17_15_49-880199800527783241 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-03-28_17_15_50-5213579935750484884 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-03-28_17_15_50-8744354175528917562 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-03-28_17_15_44-15967824374380524764 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:11.045Z: JOB_MESSAGE_BASIC: Finished operation ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow.out0/Reshard/Read INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:11.104Z: JOB_MESSAGE_DEBUG: Value "ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/ExtractKeyAndWindow.out0" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:11.171Z: JOB_MESSAGE_BASIC: Executing operation ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/View INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:11.207Z: JOB_MESSAGE_BASIC: Finished operation ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/View INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:11.259Z: JOB_MESSAGE_DEBUG: Value "ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1221#125f7c3aab6a391/View.out0" materialized. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:11.302Z: JOB_MESSAGE_BASIC: Executing operation external_1ExternalTransform(beam:transforms:xlang:test:comgl)/CreateVoid/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/ProcessElementAndRestrictionWithSizing+ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:14.979Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:15.028Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:15.050Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:17.412Z: JOB_MESSAGE_BASIC: Finished operation external_1ExternalTransform(beam:transforms:xlang:test:comgl)/CreateVoid/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/ProcessElementAndRestrictionWithSizing+ExternalTransform(beam:transforms:xlang:test:comgl)/ProduceDefault/ParMultiDo(Anonymous)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/Flatten/OutputIdentity+assert_that/Group/GroupByKey/Write INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:17.479Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:17.530Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:17.578Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-03-28_17_15_47-15829000158466439243 is in state JOB_STATE_DONE INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:22.607Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:22.650Z: JOB_MESSAGE_DEBUG: Executing success step success74 INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:22.725Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:22.765Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:24:22.800Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:25:08.529Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:25:08.566Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO:apache_beam.runners.dataflow.dataflow_runner:2021-03-29T00:25:08.603Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2021-03-28_17_15_49-11643769947449009032 is in state JOB_STATE_DONE test_multi_input_output_with_sideinput (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ERROR test_group_by_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_generate_sequence (apache_beam.io.external.generate_sequence_test.XlangGenerateSequenceTest) ... ok test_combine_per_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_cogroup_by_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_prefix (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_partition (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_combine_globally (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok ====================================================================== ERROR: test_multi_input_output_with_sideinput (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 261, in test_multi_input_output_with_sideinput test_pipeline or self.create_pipeline()) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,> line 124, in run_multi_input_output_with_sideinput assert_that(res['side'], equal_to(['ss']), label='CheckSide') File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,> line 582, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/testing/test_pipeline.py";,> line 112, in run False if self.not_use_test_runner_api else test_runner_api)) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,> line 561, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py";,> line 57, in run_pipeline self).run_pipeline(pipeline, options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,> line 586, in run_pipeline self.dataflow_client.create_job(self.job), self) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 260, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 644, in create_job self.create_job_description(job) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 757, in create_job_description resources = self._stage_resources(job.proto_pipeline, job.options) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 597, in _stage_resources resources, staging_location=google_cloud_options.staging_location) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/portability/stager.py";,> line 385, in stage_job_resources file_path, FileSystems.join(staging_location, staged_path)) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 1022, in stage_artifact local_path_to_artifact, artifact_name) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 260, in wrapper return fun(*args, **kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 561, in _gcs_file_copy self.stage_file(to_folder, to_name, f, total_size=total_size) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 622, in stage_file response = self._storage_client.objects.Insert(request, upload=upload) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,> line 1156, in Insert upload=upload, upload_config=upload_config) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/base_api.py";,> line 715, in _RunMethod http_request, client=self.client) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/transfer.py";,> line 908, in InitializeUpload return self.StreamInChunks() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/transfer.py";,> line 1020, in StreamInChunks additional_headers=additional_headers) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/transfer.py";,> line 957, in __StreamMedia response = send_func(self.stream.tell()) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/transfer.py";,> line 943, in CallSendChunk start, additional_headers=additional_headers) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/transfer.py";,> line 1120, in __SendChunk return self.__SendMediaRequest(request, end) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/transfer.py";,> line 1033, in __SendMediaRequest retries=self.num_retries, check_response_func=CheckResponse) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/http_wrapper.py";,> line 350, in MakeRequest check_response_func=check_response_func) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/apitools/base/py/http_wrapper.py";,> line 400, in _MakeRequestNoRetry redirections=redirections, connection_type=connection_type) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/oauth2client/transport.py";,> line 175, in new_request redirections, connection_type) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/oauth2client/transport.py";,> line 282, in request connection_type=connection_type) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/oauth2client/transport.py";,> line 175, in new_request redirections, connection_type) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/oauth2client/transport.py";,> line 282, in request connection_type=connection_type) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/httplib2/__init__.py";,> line 1991, in request cachekey, File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/httplib2/__init__.py";,> line 1651, in _request conn, request_uri, method, body, headers File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/httplib2/__init__.py";,> line 1589, in _conn_request response = conn.getresponse() File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse response.begin() File "/usr/lib/python3.6/http/client.py", line 297, in begin version, status, reason = self._read_status() File "/usr/lib/python3.6/http/client.py", line 258, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") File "/usr/lib/python3.6/socket.py", line 586, in readinto return self._sock.recv_into(b) File "/usr/lib/python3.6/ssl.py", line 1012, in recv_into return self.read(nbytes, buffer) File "/usr/lib/python3.6/ssl.py", line 874, in read return self._sslobj.read(len, buffer) File "/usr/lib/python3.6/ssl.py", line 631, in read v = self._sslobj.read(len, buffer) socket.timeout: The read operation timed out -------------------- >> begin captured logging << -------------------- root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] root: DEBUG: Unhandled type_constraint: Union[] apache_beam.runners.portability.stager: INFO: Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz";> to staging location. root: WARNING: Make sure that locally built Python SDK docker image has Python 3.6 interpreter. root: INFO: Default Python SDK image for environment is apache/beam_python3.6_sdk:2.30.0.dev root: INFO: Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python36-fnapi:beam-master-20210318 root: INFO: Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python36-fnapi:beam-master-20210318" for Docker environment apache_beam.runners.dataflow.internal.apiclient: INFO: Defaulting to the temp_location as staging_location: gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494 apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/pipeline.pb... apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/pipeline.pb in 0 seconds. apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/icedtea-sound-iX5usnMhooWFVsDnq3d6iP0jxH1RLWWxipZhY6Hvsnw.jar... apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/icedtea-sound-iX5usnMhooWFVsDnq3d6iP0jxH1RLWWxipZhY6Hvsnw.jar in 0 seconds. apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/jaccess-vLiJE9Opd23Iykd81sLP70H_7nOeFCEONM7N3XuinBg.jar... apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/jaccess-vLiJE9Opd23Iykd81sLP70H_7nOeFCEONM7N3XuinBg.jar in 0 seconds. apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/localedata-eAT2q5pJyQK8p1x9W86L5he9r_dvqTQKnnOkqtS02qQ.jar... apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/localedata-eAT2q5pJyQK8p1x9W86L5he9r_dvqTQKnnOkqtS02qQ.jar in 0 seconds. apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/nashorn-UTZiziZ3oPAMhBKkESP_1iGZIouF7eojtmkEsRvoc30.jar... apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/nashorn-UTZiziZ3oPAMhBKkESP_1iGZIouF7eojtmkEsRvoc30.jar in 17 seconds. apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/cldrdata-ZPGB77uRDC5AOKy08ig7v7wS0921ni2fYpQfHzSFeKM.jar... apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/cldrdata-ZPGB77uRDC5AOKy08ig7v7wS0921ni2fYpQfHzSFeKM.jar in 0 seconds. apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/dnsns-4wiJPg1GaUSuVvIrRFHNZbcPHE7Dixp3MEN1jxLCsmE.jar... apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/dnsns-4wiJPg1GaUSuVvIrRFHNZbcPHE7Dixp3MEN1jxLCsmE.jar in 0 seconds. apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0329001523-055420.1616976923.056359/beam-sdks-java-testing-expansion-service-testExpansionService-2.30.0-SNAPSHOT-cVGXPTs1P4nfDbGdEqdrglsC7NsxzpOqutQ1b1SC9QQ.jar... root: DEBUG: Caught socket error, retrying: [Errno 32] Broken pipe root: DEBUG: Retrying request to url https://www.googleapis.com/resumable/upload/storage/v1/b/dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/o?alt=json&name=beamapp-jenkins-0329001523-055420.1616976923.056359%2Fbeam-sdks-java-testing-expansion-service-testExpansionService-2.30.0-SNAPSHOT-cVGXPTs1P4nfDbGdEqdrglsC7NsxzpOqutQ1b1SC9QQ.jar&uploadType=resumable&upload_id=ABg5-UzpbjaH7PxsUpS1Bq2MGhrQ3HIPFy1YgVs8_watFrrPR6wxDrdulj4vakLtfduXoSyvKwpyy9O-CQNKnHG2esekqd-oLA after exception [Errno 32] Broken pipe root: DEBUG: Caught socket error, retrying: The read operation timed out root: DEBUG: Retrying request to url https://www.googleapis.com/resumable/upload/storage/v1/b/dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/o?alt=json&name=beamapp-jenkins-0329001523-055420.1616976923.056359%2Fbeam-sdks-java-testing-expansion-service-testExpansionService-2.30.0-SNAPSHOT-cVGXPTs1P4nfDbGdEqdrglsC7NsxzpOqutQ1b1SC9QQ.jar&uploadType=resumable&upload_id=ABg5-UzpbjaH7PxsUpS1Bq2MGhrQ3HIPFy1YgVs8_watFrrPR6wxDrdulj4vakLtfduXoSyvKwpyy9O-CQNKnHG2esekqd-oLA after exception The read operation timed out root: DEBUG: Caught socket error, retrying: The read operation timed out root: DEBUG: Retrying request to url https://www.googleapis.com/resumable/upload/storage/v1/b/dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/o?alt=json&name=beamapp-jenkins-0329001523-055420.1616976923.056359%2Fbeam-sdks-java-testing-expansion-service-testExpansionService-2.30.0-SNAPSHOT-cVGXPTs1P4nfDbGdEqdrglsC7NsxzpOqutQ1b1SC9QQ.jar&uploadType=resumable&upload_id=ABg5-UzpbjaH7PxsUpS1Bq2MGhrQ3HIPFy1YgVs8_watFrrPR6wxDrdulj4vakLtfduXoSyvKwpyy9O-CQNKnHG2esekqd-oLA after exception The read operation timed out root: DEBUG: Caught socket error, retrying: The read operation timed out root: DEBUG: Retrying request to url https://www.googleapis.com/resumable/upload/storage/v1/b/dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/o?alt=json&name=beamapp-jenkins-0329001523-055420.1616976923.056359%2Fbeam-sdks-java-testing-expansion-service-testExpansionService-2.30.0-SNAPSHOT-cVGXPTs1P4nfDbGdEqdrglsC7NsxzpOqutQ1b1SC9QQ.jar&uploadType=resumable&upload_id=ABg5-UzpbjaH7PxsUpS1Bq2MGhrQ3HIPFy1YgVs8_watFrrPR6wxDrdulj4vakLtfduXoSyvKwpyy9O-CQNKnHG2esekqd-oLA after exception The read operation timed out --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: nosetests-xlangValidateRunner.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 8 tests in 620.249s FAILED (errors=1) > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:38b90636c2d1a04e1e912eef0b2b9ca48a64c8bdbc1afbe986cb599aaa087882 Associated tags: - 20210329000058 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210329000058 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210329000058]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:38b90636c2d1a04e1e912eef0b2b9ca48a64c8bdbc1afbe986cb599aaa087882]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 24m 59s 112 actionable tasks: 83 executed, 25 from cache, 4 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/6i7hxvgfsq2ne Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
