See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/393/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-11834] Enable arrays literals to have null values. [Pablo Estrada] Enable SideInput metrics for DF worker. These have been launched on [noreply] [BEAM-10708] Support SqlTransform in container (#13944) ------------------------------------------ [...truncated 2.15 MB...] location: 'us-central1' name: 'beamapp-jenkins-0219002204-339632' projectId: 'apache-beam-testing' stageStates: [] startTime: '2021-02-19T00:22:12.650005Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2021-02-18_16_22_11-11624313303320868223] apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2021-02-18_16_22_11-11624313303320868223 apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_11-11624313303320868223?project=apache-beam-testing apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2021-02-18_16_22_11-11624313303320868223 is in state JOB_STATE_RUNNING apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:14.869Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2021-02-18_16_22_11-11624313303320868223. The number of workers will be between 1 and 1000. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:15.004Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2021-02-18_16_22_11-11624313303320868223. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:17.955Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-c. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:18.811Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.056Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step check_odd/Group/GroupByKey: GroupByKey not followed by a combiner. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.090Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step check_even/Group/GroupByKey: GroupByKey not followed by a combiner. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.125Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.147Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.253Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.285Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.321Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/WindowInto(WindowIntoFn) into ExternalTransform(beam:transforms:xlang:test:partition) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.353Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/WindowInto(WindowIntoFn) into ExternalTransform(beam:transforms:xlang:test:partition) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.386Z: JOB_MESSAGE_DETAILED: Unzipping flatten s8 for input s6.None apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.422Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of check_even/Group/GroupByKey/Reify, through flatten check_even/Group/Flatten, into producer check_even/Group/pair_with_0 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.457Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/GroupByKey/Reify into check_even/Group/pair_with_1 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.524Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/GroupByKey/GroupByWindow into check_even/Group/GroupByKey/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.557Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/Map(_merge_tagged_vals_under_key) into check_even/Group/GroupByKey/GroupByWindow apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.588Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Unkey into check_even/Group/Map(_merge_tagged_vals_under_key) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.616Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Match into check_even/Unkey apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.650Z: JOB_MESSAGE_DETAILED: Unzipping flatten s18 for input s16.None apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.681Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of check_odd/Group/GroupByKey/Reify, through flatten check_odd/Group/Flatten, into producer check_odd/Group/pair_with_0 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.715Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/GroupByKey/Reify into check_odd/Group/pair_with_1 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.780Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/GroupByKey/GroupByWindow into check_odd/Group/GroupByKey/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.816Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/Map(_merge_tagged_vals_under_key) into check_odd/Group/GroupByKey/GroupByWindow apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.857Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Unkey into check_odd/Group/Map(_merge_tagged_vals_under_key) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.886Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Match into check_odd/Unkey apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.918Z: JOB_MESSAGE_DETAILED: Unzipping flatten s8-u22 for input s9-reify-value9-c20 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:19.970Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of check_even/Group/GroupByKey/Write, through flatten check_even/Group/Flatten/Unzipped-1, into producer check_even/Group/GroupByKey/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.003Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/GroupByKey/Write into check_even/Group/GroupByKey/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.036Z: JOB_MESSAGE_DETAILED: Unzipping flatten s18-u27 for input s19-reify-value0-c25 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.070Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of check_odd/Group/GroupByKey/Write, through flatten check_odd/Group/Flatten/Unzipped-1, into producer check_odd/Group/GroupByKey/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.106Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/GroupByKey/Write into check_odd/Group/GroupByKey/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.126Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/ToVoidKey into check_even/WindowInto(WindowIntoFn) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.147Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/pair_with_1 into check_even/ToVoidKey apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.179Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/ToVoidKey into check_odd/WindowInto(WindowIntoFn) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.208Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/pair_with_1 into check_odd/ToVoidKey apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.246Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/pair_with_0 into check_even/Create/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.279Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/pair_with_0 into check_odd/Create/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.312Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.353Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.391Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:20.448Z: JOB_MESSAGE_DEBUG: Assigning stage ids. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:21.004Z: JOB_MESSAGE_DEBUG: Executing wait step start39 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:21.078Z: JOB_MESSAGE_BASIC: Executing operation Create/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:21.119Z: JOB_MESSAGE_BASIC: Finished operation Create/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:21.124Z: JOB_MESSAGE_BASIC: Executing operation check_odd/Group/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:21.168Z: JOB_MESSAGE_BASIC: Executing operation check_even/Group/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:21.175Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:21.196Z: JOB_MESSAGE_DEBUG: Value "Create/Read.out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:21.205Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-c... apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:22.103Z: JOB_MESSAGE_BASIC: Finished operation check_even/Group/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:22.151Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Group/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:22.175Z: JOB_MESSAGE_DEBUG: Value "check_even/Group/GroupByKey/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:22.221Z: JOB_MESSAGE_DEBUG: Value "check_odd/Group/GroupByKey/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:22.257Z: JOB_MESSAGE_BASIC: Executing operation check_even/Create/Read+check_even/Group/pair_with_0+check_even/Group/GroupByKey/Reify+check_even/Group/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:22.301Z: JOB_MESSAGE_BASIC: Executing operation ExternalTransform(beam:transforms:xlang:test:partition)+check_odd/WindowInto(WindowIntoFn)+check_even/WindowInto(WindowIntoFn)+check_even/ToVoidKey+check_even/Group/pair_with_1+check_even/Group/GroupByKey/Reify+check_even/Group/GroupByKey/Write+check_odd/ToVoidKey+check_odd/Group/pair_with_1+check_odd/Group/GroupByKey/Reify+check_odd/Group/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:22.335Z: JOB_MESSAGE_BASIC: Executing operation check_odd/Create/Read+check_odd/Group/pair_with_0+check_odd/Group/GroupByKey/Reify+check_odd/Group/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:30.102Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:22:57.740Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:23:45.697Z: JOB_MESSAGE_DETAILED: Workers have started successfully. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:23:45.741Z: JOB_MESSAGE_DETAILED: Workers have started successfully. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:36.358Z: JOB_MESSAGE_ERROR: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute() File "/usr/local/lib/python3.6/site-packages/dataflow_worker/executor.py", line 179, in execute op.start() File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start File "/usr/local/lib/python3.6/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__ yield self._source.coder.decode(value) File "/usr/local/lib/python3.6/site-packages/apache_beam/coders/coders.py", line 456, in decode return self.get_impl().decode(encoded) File "apache_beam/coders/coder_impl.py", line 226, in apache_beam.coders.coder_impl.StreamCoderImpl.decode File "apache_beam/coders/coder_impl.py", line 228, in apache_beam.coders.coder_impl.StreamCoderImpl.decode File "apache_beam/coders/coder_impl.py", line 483, in apache_beam.coders.coder_impl.FastPrimitivesCoderImpl.decode_from_stream ValueError: Unknown type tag 7f apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:39.857Z: JOB_MESSAGE_ERROR: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute() File "/usr/local/lib/python3.6/site-packages/dataflow_worker/executor.py", line 179, in execute op.start() File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start File "/usr/local/lib/python3.6/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__ yield self._source.coder.decode(value) File "/usr/local/lib/python3.6/site-packages/apache_beam/coders/coders.py", line 456, in decode return self.get_impl().decode(encoded) File "apache_beam/coders/coder_impl.py", line 226, in apache_beam.coders.coder_impl.StreamCoderImpl.decode File "apache_beam/coders/coder_impl.py", line 228, in apache_beam.coders.coder_impl.StreamCoderImpl.decode File "apache_beam/coders/coder_impl.py", line 483, in apache_beam.coders.coder_impl.FastPrimitivesCoderImpl.decode_from_stream ValueError: Unknown type tag 7f apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:43.072Z: JOB_MESSAGE_ERROR: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute() File "/usr/local/lib/python3.6/site-packages/dataflow_worker/executor.py", line 179, in execute op.start() File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start File "/usr/local/lib/python3.6/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__ yield self._source.coder.decode(value) File "/usr/local/lib/python3.6/site-packages/apache_beam/coders/coders.py", line 456, in decode return self.get_impl().decode(encoded) File "apache_beam/coders/coder_impl.py", line 226, in apache_beam.coders.coder_impl.StreamCoderImpl.decode File "apache_beam/coders/coder_impl.py", line 228, in apache_beam.coders.coder_impl.StreamCoderImpl.decode File "apache_beam/coders/coder_impl.py", line 483, in apache_beam.coders.coder_impl.FastPrimitivesCoderImpl.decode_from_stream ValueError: Unknown type tag 7f apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:46.427Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Create/Read+check_odd/Group/pair_with_0+check_odd/Group/GroupByKey/Reify+check_odd/Group/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:49.591Z: JOB_MESSAGE_ERROR: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/dataflow_worker/batchworker.py", line 649, in do_work work_executor.execute() File "/usr/local/lib/python3.6/site-packages/dataflow_worker/executor.py", line 179, in execute op.start() File "dataflow_worker/native_operations.py", line 38, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 39, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 44, in dataflow_worker.native_operations.NativeReadOperation.start File "dataflow_worker/native_operations.py", line 48, in dataflow_worker.native_operations.NativeReadOperation.start File "/usr/local/lib/python3.6/site-packages/dataflow_worker/inmemory.py", line 108, in __iter__ yield self._source.coder.decode(value) File "/usr/local/lib/python3.6/site-packages/apache_beam/coders/coders.py", line 456, in decode return self.get_impl().decode(encoded) File "apache_beam/coders/coder_impl.py", line 226, in apache_beam.coders.coder_impl.StreamCoderImpl.decode File "apache_beam/coders/coder_impl.py", line 228, in apache_beam.coders.coder_impl.StreamCoderImpl.decode File "apache_beam/coders/coder_impl.py", line 483, in apache_beam.coders.coder_impl.FastPrimitivesCoderImpl.decode_from_stream ValueError: Unknown type tag 7f apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:49.620Z: JOB_MESSAGE_BASIC: Finished operation ExternalTransform(beam:transforms:xlang:test:partition)+check_odd/WindowInto(WindowIntoFn)+check_even/WindowInto(WindowIntoFn)+check_even/ToVoidKey+check_even/Group/pair_with_1+check_even/Group/GroupByKey/Reify+check_even/Group/GroupByKey/Write+check_odd/ToVoidKey+check_odd/Group/pair_with_1+check_odd/Group/GroupByKey/Reify+check_odd/Group/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:49.699Z: JOB_MESSAGE_DEBUG: Executing failure step failure38 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:49.734Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S04:ExternalTransform(beam:transforms:xlang:test:partition)+check_odd/WindowInto(WindowIntoFn)+check_even/WindowInto(WindowIntoFn)+check_even/ToVoidKey+check_even/Group/pair_with_1+check_even/Group/GroupByKey/Reify+check_even/Group/GroupByKey/Write+check_odd/ToVoidKey+check_odd/Group/pair_with_1+check_odd/Group/GroupByKey/Reify+check_odd/Group/GroupByKey/Write failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers: beamapp-jenkins-021900220-02181622-ncjv-harness-rkjz Root cause: Work item failed., beamapp-jenkins-021900220-02181622-ncjv-harness-rkjz Root cause: Work item failed., beamapp-jenkins-021900220-02181622-ncjv-harness-rkjz Root cause: Work item failed., beamapp-jenkins-021900220-02181622-ncjv-harness-rkjz Root cause: Work item failed. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:49.922Z: JOB_MESSAGE_BASIC: Finished operation check_even/Create/Read+check_even/Group/pair_with_0+check_even/Group/GroupByKey/Reify+check_even/Group/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:50.014Z: JOB_MESSAGE_DETAILED: Cleaning up. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:50.096Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:29:50.136Z: JOB_MESSAGE_BASIC: Stopping worker pool... apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:30:31.634Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:30:31.682Z: JOB_MESSAGE_BASIC: Worker pool stopped. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-02-19T00:30:31.783Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2021-02-18_16_22_11-11624313303320868223 is in state JOB_STATE_FAILED --------------------- >> end captured logging << --------------------- Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_11-15666280147933211225?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_10-6561658621852141321?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_11-2657596152913458181?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_11-17983743738663862579?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_11-635225901408368451?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_10-8526435763773423215?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_11-11624313303320868223?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-02-18_16_22_11-12640726243347652944?project=apache-beam-testing ---------------------------------------------------------------------- XML: nosetests-xlangValidateRunner.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 8 tests in 531.180s FAILED (errors=8) > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 30558. Stopping expansion service pid: 30561. > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210219000133 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63c7dfacf40e7f22c246f76288d2cd238d7adb6876f392264971d3c513027a13 Deleted: sha256:01bc2bc039eae16b445d2144c5cb23c88be39f089c970e0dca7b962e0e9ead1b Deleted: sha256:e781ece34ad12c7ee9f10dc16f2d7db2b6a312e6fd5a8f8e930171cf1d400caf Deleted: sha256:44b6041c50c6cf321dbd1b9493d55eb77236150f48066703da3e7a5eaf4156cf Deleted: sha256:848adfd4e1e6400ebf148990e1e57e82eb74adc9196d0d485fc1c439565f5a76 Deleted: sha256:5d239d03a74b0914296bfbe3155b280e3d689abbd6854bc0b696b900fa96b531 Deleted: sha256:eca4f030f2f7581f126c6f0bda4dc2c34d186975cb8e357f4274b46de43b97f5 Deleted: sha256:98b05ff52d71c7f42f971d79cf03d8881a42115084ebceb78f3f92171856ff7a Deleted: sha256:1044a1bc8fb41d7f17e0172061f991aec2d18714efb58382e23652ff890fcc14 Deleted: sha256:9ffba8719b7e6c92cb39d2702f2375e020103d0dcb285df4dd2c24eeee7bf023 Deleted: sha256:6f9a4ab2149381d7f27839f02d928ec3bccc22b4d1aba2e8a2dbe338562042da Deleted: sha256:25ef676e928347aa71c99da0f9962b61f1d86ea6355cdbfa9ddf2bd28bec8b3d Deleted: sha256:8c7b3f3d7e44727f3dda954a3a25afe9a691b5ea604123f7fb7491a9df27c93a Deleted: sha256:71450461f749a57dcd6960af810b226fda973e684fceb2ecf0be8c8bfa85db29 Deleted: sha256:b2b9cf43491cd7de744bff0ab0577b2f85275c56bf43f13acb597c63ec4f3a96 Deleted: sha256:bcfd1bdcd57c54e54e118a88d89017177a7f0ad20eca8d1aae7ca1f523c80294 Deleted: sha256:ceb8d6bb13157373059dfe3acdd1babdc12f739b810af6553c0a64989f29eed9 Deleted: sha256:f1db831ead8d151902f357775329863ed166609baada5823561988315b768f0b Deleted: sha256:b5f01f22dec677c9917787266c380bed4a989ec074c4d6428208de6130ef1734 Deleted: sha256:d138f7331308317354b838d49e344b760f6e8ee22e66469424fdb8b7a78f0938 Deleted: sha256:28abbf28fedd614cdda29f67524ccf99720ddb774581095003dda2e1c83e8251 Deleted: sha256:b78ed581791ecc659fe7b4a84f77353bd65489301d464f9a22300180f9bb8189 Deleted: sha256:837e62742cc6a4b21d76e79367b21f515aa20388f7504afe279e306eed332a88 Deleted: sha256:c2c1d54cae7c9cbab60148ce06c11678ca468c8f257c04ecbc5216d12a72a66d Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63c7dfacf40e7f22c246f76288d2cd238d7adb6876f392264971d3c513027a13 Associated tags: - 20210219000133 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210219000133 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210219000133]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63c7dfacf40e7f22c246f76288d2cd238d7adb6876f392264971d3c513027a13]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 30m 24s 112 actionable tasks: 83 executed, 25 from cache, 4 up-to-date Gradle was unable to watch the file system for changes. The inotify watches limit is too low. Publishing build scan... https://gradle.com/s/mp5ksmvnnq3kk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
