See 
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/4936/display/redirect>

Changes:


------------------------------------------
[...truncated 19.27 MB...]
                                                                           
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:888 Created job 
with id: [2022-03-02_06_09_12-13077389680908820995]
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:889 Submitted job: 
2022-03-02_06_09_12-13077389680908820995
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:895 To access the 
Dataflow monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-02_06_09_12-13077389680908820995?project=apache-beam-testing
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 
2022-03-02_06_09_12-13077389680908820995 is in state JOB_STATE_RUNNING
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:14.323Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 
2022-03-02_06_09_12-13077389680908820995. The number of workers will be between 
1 and 1000.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:14.423Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically 
enabled for job 2022-03-02_06_09_12-13077389680908820995.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:16.474Z: JOB_MESSAGE_BASIC: Worker configuration: 
e2-standard-2 in us-central1-b.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.377Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey 
operations into optimizable parts.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.458Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations 
into optimizable parts.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.505Z: JOB_MESSAGE_DETAILED: Lifting 
ValueCombiningMappingFns into MergeBucketsMappingFns
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.534Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner 
information.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.594Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, 
Write, and Flatten operations
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.629Z: JOB_MESSAGE_DETAILED: Unzipping flatten s5 for input 
s3.unbatchable
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.656Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of 
WriteToSpanner/Writing to spanner, through flatten WriteToSpanner/make 
batches/Merging batchable and unbatchable, into producer WriteToSpanner/make 
batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.685Z: JOB_MESSAGE_DETAILED: Fusing consumer 
WriteToSpanner/Writing to spanner into WriteToSpanner/make 
batches/ParDo(_BatchFn)
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.710Z: JOB_MESSAGE_DETAILED: Fusing consumer 
WriteToSpanner/make batches/Making mutation groups into Create/Read
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.737Z: JOB_MESSAGE_DETAILED: Fusing consumer 
WriteToSpanner/make batches/Filtering Batchable 
Mutations/ParDo(_BatchableFilterFn) into WriteToSpanner/make batches/Making 
mutation groups
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.772Z: JOB_MESSAGE_DETAILED: Fusing consumer 
WriteToSpanner/make batches/ParDo(_BatchFn) into WriteToSpanner/make 
batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.805Z: JOB_MESSAGE_DEBUG: Workflow config is missing a 
default resource spec.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.830Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and 
teardown to workflow graph.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.860Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop 
steps.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:18.885Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:19.021Z: JOB_MESSAGE_DEBUG: Executing wait step start6
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:19.097Z: JOB_MESSAGE_BASIC: Executing operation 
Create/Read+WriteToSpanner/make batches/Making mutation 
groups+WriteToSpanner/make batches/Filtering Batchable 
Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to 
spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to 
spanner
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:19.142Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:19.174Z: JOB_MESSAGE_BASIC: Starting 1 workers in 
us-central1-b...
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:09:30.214Z: JOB_MESSAGE_BASIC: Your project already contains 100 
Dataflow-created metric descriptors, so new user metrics of the form 
custom.googleapis.com/* will not be created. However, all user metrics are also 
available in the metric dataflow.googleapis.com/job/user_counter. If you rely 
on the custom metrics, you can delete old / unused metric descriptors. See 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
 and 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:10:07.401Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number 
of workers to 1 based on the rate of progress in the currently running stage(s).
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:10:33.222Z: JOB_MESSAGE_DETAILED: Workers have started 
successfully.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:10:33.257Z: JOB_MESSAGE_DETAILED: Workers have started 
successfully.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:43.111Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               
File "apache_beam/runners/common.py", line 1198, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 537, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               
File 
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py",
 line 1251, in process
                                                                                
 self.service_metric.call('ok')
                                                                             
AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             
During handling of the above exception, another exception occurred:
                                                                             
                                                                             
Traceback (most recent call last):
                                                                               
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", 
line 646, in do_work
                                                                                
 work_executor.execute()
                                                                               
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 
210, in execute
                                                                                
 op.finish()
                                                                               
File "apache_beam/runners/worker/operations.py", line 736, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/worker/operations.py", line 738, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/worker/operations.py", line 739, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/common.py", line 1253, in 
apache_beam.runners.common.DoFnRunner.finish
                                                                               
File "apache_beam/runners/common.py", line 1234, in 
apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               
File "apache_beam/runners/common.py", line 1265, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               
File "apache_beam/runners/common.py", line 1232, in 
apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               
File "apache_beam/runners/common.py", line 475, in 
apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               
File "apache_beam/runners/common.py", line 480, in 
apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               
File "apache_beam/runners/common.py", line 1401, in 
apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               
File "apache_beam/runners/worker/operations.py", line 215, in 
apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               
File "apache_beam/runners/worker/operations.py", line 707, in 
apache_beam.runners.worker.operations.DoOperation.process
                                                                               
File "apache_beam/runners/worker/operations.py", line 708, in 
apache_beam.runners.worker.operations.DoOperation.process
                                                                               
File "apache_beam/runners/common.py", line 1200, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 1281, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               
File "apache_beam/runners/common.py", line 1198, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 537, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               
File 
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py",
 line 1251, in process
                                                                                
 self.service_metric.call('ok')
                                                                             
AttributeError: 'NoneType' object has no attribute 'call' [while running 
'WriteToSpanner/Writing to spanner']
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:46.631Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               
File "apache_beam/runners/common.py", line 1198, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 537, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               
File 
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py",
 line 1251, in process
                                                                                
 self.service_metric.call('ok')
                                                                             
AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             
During handling of the above exception, another exception occurred:
                                                                             
                                                                             
Traceback (most recent call last):
                                                                               
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", 
line 646, in do_work
                                                                                
 work_executor.execute()
                                                                               
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 
210, in execute
                                                                                
 op.finish()
                                                                               
File "apache_beam/runners/worker/operations.py", line 736, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/worker/operations.py", line 738, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/worker/operations.py", line 739, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/common.py", line 1253, in 
apache_beam.runners.common.DoFnRunner.finish
                                                                               
File "apache_beam/runners/common.py", line 1234, in 
apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               
File "apache_beam/runners/common.py", line 1265, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               
File "apache_beam/runners/common.py", line 1232, in 
apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               
File "apache_beam/runners/common.py", line 475, in 
apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               
File "apache_beam/runners/common.py", line 480, in 
apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               
File "apache_beam/runners/common.py", line 1401, in 
apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               
File "apache_beam/runners/worker/operations.py", line 215, in 
apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               
File "apache_beam/runners/worker/operations.py", line 707, in 
apache_beam.runners.worker.operations.DoOperation.process
                                                                               
File "apache_beam/runners/worker/operations.py", line 708, in 
apache_beam.runners.worker.operations.DoOperation.process
                                                                               
File "apache_beam/runners/common.py", line 1200, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 1281, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               
File "apache_beam/runners/common.py", line 1198, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 537, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               
File 
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py",
 line 1251, in process
                                                                                
 self.service_metric.call('ok')
                                                                             
AttributeError: 'NoneType' object has no attribute 'call' [while running 
'WriteToSpanner/Writing to spanner']
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:50.104Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               
File "apache_beam/runners/common.py", line 1198, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 537, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               
File 
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py",
 line 1251, in process
                                                                                
 self.service_metric.call('ok')
                                                                             
AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             
During handling of the above exception, another exception occurred:
                                                                             
                                                                             
Traceback (most recent call last):
                                                                               
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", 
line 646, in do_work
                                                                                
 work_executor.execute()
                                                                               
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 
210, in execute
                                                                                
 op.finish()
                                                                               
File "apache_beam/runners/worker/operations.py", line 736, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/worker/operations.py", line 738, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/worker/operations.py", line 739, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/common.py", line 1253, in 
apache_beam.runners.common.DoFnRunner.finish
                                                                               
File "apache_beam/runners/common.py", line 1234, in 
apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               
File "apache_beam/runners/common.py", line 1265, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               
File "apache_beam/runners/common.py", line 1232, in 
apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               
File "apache_beam/runners/common.py", line 475, in 
apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               
File "apache_beam/runners/common.py", line 480, in 
apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               
File "apache_beam/runners/common.py", line 1401, in 
apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               
File "apache_beam/runners/worker/operations.py", line 215, in 
apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               
File "apache_beam/runners/worker/operations.py", line 707, in 
apache_beam.runners.worker.operations.DoOperation.process
                                                                               
File "apache_beam/runners/worker/operations.py", line 708, in 
apache_beam.runners.worker.operations.DoOperation.process
                                                                               
File "apache_beam/runners/common.py", line 1200, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 1281, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               
File "apache_beam/runners/common.py", line 1198, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 537, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               
File 
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py",
 line 1251, in process
                                                                                
 self.service_metric.call('ok')
                                                                             
AttributeError: 'NoneType' object has no attribute 'call' [while running 
'WriteToSpanner/Writing to spanner']
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:53.359Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
                                                                               
File "apache_beam/runners/common.py", line 1198, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 537, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               
File 
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py",
 line 1251, in process
                                                                                
 self.service_metric.call('ok')
                                                                             
AttributeError: 'NoneType' object has no attribute 'call'
                                                                             
                                                                             
During handling of the above exception, another exception occurred:
                                                                             
                                                                             
Traceback (most recent call last):
                                                                               
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/batchworker.py", 
line 646, in do_work
                                                                                
 work_executor.execute()
                                                                               
File "/usr/local/lib/python3.7/site-packages/dataflow_worker/executor.py", line 
210, in execute
                                                                                
 op.finish()
                                                                               
File "apache_beam/runners/worker/operations.py", line 736, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/worker/operations.py", line 738, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/worker/operations.py", line 739, in 
apache_beam.runners.worker.operations.DoOperation.finish
                                                                               
File "apache_beam/runners/common.py", line 1253, in 
apache_beam.runners.common.DoFnRunner.finish
                                                                               
File "apache_beam/runners/common.py", line 1234, in 
apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               
File "apache_beam/runners/common.py", line 1265, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               
File "apache_beam/runners/common.py", line 1232, in 
apache_beam.runners.common.DoFnRunner._invoke_bundle_method
                                                                               
File "apache_beam/runners/common.py", line 475, in 
apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               
File "apache_beam/runners/common.py", line 480, in 
apache_beam.runners.common.DoFnInvoker.invoke_finish_bundle
                                                                               
File "apache_beam/runners/common.py", line 1401, in 
apache_beam.runners.common._OutputProcessor.finish_bundle_outputs
                                                                               
File "apache_beam/runners/worker/operations.py", line 215, in 
apache_beam.runners.worker.operations.SingletonConsumerSet.receive
                                                                               
File "apache_beam/runners/worker/operations.py", line 707, in 
apache_beam.runners.worker.operations.DoOperation.process
                                                                               
File "apache_beam/runners/worker/operations.py", line 708, in 
apache_beam.runners.worker.operations.DoOperation.process
                                                                               
File "apache_beam/runners/common.py", line 1200, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 1281, in 
apache_beam.runners.common.DoFnRunner._reraise_augmented
                                                                               
File "apache_beam/runners/common.py", line 1198, in 
apache_beam.runners.common.DoFnRunner.process
                                                                               
File "apache_beam/runners/common.py", line 537, in 
apache_beam.runners.common.SimpleInvoker.invoke_process
                                                                               
File 
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/experimental/spannerio.py",
 line 1251, in process
                                                                                
 self.service_metric.call('ok')
                                                                             
AttributeError: 'NoneType' object has no attribute 'call' [while running 
'WriteToSpanner/Writing to spanner']
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:53.387Z: JOB_MESSAGE_BASIC: Finished operation 
Create/Read+WriteToSpanner/make batches/Making mutation 
groups+WriteToSpanner/make batches/Filtering Batchable 
Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to 
spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to 
spanner
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:53.474Z: JOB_MESSAGE_DEBUG: Executing failure step failure5
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:53.531Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: 
S01:Create/Read+WriteToSpanner/make batches/Making mutation 
groups+WriteToSpanner/make batches/Filtering Batchable 
Mutations/ParDo(_BatchableFilterFn)+WriteToSpanner/Writing to 
spanner+WriteToSpanner/make batches/ParDo(_BatchFn)+WriteToSpanner/Writing to 
spanner failed., The job failed because a work item has failed 4 times. Look in 
previous log entries for the cause of each one of the 4 failures. For more 
information, see https://cloud.google.com/dataflow/docs/guides/common-errors. 
The work item was attempted on these workers: 
                                                                             
                                                                               
beamapp-jenkins-030214090-03020609-louj-harness-kg26
                                                                                
   Root cause: Work item failed.,
                                                                             
                                                                               
beamapp-jenkins-030214090-03020609-louj-harness-kg26
                                                                                
   Root cause: Work item failed.,
                                                                             
                                                                               
beamapp-jenkins-030214090-03020609-louj-harness-kg26
                                                                                
   Root cause: Work item failed.,
                                                                             
                                                                               
beamapp-jenkins-030214090-03020609-louj-harness-kg26
                                                                                
   Root cause: Work item failed.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:53.613Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:53.661Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:15:53.687Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:18:25.721Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker 
pool from 1 to 0.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:18:25.780Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 
2022-03-02T14:18:25.815Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 
2022-03-02_06_09_12-13077389680908820995 is in state JOB_STATE_FAILED
=============================== warnings summary 
===============================
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:190
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:190:
 FutureWarning: WriteToSpanner is experimental. No backwards-compatibility 
guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py:128
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:128:
 FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility 
guarantees.
    sql="select * from Users")

apache_beam/io/gcp/experimental/spannerio_write_it_test.py:171
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:171:
 FutureWarning: WriteToSpanner is experimental. No backwards-compatibility 
guarantees.
    database_id=self.TEST_DATABASE))

apache_beam/io/gcp/experimental/spannerio_read_it_test.py:117
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:117:
 FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility 
guarantees.
    columns=["UserId", "Key"])

apache_beam/io/gcp/experimental/spannerio_write_it_test.py:135
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:135:
 FutureWarning: WriteToSpanner is experimental. No backwards-compatibility 
guarantees.
    max_batch_size_bytes=250))

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: 
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-df-py37.xml>
 -
======== 1 failed, 4 passed, 10 skipped, 5 warnings in 1573.85 seconds 
=========

> Task :sdks:python:test-suites:dataflow:py37:spannerioIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script 
'<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
 line: 144

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:spannerioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

See 
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during 
this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 2h 26m 35s
224 actionable tasks: 155 executed, 63 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/fhmwz24dzh534

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to