See <https://ci-beam.apache.org/job/beam_PostCommit_Python36/2683/display/redirect?page=changes>
Changes: [Kamil Wasilewski] [BEAM-9889] Publish InfluxDB backup to public GCS bucket [Kamil Wasilewski] [BEAM-9889] Populate local instance of InfluxDB with data ------------------------------------------ [...truncated 12.61 MB...] "type": "JOB_TYPE_BATCH" } apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job createTime: '2020-07-15T12:29:54.404830Z' currentStateTime: '1970-01-01T00:00:00Z' id: '2020-07-15_05_29_53-5448937362090972879' location: 'us-central1' name: 'beamapp-jenkins-0715122941-526637' projectId: 'apache-beam-testing' stageStates: [] startTime: '2020-07-15T12:29:54.404830Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-07-15_05_29_53-5448937362090972879] apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-07-15_05_29_53-5448937362090972879 apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_29_53-5448937362090972879?project=apache-beam-testing apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2020-07-15_05_29_53-5448937362090972879 is in state JOB_STATE_RUNNING apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:53.437Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-07-15_05_29_53-5448937362090972879. The number of workers will be between 1 and 1000. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:53.437Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-07-15_05_29_53-5448937362090972879. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:57.309Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.067Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.103Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables: GroupByKey not followed by a combiner. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.148Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/BigQueryBatchFileLoads/GroupFilesByTableDestinations: GroupByKey not followed by a combiner. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.198Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/BigQueryBatchFileLoads/GroupShardedRows: GroupByKey not followed by a combiner. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.240Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.269Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.400Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.448Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.479Z: JOB_MESSAGE_DETAILED: Unzipping flatten s19 for input s13.WrittenFiles apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.517Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of write/BigQueryBatchFileLoads/IdentityWorkaround, through flatten write/BigQueryBatchFileLoads/DestinationFilesUnion, into producer write/BigQueryBatchFileLoads/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.550Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Write into write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.576Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/GroupByWindow into write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.597Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/ParDo(PartitionFiles)/ParDo(PartitionFiles) into write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/GroupByWindow apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.632Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)/ParDo(TriggerLoadJobs) into write/BigQueryBatchFileLoads/ParDo(PartitionFiles)/ParDo(PartitionFiles) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.664Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/TriggerLoadJobsWithoutTempTables into write/BigQueryBatchFileLoads/ParDo(PartitionFiles)/ParDo(PartitionFiles) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.689Z: JOB_MESSAGE_DETAILED: Unzipping flatten s19-u32 for input s20.None-c30 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.723Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Reify, through flatten write/BigQueryBatchFileLoads/DestinationFilesUnion/Unzipped-1, into producer write/BigQueryBatchFileLoads/IdentityWorkaround apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.749Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/IdentityWorkaround into write/BigQueryBatchFileLoads/WriteGroupedRecordsToFile/WriteGroupedRecordsToFile apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.773Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Reify into write/BigQueryBatchFileLoads/IdentityWorkaround apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.801Z: JOB_MESSAGE_DETAILED: Fusing consumer read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough) into read/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.834Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/RewindowIntoGlobal into read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.870Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/AppendDestination into write/BigQueryBatchFileLoads/RewindowIntoGlobal apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.904Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile) into write/BigQueryBatchFileLoads/AppendDestination apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.933Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/ParDo(_ShardDestinations) into write/BigQueryBatchFileLoads/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.954Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/GroupShardedRows/Reify into write/BigQueryBatchFileLoads/ParDo(_ShardDestinations) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:58.983Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/GroupShardedRows/Write into write/BigQueryBatchFileLoads/GroupShardedRows/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.015Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/GroupShardedRows/GroupByWindow into write/BigQueryBatchFileLoads/GroupShardedRows/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.056Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/DropShardNumber into write/BigQueryBatchFileLoads/GroupShardedRows/GroupByWindow apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.078Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/WriteGroupedRecordsToFile/WriteGroupedRecordsToFile into write/BigQueryBatchFileLoads/DropShardNumber apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.107Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/Map(<lambda at bigquery_file_loads.py:893>) into write/BigQueryBatchFileLoads/ImpulseSingleElementPC/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.134Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/GenerateFilePrefix into write/BigQueryBatchFileLoads/ImpulseSingleElementPC/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.170Z: JOB_MESSAGE_DETAILED: Fusing siblings write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/WaitForDestinationLoadJobs and write/BigQueryBatchFileLoads/WaitForTempTableLoadJobs/WaitForTempTableLoadJobs apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.203Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/ParDo(TriggerCopyJobs)/ParDo(TriggerCopyJobs) into write/BigQueryBatchFileLoads/WaitForTempTableLoadJobs/WaitForTempTableLoadJobs apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.237Z: JOB_MESSAGE_DETAILED: Fusing consumer read/_PassThroughThenCleanup/ParDo(RemoveJsonFiles)/ParDo(RemoveJsonFiles) into read/_PassThroughThenCleanup/Create/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.275Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/RemoveTempTables/PassTables/PassTables into write/BigQueryBatchFileLoads/WaitForCopyJobs/WaitForCopyJobs apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.299Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/RemoveTempTables/AddUselessValue into write/BigQueryBatchFileLoads/RemoveTempTables/PassTables/PassTables apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.334Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Reify into write/BigQueryBatchFileLoads/RemoveTempTables/AddUselessValue apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.361Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Write into write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.399Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/GroupByWindow into write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.448Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/RemoveTempTables/GetTableNames into write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/GroupByWindow apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.472Z: JOB_MESSAGE_DETAILED: Fusing consumer write/BigQueryBatchFileLoads/RemoveTempTables/Delete into write/BigQueryBatchFileLoads/RemoveTempTables/GetTableNames apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.513Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.549Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.584Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.618Z: JOB_MESSAGE_DEBUG: Assigning stage ids. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.780Z: JOB_MESSAGE_DEBUG: Executing wait step start47 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.855Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/ImpulseSingleElementPC/Read+write/BigQueryBatchFileLoads/Map(<lambda at bigquery_file_loads.py:893>)+write/BigQueryBatchFileLoads/GenerateFilePrefix apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.889Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.899Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/GroupShardedRows/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.924Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a... apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.925Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.961Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.974Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/GroupShardedRows/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.974Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:29:59.983Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/ImpulseEmptyPC/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:30:00.003Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:30:00.018Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/ImpulseEmptyPC/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:30:00.037Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:30:00.071Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/GroupShardedRows/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:30:00.104Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:30:00.138Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/ImpulseEmptyPC/Read.out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:30:24.574Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:35:59.410Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:36:27.518Z: JOB_MESSAGE_DETAILED: Workers have started successfully. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:36:27.554Z: JOB_MESSAGE_DETAILED: Workers have started successfully. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.584Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/ImpulseSingleElementPC/Read+write/BigQueryBatchFileLoads/Map(<lambda at bigquery_file_loads.py:893>)+write/BigQueryBatchFileLoads/GenerateFilePrefix apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.727Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/ImpulseSingleElementPC/Read.out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.753Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/Map(<lambda at bigquery_file_loads.py:893>).out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.776Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/GenerateFilePrefix.out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.816Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.846Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.865Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.880Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/ParDo(TriggerCopyJobs)/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.888Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.913Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/WriteGroupedRecordsToFile/_UnpickledSideInput(GenerateFilePrefix.out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.938Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/ParDo(TriggerCopyJobs)/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.949Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)/_UnpickledSideInput(GenerateFilePrefix.out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.970Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/WriteGroupedRecordsToFile/_UnpickledSideInput(GenerateFilePrefix.out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.995Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)/_UnpickledSideInput(GenerateFilePrefix.out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:39.996Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:40.023Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:40.049Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/ParDo(TriggerCopyJobs)/_UnpickledSideInput(Map(<lambda at bigquery_file_loads.py:893>).out.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:40.079Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/WriteGroupedRecordsToFile/_UnpickledSideInput(GenerateFilePrefix.out.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:40.106Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)/_UnpickledSideInput(GenerateFilePrefix.out.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:39:40.178Z: JOB_MESSAGE_BASIC: Executing operation read/Read+read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough)+write/BigQueryBatchFileLoads/RewindowIntoGlobal+write/BigQueryBatchFileLoads/AppendDestination+write/BigQueryBatchFileLoads/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)+write/BigQueryBatchFileLoads/IdentityWorkaround+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Reify+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Write+write/BigQueryBatchFileLoads/ParDo(_ShardDestinations)+write/BigQueryBatchFileLoads/GroupShardedRows/Reify+write/BigQueryBatchFileLoads/GroupShardedRows/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.106Z: JOB_MESSAGE_BASIC: Finished operation read/Read+read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough)+write/BigQueryBatchFileLoads/RewindowIntoGlobal+write/BigQueryBatchFileLoads/AppendDestination+write/BigQueryBatchFileLoads/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)/ParDo(WriteRecordsToFile)+write/BigQueryBatchFileLoads/IdentityWorkaround+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Reify+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Write+write/BigQueryBatchFileLoads/ParDo(_ShardDestinations)+write/BigQueryBatchFileLoads/GroupShardedRows/Reify+write/BigQueryBatchFileLoads/GroupShardedRows/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.188Z: JOB_MESSAGE_DEBUG: Value "read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough).cleanup_signal" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.220Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/GroupShardedRows/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.255Z: JOB_MESSAGE_BASIC: Executing operation read/_PassThroughThenCleanup/ParDo(RemoveJsonFiles)/_UnpickledSideInput(ParDo(PassThrough).cleanup_signal.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.273Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/GroupShardedRows/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.314Z: JOB_MESSAGE_BASIC: Finished operation read/_PassThroughThenCleanup/ParDo(RemoveJsonFiles)/_UnpickledSideInput(ParDo(PassThrough).cleanup_signal.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.359Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/GroupShardedRows/Read+write/BigQueryBatchFileLoads/GroupShardedRows/GroupByWindow+write/BigQueryBatchFileLoads/DropShardNumber+write/BigQueryBatchFileLoads/WriteGroupedRecordsToFile/WriteGroupedRecordsToFile+write/BigQueryBatchFileLoads/IdentityWorkaround+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Reify+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.396Z: JOB_MESSAGE_DEBUG: Value "read/_PassThroughThenCleanup/ParDo(RemoveJsonFiles)/_UnpickledSideInput(ParDo(PassThrough).cleanup_signal.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:00.450Z: JOB_MESSAGE_BASIC: Executing operation read/_PassThroughThenCleanup/Create/Read+read/_PassThroughThenCleanup/ParDo(RemoveJsonFiles)/ParDo(RemoveJsonFiles) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:06.167Z: JOB_MESSAGE_BASIC: Finished operation read/_PassThroughThenCleanup/Create/Read+read/_PassThroughThenCleanup/ParDo(RemoveJsonFiles)/ParDo(RemoveJsonFiles) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:09.328Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/GroupShardedRows/Read+write/BigQueryBatchFileLoads/GroupShardedRows/GroupByWindow+write/BigQueryBatchFileLoads/DropShardNumber+write/BigQueryBatchFileLoads/WriteGroupedRecordsToFile/WriteGroupedRecordsToFile+write/BigQueryBatchFileLoads/IdentityWorkaround+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Reify+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:09.397Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:09.449Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:09.512Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Read+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/GroupByWindow+write/BigQueryBatchFileLoads/ParDo(PartitionFiles)/ParDo(PartitionFiles)+write/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)/ParDo(TriggerLoadJobs)+write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/TriggerLoadJobsWithoutTempTables apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.028Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/Read+write/BigQueryBatchFileLoads/GroupFilesByTableDestinations/GroupByWindow+write/BigQueryBatchFileLoads/ParDo(PartitionFiles)/ParDo(PartitionFiles)+write/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs)/ParDo(TriggerLoadJobs)+write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/TriggerLoadJobsWithoutTempTables apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.095Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs).out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.120Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/TriggerLoadJobsWithTempTables/ParDo(TriggerLoadJobs).TemporaryTables" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.154Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.188Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/WaitForTempTableLoadJobs/_UnpickledSideInput(ParDo(TriggerLoadJobs).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.220Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/RemoveTempTables/PassTables/_UnpickledSideInput(ParDo(TriggerLoadJobs).TemporaryTables.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.238Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/WaitForTempTableLoadJobs/_UnpickledSideInput(ParDo(TriggerLoadJobs).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.245Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.271Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/RemoveTempTables/PassTables/_UnpickledSideInput(ParDo(TriggerLoadJobs).TemporaryTables.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.281Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/Flatten apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.300Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.316Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/WaitForTempTableLoadJobs/_UnpickledSideInput(ParDo(TriggerLoadJobs).out.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.354Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/Flatten apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.367Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/RemoveTempTables/PassTables/_UnpickledSideInput(ParDo(TriggerLoadJobs).TemporaryTables.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.423Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.464Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/Flatten.out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:22.527Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/WaitForDestinationLoadJobs+write/BigQueryBatchFileLoads/WaitForTempTableLoadJobs/WaitForTempTableLoadJobs+write/BigQueryBatchFileLoads/ParDo(TriggerCopyJobs)/ParDo(TriggerCopyJobs) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:26.697Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/WaitForDestinationLoadJobs+write/BigQueryBatchFileLoads/WaitForTempTableLoadJobs/WaitForTempTableLoadJobs+write/BigQueryBatchFileLoads/ParDo(TriggerCopyJobs)/ParDo(TriggerCopyJobs) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:26.779Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/ParDo(TriggerCopyJobs).out" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:26.862Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/WaitForCopyJobs/_UnpickledSideInput(ParDo(TriggerCopyJobs).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:26.932Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/WaitForCopyJobs/_UnpickledSideInput(ParDo(TriggerCopyJobs).out.0) apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:27.032Z: JOB_MESSAGE_DEBUG: Value "write/BigQueryBatchFileLoads/WaitForCopyJobs/_UnpickledSideInput(ParDo(TriggerCopyJobs).out.0).output" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:27.109Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/WaitForCopyJobs/WaitForCopyJobs+write/BigQueryBatchFileLoads/RemoveTempTables/PassTables/PassTables+write/BigQueryBatchFileLoads/RemoveTempTables/AddUselessValue+write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Reify+write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:28.785Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/WaitForCopyJobs/WaitForCopyJobs+write/BigQueryBatchFileLoads/RemoveTempTables/PassTables/PassTables+write/BigQueryBatchFileLoads/RemoveTempTables/AddUselessValue+write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Reify+write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:28.860Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:28.903Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Close apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:28.953Z: JOB_MESSAGE_BASIC: Executing operation write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Read+write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/GroupByWindow+write/BigQueryBatchFileLoads/RemoveTempTables/GetTableNames+write/BigQueryBatchFileLoads/RemoveTempTables/Delete apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:31.955Z: JOB_MESSAGE_BASIC: Finished operation write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/Read+write/BigQueryBatchFileLoads/RemoveTempTables/DeduplicateTables/GroupByWindow+write/BigQueryBatchFileLoads/RemoveTempTables/GetTableNames+write/BigQueryBatchFileLoads/RemoveTempTables/Delete apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:32.036Z: JOB_MESSAGE_DEBUG: Executing success step success45 apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:32.156Z: JOB_MESSAGE_DETAILED: Cleaning up. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:32.202Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-07-15T12:40:32.232Z: JOB_MESSAGE_BASIC: Stopping worker pool... apache_beam.runners.dataflow.dataflow_runner: WARNING: Timing out on waiting for job 2020-07-15_05_29_53-5448937362090972879 after 903 seconds oauth2client.transport: INFO: Refreshing due to a 401 (attempt 1/2) --------------------- >> end captured logging << --------------------- Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_02_59-5633302926009594351?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_24_19-883873946482981616?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_44_05-14292109298320928008?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_01_30-11541940930930991749?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_11_47-2890393272800533985?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_21_09-14253184098422221611?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_02_55-12046696184384675942?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_44_56-214756805541293907?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_00_08-18032439693853426800?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_10_24-17316666664422095659?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_18_46-14077039797177999798?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_26_22-16335254233644899471?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_02_57-1547662522618850056?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_18_39-6498868336275348829?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_39_16-6084241611525486271?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_56_48-16644266600581482690?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_08_12-5154739579910577646?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_17_12-12849109800338959129?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_24_59-10377044725679077135?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_32_04-10484027575398296726?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_02_54-7010008291120445904?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_34_37-9040871025865802492?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_53_23-3782953576070100392?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_05_11-16654174276499316368?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_14_29-9641725008999999310?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_23_44-3588148986416650869?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_02_55-9345323637357783013?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_11_23-14272943570988250026?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_29_53-5448937362090972879?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_50_09-17238675545848289723?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_03_19-6989480913496023489?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_13_06-13179509536612049360?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_21_06-12458311916323063700?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_28_31-4578224218205297781?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_02_55-16382529321971310304?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_09_44-3925643309073318649?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_26_58-4661173348578927297?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_46_05-10815353045810564392?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_00_37-1421149782112744023?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_11_02-2429269515384451475?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_21_04-1524483743148152565?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_28_48-14581136962596010324?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_02_54-5653755040961969533?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_13_07-747438769224304961?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_31_53-17669183573142723819?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_52_25-14075094583812040699?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_05_05-15168449923607470915?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_16_42-2203398094704960032?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_24_42-16854291521822186852?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_02_55-15715403758405087546?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_13_54-15898121597442837377?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_34_21-5824438145903343530?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_05_52_54-11237245350000164484?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_05_17-11010519122701227785?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_22_21-13622146474778842039?project=apache-beam-testing Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-07-15_06_30_11-14209877452705231843?project=apache-beam-testing ---------------------------------------------------------------------- XML: nosetests-postCommitIT-df-py36.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 64 tests in 5807.692s FAILED (SKIP=7, errors=2, failures=2) > Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 38m 52s 111 actionable tasks: 79 executed, 32 from cache Publishing build scan... https://gradle.com/s/qvy6blftgafua Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
