See
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/566/display/redirect>
------------------------------------------
[...truncated 18.02 MB...]
INFO: 2018-05-27T00:39:49.217Z: Fusing consumer
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.238Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
into BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.261Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify into
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.285Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow
into BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.311Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write into
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.336Z: Fusing consumer
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.361Z: Fusing consumer
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.389Z: Fusing consumer
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.413Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)
into BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/ExpandIterable
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.437Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify into
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.460Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow
into BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.487Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write into
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.518Z: Unzipping flatten s46 for input
s43.writtenFiles
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.542Z: Fusing unzipped copy of
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow),
through flatten BigQueryIO.Write/BatchLoads/FlattenFiles, into producer
BigQueryIO.Write/BatchLoads/WriteBundlesToFiles
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.567Z: Fusing consumer
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into BigQueryIO.Write/BatchLoads/WriteGroupedRecords
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.588Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify
into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.606Z: Fusing consumer
BigQueryIO.Write/BatchLoads/GroupByDestination/Reify into
BigQueryIO.Write/BatchLoads/WriteBundlesToFiles
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.630Z: Fusing consumer
BigQueryIO.Write/BatchLoads/WriteGroupedRecords into
BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.653Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Init/Map into
BigQueryTornadoes.CountTornadoes/ParDo(ExtractTornadoes)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.672Z: Fusing consumer
BigQueryIO.Write/BatchLoads/GroupByDestination/Write into
BigQueryIO.Write/BatchLoads/GroupByDestination/Reify
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.693Z: Fusing consumer
BigQueryIO.Write/BatchLoads/WriteBundlesToFiles into
BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.717Z: Fusing consumer
BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign into
BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.751Z: Fusing consumer
BigQueryIO.Write/PrepareWrite/ParDo(Anonymous) into
BigQueryTornadoes.CountTornadoes/ParDo(FormatCounts)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.780Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/ParDo(ExtractTornadoes) into
BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.808Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues
into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.830Z: Fusing consumer
BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity) into
BigQueryIO.TypedRead/Read(BigQueryTableSource)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.849Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.870Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract
into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.892Z: Fusing consumer
BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow into
BigQueryIO.Write/BatchLoads/GroupByDestination/Read
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.919Z: Fusing consumer
BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.941Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/ParDo(FormatCounts) into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.963Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial
into BigQueryTornadoes.CountTornadoes/Count.PerElement/Init/Map
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:49.988Z: Fusing consumer
BigQueryIO.TypedRead/PassThroughThenCleanup/Cleanup into
BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.013Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.040Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.068Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.084Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.110Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.134Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.153Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.178Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.199Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.222Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.575Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)+DropInputs
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.606Z: Executing operation
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.632Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.649Z: Starting 1 workers in us-central1-b...
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.659Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.685Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.712Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.735Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.761Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.787Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.807Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.842Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.869Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:50.894Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Create
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:51.219Z: Executing operation
BigQueryIO.TypedRead/Read(BigQueryTableSource)+BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)+BigQueryTornadoes.CountTornadoes/ParDo(ExtractTornadoes)+BigQueryTornadoes.CountTornadoes/Count.PerElement/Init/Map+BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:51.271Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)+BigQueryIO.Write/BatchLoads/CreateJobId+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 12:39:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:51.298Z: Executing operation
BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 12:40:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:39:59.116Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
May 27, 2018 12:40:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:40:09.655Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
May 27, 2018 12:40:30 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:40:28.776Z: Workers have started successfully.
May 27, 2018 12:41:09 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:07.464Z: Executing operation
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
May 27, 2018 12:41:09 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:07.525Z: Executing operation
BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/CreateDataflowView
May 27, 2018 12:41:09 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:08.929Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 12:41:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:09.115Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 12:41:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:09.414Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 12:41:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:09.488Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 12:41:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:18.084Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 12:41:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:18.141Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 12:41:22 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:20.320Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 12:41:22 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:20.376Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 12:41:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:29.644Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 12:41:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:29.807Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)+BigQueryIO.Write/BatchLoads/GetTempFilePrefix+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 12:41:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:29.896Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 12:41:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:30.034Z: Executing operation
BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)+BigQueryIO.TypedRead/PassThroughThenCleanup/Cleanup
May 27, 2018 12:41:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:33.772Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 12:41:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:33.843Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 12:41:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:38.415Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 12:41:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:38.479Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 12:41:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:45.583Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 12:41:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:45.733Z: Executing operation
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+BigQueryTornadoes.CountTornadoes/ParDo(FormatCounts)+BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign+BigQueryIO.Write/BatchLoads/WriteBundlesToFiles+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+BigQueryIO.Write/BatchLoads/GroupByDestination/Reify+BigQueryIO.Write/BatchLoads/GroupByDestination/Write
May 27, 2018 12:41:52 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:52.356Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Close
May 27, 2018 12:41:52 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:52.433Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Read+BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow+BigQueryIO.Write/BatchLoads/WriteGroupedRecords+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 27, 2018 12:41:55 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:55.118Z: Executing operation s46-u136
May 27, 2018 12:41:55 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:55.322Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/CreateDataflowView
May 27, 2018 12:41:55 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:55.527Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)+BigQueryIO.Write/BatchLoads/ReifyResults/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WritePartitionUntriggered+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Write+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write
May 27, 2018 12:41:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:57.446Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Close
May 27, 2018 12:41:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:57.493Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Close
May 27, 2018 12:41:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:57.540Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Write
May 27, 2018 12:41:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:41:57.597Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 27, 2018 12:42:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:42:04.140Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Close
May 27, 2018 12:42:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:42:04.195Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/CreateDataflowView
May 27, 2018 12:42:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:42:04.237Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
May 27, 2018 12:42:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:42:04.381Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Close
May 27, 2018 12:42:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:42:04.422Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WriteRenameUntriggered
May 27, 2018 12:42:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:42:04.477Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParDo(GarbageCollectTemporaryFiles)
May 27, 2018 12:42:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:42:06.997Z: Cleaning up.
May 27, 2018 12:42:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:42:07.097Z: Stopping worker pool...
May 27, 2018 12:43:25 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:43:24.373Z: Autoscaling: Resized worker pool from 1 to
0.
May 27, 2018 12:43:25 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T00:43:24.423Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
May 27, 2018 12:43:34 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-26_17_39_39-16896198291746871985 finished with status
DONE.
May 27, 2018 12:43:34 AM
org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-05-26_17_39_39-16896198291746871985. Found 0 success, 0 failures out of 0
expected assertions.
May 27, 2018 12:43:34 AM org.apache.beam.sdk.io.gcp.testing.BigqueryMatcher
matchesSafely
INFO: Verifying Bigquery data
May 27, 2018 12:43:34 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-26_17_39_39-16896198291746871985 finished with status
DONE.
Gradle Test Executor 130 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:examplesJavaIntegrationTest
Finished generating test XML results (0.002 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/examplesJavaIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.003 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaIntegrationTest>
Packing task
':beam-runners-google-cloud-dataflow-java:examplesJavaIntegrationTest'
:beam-runners-google-cloud-dataflow-java:examplesJavaIntegrationTest
(Thread[Task worker for ':' Thread 12,5,main]) completed. Took 4 mins 3.347
secs.
:beam-runners-google-cloud-dataflow-java:postCommit (Thread[Task worker for ':'
Thread 12,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:postCommit
Skipping task ':beam-runners-google-cloud-dataflow-java:postCommit' as it has
no actions.
:beam-runners-google-cloud-dataflow-java:postCommit (Thread[Task worker for ':'
Thread 12,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-extensions-sql:integrationTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/extensions/sql/build/reports/tests/integrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 43m 15s
536 actionable tasks: 524 executed, 12 from cache
Publishing build scan...
https://gradle.com/s/umxvoe26xp7u4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
