See
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/663/display/redirect>
------------------------------------------
[...truncated 18.13 MB...]
INFO: 2018-06-05T12:41:57.066Z: Fusing consumer
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.101Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
into BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.143Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify into
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.189Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow
into BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.233Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write into
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.275Z: Fusing consumer
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.318Z: Fusing consumer
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.361Z: Fusing consumer
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.397Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)
into BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/ExpandIterable
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.433Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify into
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.467Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow
into BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.513Z: Fusing consumer
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write into
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.546Z: Unzipping flatten s46 for input
s43.writtenFiles
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.592Z: Fusing unzipped copy of
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow),
through flatten BigQueryIO.Write/BatchLoads/FlattenFiles, into producer
BigQueryIO.Write/BatchLoads/WriteBundlesToFiles
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.627Z: Fusing consumer
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into BigQueryIO.Write/BatchLoads/WriteGroupedRecords
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.665Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify
into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.700Z: Fusing consumer
BigQueryIO.Write/BatchLoads/GroupByDestination/Reify into
BigQueryIO.Write/BatchLoads/WriteBundlesToFiles
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.736Z: Fusing consumer
BigQueryIO.Write/BatchLoads/WriteGroupedRecords into
BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.780Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Init/Map into
BigQueryTornadoes.CountTornadoes/ParDo(ExtractTornadoes)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.819Z: Fusing consumer
BigQueryIO.Write/BatchLoads/GroupByDestination/Write into
BigQueryIO.Write/BatchLoads/GroupByDestination/Reify
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.863Z: Fusing consumer
BigQueryIO.Write/BatchLoads/WriteBundlesToFiles into
BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.908Z: Fusing consumer
BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign into
BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.954Z: Fusing consumer
BigQueryIO.Write/PrepareWrite/ParDo(Anonymous) into
BigQueryTornadoes.CountTornadoes/ParDo(FormatCounts)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:57.997Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/ParDo(ExtractTornadoes) into
BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.041Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues
into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.087Z: Fusing consumer
BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity) into
BigQueryIO.TypedRead/Read(BigQueryTableSource)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.131Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.166Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract
into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.205Z: Fusing consumer
BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow into
BigQueryIO.Write/BatchLoads/GroupByDestination/Read
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.250Z: Fusing consumer
BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.295Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/ParDo(FormatCounts) into
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.338Z: Fusing consumer
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial
into BigQueryTornadoes.CountTornadoes/Count.PerElement/Init/Map
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.372Z: Fusing consumer
BigQueryIO.TypedRead/PassThroughThenCleanup/Cleanup into
BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.416Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.460Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.504Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.542Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.585Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.628Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.672Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.714Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.756Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:58.799Z: Fusing consumer
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.255Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)+DropInputs
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.293Z: Executing operation
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.324Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.348Z: Starting 1 workers in us-central1-b...
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.359Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.392Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.426Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.450Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.481Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.512Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.540Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.573Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.605Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:41:59.630Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Create
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:42:00.023Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)+BigQueryIO.Write/BatchLoads/CreateJobId+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:42:00.073Z: Executing operation
BigQueryIO.TypedRead/Read(BigQueryTableSource)+BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)+BigQueryTornadoes.CountTornadoes/ParDo(ExtractTornadoes)+BigQueryTornadoes.CountTornadoes/Count.PerElement/Init/Map+BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:42:00.115Z: Executing operation
BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 05, 2018 12:42:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:42:05.955Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Jun 05, 2018 12:42:18 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:42:16.472Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
Jun 05, 2018 12:42:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:42:38.151Z: Workers have started successfully.
Jun 05, 2018 12:43:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:13.432Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 05, 2018 12:43:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:13.522Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 05, 2018 12:43:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:19.057Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 05, 2018 12:43:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:19.147Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 05, 2018 12:43:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:24.021Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 05, 2018 12:43:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:24.103Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 05, 2018 12:43:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:30.420Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 05, 2018 12:43:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:30.509Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 05, 2018 12:43:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:39.083Z: Executing operation
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Jun 05, 2018 12:43:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:39.122Z: Executing operation
BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/CreateDataflowView
Jun 05, 2018 12:43:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:40.817Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 05, 2018 12:43:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:41.021Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)+BigQueryIO.Write/BatchLoads/GetTempFilePrefix+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 05, 2018 12:43:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:44.556Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 05, 2018 12:43:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:44.639Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 05, 2018 12:43:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:46.976Z: Executing operation
BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 05, 2018 12:43:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:47.137Z: Executing operation
BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)+BigQueryIO.TypedRead/PassThroughThenCleanup/Cleanup
Jun 05, 2018 12:43:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:50.720Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 05, 2018 12:43:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:50.792Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 05, 2018 12:43:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:56.129Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 05, 2018 12:43:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:43:56.245Z: Executing operation
BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+BigQueryTornadoes.CountTornadoes/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+BigQueryTornadoes.CountTornadoes/ParDo(FormatCounts)+BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign+BigQueryIO.Write/BatchLoads/WriteBundlesToFiles+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+BigQueryIO.Write/BatchLoads/GroupByDestination/Reify+BigQueryIO.Write/BatchLoads/GroupByDestination/Write
Jun 05, 2018 12:44:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:06.153Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Close
Jun 05, 2018 12:44:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:06.241Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Read+BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow+BigQueryIO.Write/BatchLoads/WriteGroupedRecords+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 05, 2018 12:44:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:08.729Z: Executing operation s46-u136
Jun 05, 2018 12:44:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:08.992Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/CreateDataflowView
Jun 05, 2018 12:44:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:09.179Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)+BigQueryIO.Write/BatchLoads/ReifyResults/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WritePartitionUntriggered+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Write+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write
Jun 05, 2018 12:44:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:10.224Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Close
Jun 05, 2018 12:44:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:10.266Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Close
Jun 05, 2018 12:44:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:10.309Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Write
Jun 05, 2018 12:44:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:10.350Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 05, 2018 12:44:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:12.877Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Close
Jun 05, 2018 12:44:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:12.933Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/CreateDataflowView
Jun 05, 2018 12:44:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:12.969Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
Jun 05, 2018 12:44:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:13.123Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WriteRenameUntriggered
Jun 05, 2018 12:44:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:15.552Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Close
Jun 05, 2018 12:44:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:15.637Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParDo(GarbageCollectTemporaryFiles)
Jun 05, 2018 12:44:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:19.589Z: Cleaning up.
Jun 05, 2018 12:44:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:44:19.689Z: Stopping worker pool...
Jun 05, 2018 12:46:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:46:12.395Z: Autoscaling: Resized worker pool from 1 to
0.
Jun 05, 2018 12:46:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-05T12:46:12.431Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Jun 05, 2018 12:46:21 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-05_05_41_46-9314191257539010534 finished with status DONE.
Jun 05, 2018 12:46:21 PM
org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-06-05_05_41_46-9314191257539010534. Found 0 success, 0 failures out of 0
expected assertions.
Jun 05, 2018 12:46:21 PM org.apache.beam.sdk.io.gcp.testing.BigqueryMatcher
matchesSafely
INFO: Verifying Bigquery data
Jun 05, 2018 12:46:22 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-05_05_41_46-9314191257539010534 finished with status DONE.
Gradle Test Executor 133 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:examplesJavaIntegrationTest
Finished generating test XML results (0.002 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/examplesJavaIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.003 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaIntegrationTest>
Packing task
':beam-runners-google-cloud-dataflow-java:examplesJavaIntegrationTest'
:beam-runners-google-cloud-dataflow-java:examplesJavaIntegrationTest
(Thread[Task worker for ':' Thread 6,5,main]) completed. Took 4 mins 44.137
secs.
:beam-runners-google-cloud-dataflow-java:postCommit (Thread[Task worker for ':'
Thread 6,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:postCommit
Skipping task ':beam-runners-google-cloud-dataflow-java:postCommit' as it has
no actions.
:beam-runners-google-cloud-dataflow-java:postCommit (Thread[Task worker for ':'
Thread 6,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-direct-java:test'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/direct-java/build/reports/tests/test/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 45m 10s
541 actionable tasks: 527 executed, 14 from cache
Publishing build scan...
https://gradle.com/s/vhx3qyz3esnyi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
