See
<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/84/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-5879 ] Make write_record() in tfrecordio.py py3 compatible
(#6953)
------------------------------------------
[...truncated 1.58 MB...]
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.004Z: Fusing consumer
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.042Z: Fusing consumer
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.078Z: Fusing consumer
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.108Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(SplitBoundedSource)
into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Impulse
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.141Z: Fusing consumer
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.175Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(SplitBoundedSource)
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.203Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.232Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(ReadFromBoundedSource)
into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.267Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.755Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.795Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.831Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.831Z: Starting 1 workers in us-central1-b...
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.866Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.903Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.937Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.974Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:10.998Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.023Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 07, 2018 11:22:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.048Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.084Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.110Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.147Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.184Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.223Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.258Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.294Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.326Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.365Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.399Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.442Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:11.475Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:12.310Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:12.347Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:12.386Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:12.420Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:12.495Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:12.529Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:12.576Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 07, 2018 11:22:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:12.615Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 07, 2018 11:22:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:22:21.080Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Nov 07, 2018 11:23:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:00.748Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
Nov 07, 2018 11:23:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:00.780Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Nov 07, 2018 11:23:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:05.763Z: Workers have started successfully.
Nov 07, 2018 11:23:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:05.796Z: Workers have started successfully.
Nov 07, 2018 11:23:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:30.194Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 07, 2018 11:23:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:32.477Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 07, 2018 11:23:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:34.707Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 07, 2018 11:23:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:34.852Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/ParDo(ReadFromBoundedSource)+DropInputs
Nov 07, 2018 11:23:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:36.922Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 07, 2018 11:23:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:39.191Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 07, 2018 11:23:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:39.281Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/CreateJobId+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Nov 07, 2018 11:23:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:23:41.445Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 07, 2018 11:25:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:25:55.694Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 07, 2018 11:26:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:00.635Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Nov 07, 2018 11:26:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:00.748Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 07, 2018 11:26:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:00.813Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 07, 2018 11:26:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:00.933Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Nov 07, 2018 11:26:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:10.743Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Nov 07, 2018 11:26:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:10.840Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 07, 2018 11:26:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:11.018Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 07, 2018 11:26:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:11.180Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 07, 2018 11:26:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:21.306Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Nov 07, 2018 11:26:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:21.412Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 07, 2018 11:26:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:21.486Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 07, 2018 11:26:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:21.531Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/GetTempFilePrefix+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Nov 07, 2018 11:26:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:29.008Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Nov 07, 2018 11:26:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:30.522Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Nov 07, 2018 11:26:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:30.591Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 07, 2018 11:26:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:35.991Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 07, 2018 11:26:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:36.077Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 07, 2018 11:26:46 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:44.582Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Nov 07, 2018 11:26:46 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:44.820Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write+BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign+BigQueryIO.Write/BatchLoads/WriteBundlesToFiles+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write+BigQueryIO.Write/BatchLoads/GroupByDestination/Reify+BigQueryIO.Write/BatchLoads/GroupByDestination/Write
Nov 07, 2018 11:26:52 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:50.773Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Close
Nov 07, 2018 11:26:52 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:50.807Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 07, 2018 11:26:52 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:50.881Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Read+BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow+BigQueryIO.Write/BatchLoads/WriteGroupedRecords+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 07, 2018 11:26:52 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:50.950Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 07, 2018 11:26:53 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:52.447Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 07, 2018 11:26:53 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:52.550Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 07, 2018 11:26:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:56.032Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/Materialize
Nov 07, 2018 11:26:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:26:56.324Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Cleanup
Nov 07, 2018 11:27:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:01.337Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/Materialize
Nov 07, 2018 11:27:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:01.539Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyResults/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WritePartitionUntriggered+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Write+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write
Nov 07, 2018 11:27:05 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:03.770Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Close
Nov 07, 2018 11:27:05 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:03.811Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Close
Nov 07, 2018 11:27:05 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:03.867Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 07, 2018 11:27:05 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:03.903Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Write
Nov 07, 2018 11:27:05 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:04.268Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Close
Nov 07, 2018 11:27:05 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:04.305Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 07, 2018 11:27:05 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:04.342Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
Nov 07, 2018 11:27:05 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:04.380Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 07, 2018 11:27:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:13.680Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Close
Nov 07, 2018 11:27:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:13.754Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParDo(GarbageCollectTemporaryFiles)
Nov 07, 2018 11:27:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:15.507Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/Materialize
Nov 07, 2018 11:27:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:15.696Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WriteRenameUntriggered
Nov 07, 2018 11:27:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:22.719Z: Cleaning up.
Nov 07, 2018 11:27:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:27:22.867Z: Stopping worker pool...
Nov 07, 2018 11:30:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:30:21.330Z: Autoscaling: Resized worker pool from 1 to
0.
Nov 07, 2018 11:30:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:30:21.375Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Nov 07, 2018 11:30:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-07T11:30:21.432Z: Worker pool stopped.
Nov 07, 2018 11:30:26 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-11-07_03_21_55-13708246454950729999 finished with status
DONE.
Nov 07, 2018 11:30:27 AM
org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-11-07_03_21_55-13708246454950729999. Found 0 success, 0 failures out of 0
expected assertions.
Nov 07, 2018 11:30:27 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-11-07_03_21_55-13708246454950729999 finished with status
DONE.
Nov 07, 2018 11:30:27 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT verifyLegacyQueryRes
INFO: Starting verifyLegacyQueryRes in outputTable
apache-beam-testing:bq_query_to_table_1541589703951_772.output_table
Nov 07, 2018 11:30:27 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT verifyLegacyQueryRes
INFO: Finished to query result table
apache-beam-testing:bq_query_to_table_1541589703951_772.output_table
Nov 07, 2018 11:30:27 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT cleanBqEnvironment
INFO: Start to clean up tables and datasets.
Nov 07, 2018 11:30:27 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: output_table
Nov 07, 2018 11:30:28 AM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: bq_query_to_table_1541589703951_772
Gradle Test Executor 3 finished executing tests.
> Task
> :beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest
Finished generating test XML results (0.03 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformFnApiWorkerIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.021 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformFnApiWorkerIntegrationTest>
Packing task
':beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest'
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest
(Thread[Daemon worker,5,main]) completed. Took 37 mins 5.803 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':beam-runners-google-cloud-dataflow-java:examplesJavaFnApiWorkerIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaFnApiWorkerIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 51m 30s
90 actionable tasks: 84 executed, 5 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/zygms376j3j34
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
