See
<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/8/display/redirect?page=changes>
Changes:
[github] Fix Community Metrics Prober test (#6876)
------------------------------------------
[...truncated 1.58 MB...]
INFO: 2018-10-30T19:10:14.940Z: Fusing consumer
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:14.990Z: Fusing consumer
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:15.037Z: Fusing consumer
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:15.124Z: Fusing consumer
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:15.171Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(SplitBoundedSource)
into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Impulse
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:15.208Z: Fusing consumer
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:15.257Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(SplitBoundedSource)
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:15.295Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:15.342Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(ReadFromBoundedSource)
into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:15.389Z: Fusing consumer
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
into
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.032Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.080Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.131Z: Starting 1 workers in us-central1-b...
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.131Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.174Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.218Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.264Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.311Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.366Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.402Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.446Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.475Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.518Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.546Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.592Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.639Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.676Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.725Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.770Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.813Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.854Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.890Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:16.941Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:18.077Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:18.116Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:18.160Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:18.208Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:18.255Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:18.306Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:18.354Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Oct 30, 2018 7:10:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:18.398Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Oct 30, 2018 7:10:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:10:32.833Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Oct 30, 2018 7:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:11:40.216Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
Oct 30, 2018 7:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:11:40.261Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Oct 30, 2018 7:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:11:41.496Z: Workers have started successfully.
Oct 30, 2018 7:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:11:41.537Z: Workers have started successfully.
Oct 30, 2018 7:12:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:12:05.406Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Oct 30, 2018 7:12:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:12:05.490Z: Executing operation
BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/ParDo(ReadFromBoundedSource)+DropInputs
Oct 30, 2018 7:12:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:12:07.721Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Oct 30, 2018 7:12:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:12:09.982Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Oct 30, 2018 7:12:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:12:10.072Z: Executing operation
BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/CreateJobId+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 30, 2018 7:12:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:12:12.220Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Oct 30, 2018 7:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:12:22.327Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 30, 2018 7:12:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:12:22.423Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Oct 30, 2018 7:15:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:10.577Z: Autoscaling: Resizing worker pool from 1 to
2.
Oct 30, 2018 7:15:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:28.606Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Oct 30, 2018 7:15:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:32.145Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Oct 30, 2018 7:15:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:35.497Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Oct 30, 2018 7:15:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:35.615Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Oct 30, 2018 7:15:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:36.637Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Oct 30, 2018 7:15:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:36.773Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 30, 2018 7:15:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:45.292Z: Executing operation
BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Oct 30, 2018 7:15:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:45.509Z: Executing operation
BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/GetTempFilePrefix+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Oct 30, 2018 7:15:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:51.562Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 30, 2018 7:15:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:51.668Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Oct 30, 2018 7:15:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:53.080Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Oct 30, 2018 7:15:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:53.174Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Oct 30, 2018 7:15:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:54.194Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Oct 30, 2018 7:15:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:15:54.294Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Oct 30, 2018 7:16:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:00.420Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Oct 30, 2018 7:16:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:00.767Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Oct 30, 2018 7:16:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:00.859Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Oct 30, 2018 7:16:03 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:02.908Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Oct 30, 2018 7:16:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:07.135Z: Autoscaling: Raised the number of workers
to 2 based on the rate of progress in the currently running step(s).
Oct 30, 2018 7:16:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:08.000Z: Executing operation
BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Oct 30, 2018 7:16:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:08.229Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write+BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign+BigQueryIO.Write/BatchLoads/WriteBundlesToFiles+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write+BigQueryIO.Write/BatchLoads/GroupByDestination/Reify+BigQueryIO.Write/BatchLoads/GroupByDestination/Write
Oct 30, 2018 7:16:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:13.932Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Close
Oct 30, 2018 7:16:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:13.968Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Oct 30, 2018 7:16:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:14.018Z: Executing operation
BigQueryIO.Write/BatchLoads/GroupByDestination/Read+BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow+BigQueryIO.Write/BatchLoads/WriteGroupedRecords+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Oct 30, 2018 7:16:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:14.073Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Oct 30, 2018 7:16:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:16.242Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Oct 30, 2018 7:16:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:16.327Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Oct 30, 2018 7:16:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:19.488Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/Materialize
Oct 30, 2018 7:16:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:19.705Z: Executing operation
BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Cleanup
Oct 30, 2018 7:16:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:20.228Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/Materialize
Oct 30, 2018 7:16:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:20.464Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyResults/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WritePartitionUntriggered+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Write+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write
Oct 30, 2018 7:16:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:24.685Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Close
Oct 30, 2018 7:16:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:24.720Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Close
Oct 30, 2018 7:16:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:24.779Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Oct 30, 2018 7:16:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:24.828Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Write
Oct 30, 2018 7:16:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:27.291Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Close
Oct 30, 2018 7:16:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:27.341Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Oct 30, 2018 7:16:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:27.388Z: Executing operation
BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
Oct 30, 2018 7:16:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:27.537Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Oct 30, 2018 7:16:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:30.276Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/Materialize
Oct 30, 2018 7:16:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:30.496Z: Executing operation
BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WriteRenameUntriggered
Oct 30, 2018 7:16:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:31.283Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Close
Oct 30, 2018 7:16:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:31.373Z: Executing operation
BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParDo(GarbageCollectTemporaryFiles)
Oct 30, 2018 7:16:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:34.685Z: Cleaning up.
Oct 30, 2018 7:16:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:16:34.794Z: Stopping worker pool...
Oct 30, 2018 7:20:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:20:04.350Z: Autoscaling: Resized worker pool from 2 to
0.
Oct 30, 2018 7:20:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:20:04.397Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Oct 30, 2018 7:20:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-30T19:20:04.481Z: Worker pool stopped.
Oct 30, 2018 7:20:11 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-10-30_12_09_58-16443272416561111484 finished with status
DONE.
Oct 30, 2018 7:20:11 PM org.apache.beam.runners.dataflow.TestDataflowRunner
checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-10-30_12_09_58-16443272416561111484. Found 0 success, 0 failures out of 0
expected assertions.
Oct 30, 2018 7:20:11 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-10-30_12_09_58-16443272416561111484 finished with status
DONE.
Oct 30, 2018 7:20:12 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteTable
INFO: Successfully deleted table: output_table
Oct 30, 2018 7:20:12 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient
deleteDataset
INFO: Successfully deleted dataset: bq_query_to_table_1540926586454_223
Gradle Test Executor 5 finished executing tests.
> Task
> :beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest
> FAILED
7 tests completed, 1 failed
Finished generating test XML results (0.031 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformFnApiWorkerIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.03 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformFnApiWorkerIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest
(Thread[Task worker for ':' Thread 5,5,main]) completed. Took 1 hrs 34 mins
26.632 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformFnApiWorkerIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 54m 30s
90 actionable tasks: 84 executed, 5 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bn57ci3kcj4rc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
