See
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/589/display/redirect>
------------------------------------------
[...truncated 18.16 MB...]
INFO: 2018-05-30T03:30:37.242Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.286Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.332Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/ParDo(CollectWindows)
into SpannerIO.Write/To mutation group
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.372Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Extract keys into SpannerIO.Write/Write mutations to
Cloud Spanner/Serialize mutations
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.416Z: Fusing consumer ParDo(GenerateMutations)
into GenerateSequence/Read(BoundedCountingSource)
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.462Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/Combine.GroupedValues into
SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/GroupByKey/Read
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.489Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Batch mutations together into SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/GroupByWindow
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.533Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/ParMultiDo(ToIsmRecordForMapLike) into SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as
view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.580Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into
SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow)
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.627Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow) into
SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/Combine.GroupedValues/Extract
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.673Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey/Write into
SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/GroupByKey/Reify
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.709Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Extract into
SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/Combine.GroupedValues
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.749Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey/Reify into
SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Sample
keys/Combine.GroupedValues/Partial
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.792Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Partial into
SpannerIO.Write/Write mutations to Cloud Spanner/Extract keys
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.831Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Write
into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait
view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Reify
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.873Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Write into
SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as
view/ParMultiDo(ToIsmRecordForMapLike)
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.900Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/View.AsList/ParDo(ToIsmRecordForGlobalWindow) into SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Flatten.Iterables/FlattenIterables/FlatMap
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.940Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Write into
SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as
view/ParMultiDo(ToIsmRecordForMapLike)
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:37.986Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Flatten.Iterables/FlattenIterables/FlatMap into
SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Values/Values/Map
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.031Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Values/Values/Map into
SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Extract
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.076Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForKey)
into SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as
view/GBKaSVForKeys/Read
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.122Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Extract
into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait
view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.160Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/WithKeys/AddKeys/Map into
SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/ParDo(CollectWindows)
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.206Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues
into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait
view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Read
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.246Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Write mutations to Spanner into
SpannerIO.Write/Write mutations to Cloud Spanner/Batch mutations together
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.291Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Reify
into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait
view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Partial
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.337Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Partial
into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait
view 0/Sample.Any/Combine.globally(SampleAny)/WithKeys/AddKeys/Map
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.380Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Reify into SpannerIO.Write/Write
mutations to Cloud Spanner/Partition input
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.424Z: Fusing consumer SpannerIO.Write/To mutation
group into ParDo(GenerateMutations)
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.468Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/GroupByWindow into
SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Read
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.513Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Write into SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Reify
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:38.556Z: Fusing consumer SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/ParDo(ToIsmMetadataRecordForSize) into SpannerIO.Write/Write mutations to
Cloud Spanner/Keys sample as view/GBKaSVForSize/Read
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.000Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.043Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.090Z: Starting 1 workers in us-central1-b...
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.090Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey/Create
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.131Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.171Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Create
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.212Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Create
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.250Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Create
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.294Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Create
May 30, 2018 3:30:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:39.700Z: Executing operation
GenerateSequence/Read(BoundedCountingSource)+ParDo(GenerateMutations)+SpannerIO.Write/To
mutation group+SpannerIO.Write/Write mutations to Cloud
Spanner/Wait.OnSignal/To wait view
0/ParDo(CollectWindows)+SpannerIO.Write/Write mutations to Cloud
Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/WithKeys/AddKeys/Map+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Partial+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Reify+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Write
May 30, 2018 3:30:50 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:30:48.924Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 3:31:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:31:26.203Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 3:31:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:31:26.230Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
May 30, 2018 3:31:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:31:42.393Z: Workers have started successfully.
May 30, 2018 3:32:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:19.230Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Close
May 30, 2018 3:32:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:19.326Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Extract+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Combine.globally(SampleAny)/Values/Values/Map+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/Sample.Any/Flatten.Iterables/FlattenIterables/FlatMap+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
May 30, 2018 3:32:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:27.873Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/To wait view
0/View.AsList/CreateDataflowView
May 30, 2018 3:32:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:28.105Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Create seed/Read(CreateSource)+SpannerIO.Write/Write
mutations to Cloud Spanner/Wait.OnSignal/Wait/Map+SpannerIO.Write/Write
mutations to Cloud Spanner/Read information schema+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 3:32:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:35.918Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 3:32:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:36.014Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 3:32:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:39.817Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 3:32:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:39.908Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 3:32:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:47.166Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Schema
View/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 3:32:49 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:47.362Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Serialize mutations+SpannerIO.Write/Write mutations
to Cloud Spanner/Extract keys+SpannerIO.Write/Write mutations to Cloud
Spanner/Sample keys/GroupByKey+SpannerIO.Write/Write mutations to Cloud
Spanner/Sample keys/Combine.GroupedValues/Partial+SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey/Reify+SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey/Write
May 30, 2018 3:33:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:58.780Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey/Close
May 30, 2018 3:33:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:32:58.862Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Sample keys/GroupByKey/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Sample
keys/Combine.GroupedValues+SpannerIO.Write/Write mutations to Cloud
Spanner/Sample keys/Combine.GroupedValues/Extract+SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow)+SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 3:33:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:00.710Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 3:33:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:00.813Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/ParMultiDo(ToIsmRecordForMapLike)+SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/GBKaSVForSize/Write+SpannerIO.Write/Write mutations
to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Write
May 30, 2018 3:33:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:10.622Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Close
May 30, 2018 3:33:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:10.659Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Close
May 30, 2018 3:33:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:10.697Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForSize/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Keys
sample as view/ParDo(ToIsmMetadataRecordForSize)
May 30, 2018 3:33:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:10.741Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForKeys/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Keys
sample as view/ParDo(ToIsmMetadataRecordForKey)
May 30, 2018 3:33:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:21.633Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/Flatten.PCollections
May 30, 2018 3:33:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:21.888Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/CreateDataflowView
May 30, 2018 3:33:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:22.110Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Partition input+SpannerIO.Write/Write mutations to
Cloud Spanner/Group by partition/Reify+SpannerIO.Write/Write mutations to Cloud
Spanner/Group by partition/Write
May 30, 2018 3:33:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:29.770Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Close
May 30, 2018 3:33:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:29.862Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Group by
partition/GroupByWindow+SpannerIO.Write/Write mutations to Cloud Spanner/Batch
mutations together+SpannerIO.Write/Write mutations to Cloud Spanner/Write
mutations to Spanner
May 30, 2018 3:33:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:36.639Z: Cleaning up.
May 30, 2018 3:33:39 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:33:38.825Z: Stopping worker pool...
May 30, 2018 3:35:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:35:07.940Z: Autoscaling: Resized worker pool from 1 to
0.
May 30, 2018 3:35:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:35:07.981Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
May 30, 2018 3:35:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T03:35:08.038Z: Worker pool stopped.
May 30, 2018 3:35:23 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_20_30_29-337774431980376265 finished with status DONE.
May 30, 2018 3:35:23 AM org.apache.beam.runners.dataflow.TestDataflowRunner
checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-05-29_20_30_29-337774431980376265. Found 0 success, 0 failures out of 0
expected assertions.
May 30, 2018 3:35:23 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_20_30_29-337774431980376265 finished with status DONE.
Gradle Test Executor 122 finished executing tests.
> Task
> :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest
Finished generating test XML results (0.014 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.012 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
Packing task
':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest
(Thread[Task worker for ':' Thread 7,5,main]) completed. Took 31 mins 34.751
secs.
:beam-runners-google-cloud-dataflow-java:postCommit (Thread[Task worker for ':'
Thread 7,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:postCommit
Skipping task ':beam-runners-google-cloud-dataflow-java:postCommit' as it has
no actions.
:beam-runners-google-cloud-dataflow-java:postCommit (Thread[Task worker for ':'
Thread 7,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-extensions-sql:spotlessJava'.
> The following files had format violations:
sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/meta/provider/bigquery/BigQueryWriteIT.java
@@ -52,9 +52,7 @@
import·org.junit.runner.RunWith;
import·org.junit.runners.JUnit4;
-/**
-·*·Integration·tests·form·writing·to·BigQuery·with·Beam·SQL.
-·*/
+/**·Integration·tests·form·writing·to·BigQuery·with·Beam·SQL.·*/
@RunWith(JUnit4.class)
public·class·BigQueryWriteIT·implements·Serializable·{
@@ -62,18 +60,10 @@
······DateTimeFormat.forPattern("YYYY_MM_dd_HH_mm_ss_SSS");
··private·static·final·Schema·SOURCE_SCHEMA·=
-······RowSqlTypes
-··········.builder()
-··········.withBigIntField("id")
-··········.withVarcharField("name")
-··········.build();
+······RowSqlTypes.builder().withBigIntField("id").withVarcharField("name").build();
··private·static·final·Schema·RESULT_SCHEMA·=
-······RowSqlTypes
-··········.builder()
-··········.withVarcharField("id")
-··········.withVarcharField("name")
-··········.build();
+······RowSqlTypes.builder().withVarcharField("id").withVarcharField("name").build();
··@Rule·public·transient·TestPipeline·pipeline·=·TestPipeline.create();
··@Rule·public·transient·TestPipeline·resultsPipeline·=·TestPipeline.create();
@@ -85,18 +75,19 @@
····String·createTableStatement·=
········"CREATE·TABLE·ORDERS(·\n"
-········+·"···id·BIGINT,·\n"
-········+·"···name·VARCHAR·)·\n"
-········+·"TYPE·'bigquery'·\n"
-········+·"LOCATION·'"·+·bigQueryLocation·+·"'";
+············+·"···id·BIGINT,·\n"
+············+·"···name·VARCHAR·)·\n"
+············+·"TYPE·'bigquery'·\n"
+············+·"LOCATION·'"
+············+·bigQueryLocation
+············+·"'";
····executeCreateTable(sqlEnv,·createTableStatement);
····executeInsert(pipeline,·sqlEnv,·"INSERT·INTO·ORDERS·VALUES·(1,·'foo')");
... (168 more lines that didn't fit)
Violations also present in:
sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/meta/provider/bigquery/TestBigQueryOptions.java
Run 'gradlew spotlessApply' to fix these violations.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 45m 8s
525 actionable tasks: 520 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/7mwl5p7druvqs
Build cache (/home/jenkins/.gradle/caches/build-cache-1) remove files older
than Wed May 23 02:50:19 UTC 2018.
Build cache (/home/jenkins/.gradle/caches/build-cache-1) removing 36626 cache
entries (2 GB reclaimed).
Build cache (/home/jenkins/.gradle/caches/build-cache-1) cleaned up in 2.392
secs.
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user [email protected]
