See
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/251/display/redirect?page=changes>
Changes:
[kirpichov] [BEAM-4144] Fixes SplittableParDoProcessFnTest
------------------------------------------
[...truncated 19.00 MB...]
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.010Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.034Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.059Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.089Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.120Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.151Z: Fusing consumer
PAssert$3/CreateActual/RewindowActuals/Window.Assign into
PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.180Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.211Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.244Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.275Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.303Z: Fusing consumer
PAssert$3/CreateActual/ParDo(Anonymous) into
PAssert$3/CreateActual/RewindowActuals/Window.Assign
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.333Z: Fusing consumer
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into PAssert$3/CreateActual/ParDo(Anonymous)
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.362Z: Fusing consumer
Combine.globally(Count)/ProduceDefault into
Combine.globally(Count)/CreateVoid/Read(CreateSource)
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.394Z: Fusing consumer
Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into
Combine.globally(Count)/Values/Values/Map
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.418Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.440Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
into Combine.globally(Count)/WithKeys/AddKeys/Map
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.464Z: Fusing consumer
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.488Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.521Z: Fusing consumer
Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.552Z: Fusing consumer
DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.578Z: Fusing consumer
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.610Z: Fusing consumer
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into
DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.642Z: Fusing consumer
Combine.globally(Count)/Values/Values/Map into
Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.673Z: Fusing consumer DatastoreV1.Read/Split into
DatastoreV1.Read/ParDo(GqlQueryTranslate)
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.702Z: Fusing consumer
DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into
DatastoreV1.Read/Reshuffle/Pair with random key
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.733Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.752Z: Fusing consumer
DatastoreV1.Read/ParDo(GqlQueryTranslate) into
DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.779Z: Fusing consumer DatastoreV1.Read/Read into
DatastoreV1.Read/Reshuffle/Values/Values/Map
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.807Z: Fusing consumer
DatastoreV1.Read/Reshuffle/Values/Values/Map into
DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.837Z: Fusing consumer
DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.865Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.898Z: Fusing consumer PAssert$3/RunChecks into
PAssert$3/WindowToken/Window.Assign
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.923Z: Fusing consumer
PAssert$3/WindowToken/Window.Assign into
PAssert$3/Create.Values/Read(CreateSource)
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:54.946Z: Fusing consumer
PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:55.271Z: Executing operation
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:55.297Z: Executing operation
PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:55.321Z: Executing operation
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:55.332Z: Starting 1 workers in us-central1-c...
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:55.342Z: Executing operation
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 01, 2018 10:36:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:36:55.376Z: Executing operation
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
May 01, 2018 10:37:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:37:04.437Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
May 01, 2018 10:37:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:37:04.575Z: Executing operation
DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair
with random
key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
May 01, 2018 10:37:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:37:09.950Z: Autoscaling: Resizing worker pool from 1 to
5.
May 01, 2018 10:37:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:37:47.872Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
May 01, 2018 10:37:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:37:47.905Z: Resized worker pool to 1, though goal was
5. This could be a quota issue.
May 01, 2018 10:37:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:37:58.372Z: Autoscaling: Raised the number of workers
to 5 based on the rate of progress in the currently running step(s).
May 01, 2018 10:38:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:38:11.866Z: Workers have started successfully.
May 01, 2018 10:38:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:38:39.530Z: Executing operation
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
May 01, 2018 10:38:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:38:39.590Z: Executing operation
DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
May 01, 2018 10:38:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:38:47.619Z: Executing operation
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
May 01, 2018 10:38:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:38:47.679Z: Executing operation
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 01, 2018 10:38:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:38:58.698Z: Executing operation
Combine.globally(Count)/View.AsIterable/CreateDataflowView
May 01, 2018 10:38:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:38:58.828Z: Executing operation
Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
May 01, 2018 10:39:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:00.189Z: Executing operation
PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
May 01, 2018 10:39:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:00.266Z: Executing operation
PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 01, 2018 10:39:02 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:02.155Z: Executing operation
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 01, 2018 10:39:02 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:02.227Z: Executing operation
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 01, 2018 10:39:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:03.893Z: Executing operation
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 01, 2018 10:39:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:03.954Z: Executing operation
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 01, 2018 10:39:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:08.065Z: Executing operation
PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 01, 2018 10:39:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:08.204Z: Executing operation
PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
May 01, 2018 10:39:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:09.062Z: Cleaning up.
May 01, 2018 10:39:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:39:09.349Z: Stopping worker pool...
May 01, 2018 10:40:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:40:37.720Z: Autoscaling: Resized worker pool from 5 to
0.
May 01, 2018 10:40:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-01T22:40:37.757Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
May 01, 2018 10:40:45 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-01_15_36_46-13250789493566899475 finished with status
DONE.
May 01, 2018 10:40:45 PM
org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-05-01_15_36_46-13250789493566899475. Found 1 success, 0 failures out of 1
expected assertions.
May 01, 2018 10:40:46 PM
org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
May 01, 2018 10:40:46 PM
org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
May 01, 2018 10:40:47 PM
org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
May 01, 2018 10:40:47 PM
org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
May 01, 2018 10:40:47 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil
deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT >
testSplitQueryFnWithLargeDataset STANDARD_ERROR
May 01, 2018 10:40:47 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly.
Please use TestPipeline instead.
May 01, 2018 10:40:47 PM
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1525074215000000
May 01, 2018 10:40:47 PM
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
May 01, 2018 10:40:47 PM
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn
processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT >
testSplitQueryFnWithSmallDataset STANDARD_ERROR
May 01, 2018 10:40:48 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly.
Please use TestPipeline instead.
May 01, 2018 10:40:48 PM
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1525074215000000
May 01, 2018 10:40:48 PM
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
May 01, 2018 10:40:48 PM
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn
processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 130 finished executing tests.
> Task
> :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest
> FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError:
com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at
com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at
com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException:
com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
13 tests completed, 4 failed
Finished generating test XML results (0.008 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.012 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest
(Thread[Task worker for ':',5,main]) completed. Took 16 mins 19.361 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 59m 21s
545 actionable tasks: 541 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/xplfuacw6xn6w
Build cache (/home/jenkins/.gradle/caches/build-cache-1) remove files older
than Tue Apr 24 21:41:30 UTC 2018.
Build cache (/home/jenkins/.gradle/caches/build-cache-1) removing 300 cache
entries (15 MB reclaimed).
Build cache (/home/jenkins/.gradle/caches/build-cache-1) cleaned up in 0.042
secs.
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user
[email protected]
Not sending mail to unregistered user [email protected]
