See
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/6448/display/redirect?page=changes>
Changes:
[Jan Lukavský] [BEAM-14492] add flinkConfDir to FlinkPipelineOptions
------------------------------------------
[...truncated 345.26 KB...]
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.351Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.399Z: Fusing consumer
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract
into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.436Z: Fusing consumer
Combine.globally(Top(Natural))/Values/Values/Map into
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.467Z: Fusing consumer
Combine.globally(Top(Natural))/ProduceDefault into
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.550Z: Unzipping flatten s42-u187 for input
s44.org.apache.beam.sdk.values.PCollection.<init>:408#43d0369d0f0559b7-c185
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.671Z: Fusing unzipped copy of
PAssert$2/GroupGlobally/GroupByKey/Reify, through flatten
PAssert$2/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.791Z: Fusing consumer
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.873Z: Fusing consumer
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.922Z: Fusing consumer
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.957Z: Fusing consumer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:18.983Z: Fusing consumer
PAssert$1/GroupGlobally/GroupByKey/Reify into
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:19.010Z: Fusing consumer
PAssert$3/GroupGlobally/GroupByKey/Reify into
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:19.046Z: Fusing consumer
PAssert$4/GroupGlobally/GroupByKey/Reify into
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map
May 26, 2022 8:12:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:19.080Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/Reify into
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
May 26, 2022 8:12:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:19.530Z: Executing operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 26, 2022 8:12:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:19.607Z: Starting 5 ****s in us-central1-b...
May 26, 2022 8:12:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:12:42.589Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
May 26, 2022 8:13:22 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:13:17.886Z: Workers have started successfully.
May 26, 2022 8:14:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:11.886Z: Finished operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 26, 2022 8:14:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:12.081Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
May 26, 2022 8:14:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:12.133Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
May 26, 2022 8:14:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:12.315Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 26, 2022 8:14:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:12.881Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 26, 2022 8:14:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:13.042Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:41.585Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:41.656Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:41.746Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:41.817Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:41.852Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:41.888Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:41.932Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Create
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:42.051Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:42.065Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:42.099Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:42.206Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Create
May 26, 2022 8:14:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:14:42.402Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:11.258Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:11.967Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.006Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.066Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.091Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.106Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Close
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.112Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.141Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.162Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Close
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.165Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Create
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.190Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Create
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.223Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Create
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.275Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Create
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.366Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Create
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.369Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Create
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.434Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Create
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.504Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Create
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.584Z: Executing operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.617Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.726Z: Executing operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.794Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.827Z: Executing operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.870Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 26, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:12.904Z: Executing operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:13.890Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:13.967Z: Finished operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:14.877Z: Finished operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:14.897Z: Finished operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:15.149Z: Finished operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:15.223Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Close
May 26, 2022 8:15:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:15.317Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Close
May 26, 2022 8:15:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:15.379Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:15.795Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:15.942Z: Executing operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.005Z: Finished operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.184Z: Executing operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.190Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.288Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.382Z: Executing operation Count
All/View.AsIterable/CreateDataflowView
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.450Z: Finished operation Count
All/View.AsIterable/CreateDataflowView
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.487Z: Executing operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.556Z: Finished operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.590Z: Executing operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.672Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:16.740Z: Executing operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:18 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:17.724Z: Finished operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:18 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:17.817Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Close
May 26, 2022 8:15:18 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:17.917Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Close
May 26, 2022 8:15:18 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:18.057Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2022 8:15:18 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:18.189Z: Finished operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:18.329Z: Finished operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:18.491Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Close
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:18.579Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Close
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:18.744Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Close
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:18.826Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Close
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:18.944Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:19.074Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:19.521Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:20.413Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2022 8:15:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:20.551Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2022 8:15:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:28.966Z: Cleaning up.
May 26, 2022 8:15:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:15:29.041Z: Stopping **** pool...
May 26, 2022 8:16:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:16:02.944Z: Autoscaling: Resized **** pool from 5 to 0.
May 26, 2022 8:16:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-26T08:16:03.005Z: Worker pool stopped.
May 26, 2022 8:16:13 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-05-26_01_11_46-13769290787923339763 finished with status
DONE.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT
Load test results for test (ID): 976df10d-f2cd-4704-bee5-0399cf2bcafb and
timestamp: 2022-05-26T08:16:13.471000000Z:
Metric: Value:
write_time 39.748
total_size 2.60866048E8
Load test results for test (ID): 976df10d-f2cd-4704-bee5-0399cf2bcafb and
timestamp: 2022-05-26T08:16:13.471000000Z:
Metric: Value:
read_time 25.157
Gradle Test Executor 32 finished executing tests.
> Task :sdks:java:io:jdbc:integrationTest FAILED
3 tests completed, 2 failed
Finished generating test XML results (0.003 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.004 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:sdks:java:io:jdbc:integrationTest (Thread[Execution **** for ':' Thread
3,5,main]) completed. Took 7 mins 57.141 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:jdbc:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 7s
129 actionable tasks: 75 executed, 52 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i7xrejzk7hmwa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
