See
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/6432/display/redirect>
Changes:
------------------------------------------
[...truncated 346.56 KB...]
May 22, 2022 8:12:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:00.987Z: Fusing consumer
Combine.globally(Top(Natural))/ProduceDefault into
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)
May 22, 2022 8:12:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.019Z: Unzipping flatten s42-u187 for input
s44.org.apache.beam.sdk.values.PCollection.<init>:408#43d0369d0f0559b7-c185
May 22, 2022 8:12:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.069Z: Fusing unzipped copy of
PAssert$2/GroupGlobally/GroupByKey/Reify, through flatten
PAssert$2/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
May 22, 2022 8:12:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.093Z: Fusing consumer
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)
May 22, 2022 8:12:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.119Z: Fusing consumer
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)
May 22, 2022 8:12:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.154Z: Fusing consumer
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)
May 22, 2022 8:12:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.177Z: Fusing consumer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)
May 22, 2022 8:12:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.217Z: Fusing consumer
PAssert$1/GroupGlobally/GroupByKey/Reify into
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map
May 22, 2022 8:12:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.241Z: Fusing consumer
PAssert$3/GroupGlobally/GroupByKey/Reify into
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map
May 22, 2022 8:12:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.278Z: Fusing consumer
PAssert$4/GroupGlobally/GroupByKey/Reify into
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map
May 22, 2022 8:12:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.322Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/Reify into
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
May 22, 2022 8:12:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.686Z: Executing operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 22, 2022 8:12:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:01.761Z: Starting 5 ****s in us-central1-b...
May 22, 2022 8:12:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:34.701Z: Autoscaling: Raised the number of ****s to
4 based on the rate of progress in the currently running stage(s).
May 22, 2022 8:12:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:34.729Z: Resized **** pool to 4, though goal was 5.
This could be a quota issue.
May 22, 2022 8:12:46 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:12:44.913Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
May 22, 2022 8:13:06 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:13:06.778Z: Workers have started successfully.
May 22, 2022 8:14:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:09.495Z: Finished operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 22, 2022 8:14:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:09.649Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
May 22, 2022 8:14:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:09.708Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
May 22, 2022 8:14:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:09.822Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 22, 2022 8:14:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:10.474Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 22, 2022 8:14:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:10.601Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 22, 2022 8:14:39 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:38.714Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 22, 2022 8:14:39 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:38.806Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 22, 2022 8:14:39 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:38.863Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 22, 2022 8:14:39 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:38.911Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
May 22, 2022 8:14:39 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:38.946Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
May 22, 2022 8:14:39 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:38.972Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
May 22, 2022 8:14:39 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:38.997Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Create
May 22, 2022 8:14:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:39.085Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
May 22, 2022 8:14:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:39.121Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
May 22, 2022 8:14:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:39.156Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Create
May 22, 2022 8:14:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:39.220Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
May 22, 2022 8:14:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:14:39.382Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.054Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.121Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.144Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.166Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.179Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.194Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.197Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Close
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.218Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.242Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Close
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.271Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Create
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.303Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Create
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.357Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Create
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.379Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Create
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.426Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Create
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.487Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Create
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.559Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Create
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.559Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Create
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.589Z: Executing operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.611Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.637Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.661Z: Executing operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.752Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.787Z: Executing operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.822Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 22, 2022 8:15:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:07.852Z: Executing operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:09.070Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:09.137Z: Finished operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:09.191Z: Finished operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:09.234Z: Finished operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:09.775Z: Finished operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:09.827Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Close
May 22, 2022 8:15:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:09.908Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Close
May 22, 2022 8:15:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:09.959Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:10.617Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:10.748Z: Executing operation Count
All/View.AsIterable/CreateDataflowView
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:10.790Z: Finished operation Count
All/View.AsIterable/CreateDataflowView
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:10.844Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:10.929Z: Executing operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:10.962Z: Executing operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.040Z: Finished operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.178Z: Executing operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.239Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.249Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.387Z: Executing operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.450Z: Finished operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.620Z: Executing operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.724Z: Finished operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.804Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Close
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.872Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Close
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:11.940Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:12.263Z: Finished operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:12.366Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Close
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:12.433Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Close
May 22, 2022 8:15:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:12.519Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2022 8:15:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:13.348Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2022 8:15:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:13.511Z: Finished operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
May 22, 2022 8:15:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:13.577Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Close
May 22, 2022 8:15:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:13.621Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Close
May 22, 2022 8:15:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:13.698Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2022 8:15:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:13.797Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:14.983Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:15.119Z: Cleaning up.
May 22, 2022 8:15:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:15.199Z: Stopping **** pool...
May 22, 2022 8:15:50 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:50.175Z: Autoscaling: Resized **** pool from 5 to 0.
May 22, 2022 8:15:50 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-22T08:15:50.208Z: Worker pool stopped.
May 22, 2022 8:15:59 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-05-22_01_11_44-11273792356217459754 finished with status
DONE.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT
Load test results for test (ID): 4565c99b-8b39-490f-86ca-afbefa668b81 and
timestamp: 2022-05-22T08:15:59.277000000Z:
Metric: Value:
write_time 40.206
total_size 2.6087424E8
Load test results for test (ID): 4565c99b-8b39-490f-86ca-afbefa668b81 and
timestamp: 2022-05-22T08:15:59.277000000Z:
Metric: Value:
read_time 25.856
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:jdbc:integrationTest FAILED
3 tests completed, 2 failed
Finished generating test XML results (0.029 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.03 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:sdks:java:io:jdbc:integrationTest (Thread[Execution **** for ':' Thread
4,5,main]) completed. Took 7 mins 37.316 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:jdbc:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 1s
129 actionable tasks: 75 executed, 52 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/khadmdjbcypao
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
