See
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/7575/display/redirect>
Changes:
------------------------------------------
[...truncated 609.49 KB...]
Jun 01, 2023 2:41:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:41:51.257Z: Fusing consumer
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2023 2:41:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:41:51.293Z: Fusing consumer
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2023 2:41:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:41:51.324Z: Fusing consumer
PAssert$1/GroupGlobally/GroupByKey/Reify into
PAssert$1/GroupGlobally/WithKeys/AddKeys/Map
Jun 01, 2023 2:41:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:41:51.357Z: Fusing consumer
PAssert$3/GroupGlobally/GroupByKey/Reify into
PAssert$3/GroupGlobally/WithKeys/AddKeys/Map
Jun 01, 2023 2:41:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:41:51.380Z: Fusing consumer
PAssert$4/GroupGlobally/GroupByKey/Reify into
PAssert$4/GroupGlobally/WithKeys/AddKeys/Map
Jun 01, 2023 2:41:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:41:51.403Z: Fusing consumer
PAssert$2/GroupGlobally/GroupByKey/Reify into
PAssert$2/GroupGlobally/WithKeys/AddKeys/Map
Jun 01, 2023 2:41:54 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:41:51.825Z: Executing operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 01, 2023 2:41:54 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:41:51.893Z: Starting 5 ****s in us-central1-f...
Jun 01, 2023 2:42:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:42:34.719Z: Autoscaling: Raised the number of ****s to
3 based on the rate of progress in the currently running stage(s).
Jun 01, 2023 2:42:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:42:34.745Z: Autoscaling: Resized **** pool to 3, though
goal was 5. This could be a quota issue.
Jun 01, 2023 2:42:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:42:44.655Z: Autoscaling: Raised the number of ****s to
4 based on the rate of progress in the currently running stage(s).
Jun 01, 2023 2:42:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:42:44.712Z: Autoscaling: Resized **** pool to 4, though
goal was 5. This could be a quota issue.
Jun 01, 2023 2:43:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:43:04.629Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Jun 01, 2023 2:43:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:43:06.006Z: Workers have started successfully.
Jun 01, 2023 2:43:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:43:26.274Z: All ****s have finished the startup
processes and began to receive work requests.
Jun 01, 2023 2:44:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:02.683Z: Finished operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 01, 2023 2:44:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:02.853Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
Jun 01, 2023 2:44:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:02.902Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
Jun 01, 2023 2:44:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:03.027Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jun 01, 2023 2:44:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:03.296Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jun 01, 2023 2:44:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:03.417Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.648Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.706Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.754Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.826Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.849Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.884Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.917Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Create
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.965Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:30.985Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:31.016Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:31.047Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Create
Jun 01, 2023 2:44:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:31.182Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.475Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.555Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.588Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.613Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.622Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.646Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.649Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.671Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.683Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Create
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.699Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.716Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Create
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.752Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Create
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.778Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Create
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.828Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Create
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.841Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Create
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.885Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Create
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.904Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Create
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:44:59.994Z: Executing operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.030Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.094Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.128Z: Executing operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.162Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.200Z: Executing operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.236Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.244Z: Finished operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.259Z: Executing operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.386Z: Finished operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.412Z: Finished operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.482Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.503Z: Finished operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.545Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.599Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Close
Jun 01, 2023 2:45:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:00.664Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:01.090Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:01.653Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:01.781Z: Executing operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:01.826Z: Finished operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:01.841Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:01.951Z: Executing operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:01.987Z: Executing operation Count
All/View.AsIterable/CreateDataflowView
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.052Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.105Z: Finished operation Count
All/View.AsIterable/CreateDataflowView
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.212Z: Executing operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.245Z: Executing operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.270Z: Finished operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.394Z: Executing operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.555Z: Finished operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.618Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Close
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.677Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Close
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.728Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.817Z: Finished operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.841Z: Finished operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.881Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Close
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.915Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Close
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.938Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Close
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:02.960Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Close
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:03.002Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:03.033Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:03.116Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:03.339Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:03.399Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:03.537Z: Cleaning up.
Jun 01, 2023 2:45:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:45:03.615Z: Stopping **** pool...
Jun 01, 2023 2:47:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:47:17.620Z: Autoscaling: Resized **** pool from 5 to 0.
Jun 01, 2023 2:47:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-01T02:47:17.657Z: Worker pool stopped.
Jun 01, 2023 2:47:27 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2023-05-31_19_41_32-17781872860766180298 finished with status
DONE.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT
Load test results for test (ID): 31ff68c1-6eb7-48d3-81f8-3aa535b9f6fc and
timestamp: 2023-06-01T02:47:27.697000000Z:
Metric: Value:
write_time 41.102
total_size 2.60841472E8
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_ERROR
ERROR StatusLogger Log4j2 could not find a logging implementation. Please
add log4j-core to the classpath. Using SimpleLogger to log to the console...
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT
Load test results for test (ID): 31ff68c1-6eb7-48d3-81f8-3aa535b9f6fc and
timestamp: 2023-06-01T02:47:27.697000000Z:
Metric: Value:
read_time 27.562
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:jdbc:integrationTest FAILED
3 tests completed, 1 failed
Finished generating test XML results (0.041 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.054 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:sdks:java:io:jdbc:integrationTest (Thread[included builds,5,main]) completed.
Took 38 mins 53.252 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:jdbc:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 39m 27s
142 actionable tasks: 84 executed, 56 from cache, 2 up-to-date
Publishing build scan...
https://ge.apache.org/s/scdviymcoloyq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
