See
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/5410/display/redirect>
Changes:
------------------------------------------
[...truncated 351.58 KB...]
Sep 06, 2021 12:21:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:21:13.451Z: Starting 5 ****s in us-central1-a...
Sep 06, 2021 12:21:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:21:27.318Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Sep 06, 2021 12:22:06 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:22:04.380Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Sep 06, 2021 12:22:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:22:34.505Z: Workers have started successfully.
Sep 06, 2021 12:22:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:22:34.532Z: Workers have started successfully.
Sep 06, 2021 12:23:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:23:34.152Z: Finished operation
JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Sep 06, 2021 12:23:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:23:34.303Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
Sep 06, 2021 12:23:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:23:34.355Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView
Sep 06, 2021 12:23:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:23:34.490Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Sep 06, 2021 12:23:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:23:34.910Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Sep 06, 2021 12:23:36 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:23:35.074Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.030Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair
with random
key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.094Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.155Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.217Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.257Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.295Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.329Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Create
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.376Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.415Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Create
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.424Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.459Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Create
Sep 06, 2021 12:24:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:03.666Z: Executing operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.672Z: Finished operation
JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count
All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count
All/Combine.perKey(Count)/GroupByKey+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count
All/Combine.perKey(Count)/GroupByKey/Reify+Hash row
contents/WithKeys/AddKeys/Map+Hash row
contents/Combine.perKey(Hashing)/GroupByKey+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count
All/Combine.perKey(Count)/GroupByKey/Write+Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.739Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.775Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.791Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Close
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.811Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.820Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.841Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Close
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.864Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.883Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Create
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.896Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Close
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.915Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Create
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.967Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Create
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:30.997Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Create
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.005Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Create
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.068Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Create
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.117Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Create
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.142Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Create
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.143Z: Executing operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.180Z: Executing operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.294Z: Executing operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.303Z: Finished operation
PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.329Z: Executing operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.362Z: Executing operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.389Z: Executing operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.417Z: Executing operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.450Z: Executing operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:31.498Z: Finished operation
PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:32.560Z: Finished operation Hash row
contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row
contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row
contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:32.587Z: Finished operation
PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:32.610Z: Finished operation
PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:32.635Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Close
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:32.696Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Close
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:32.763Z: Executing operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.027Z: Finished operation
Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.167Z: Executing operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.213Z: Finished operation
Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.269Z: Finished operation
Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.360Z: Executing operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.465Z: Executing operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.502Z: Finished operation
Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.638Z: Executing operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.801Z: Finished operation Count
All/Combine.perKey(Count)/GroupByKey/Read+Count
All/Combine.perKey(Count)/Combine.GroupedValues+Count
All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count
All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count
All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.856Z: Finished operation
Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.923Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Close
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.969Z: Executing operation Count
All/View.AsIterable/CreateDataflowView
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:33.994Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Close
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.008Z: Finished operation Count
All/View.AsIterable/CreateDataflowView
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.060Z: Executing operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.077Z: Finished operation
PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude)
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.152Z: Executing operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.386Z: Finished operation
PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude)
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.565Z: Finished operation Count
All/CreateVoid/Read(CreateSource)+Count
All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.634Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Close
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.686Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Close
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.752Z: Executing operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:34.936Z: Finished operation
PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude)
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:35.072Z: Finished operation
Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:35.143Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Close
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:35.201Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Close
Sep 06, 2021 12:24:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:35.257Z: Executing operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Sep 06, 2021 12:24:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:36.527Z: Finished operation
PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Sep 06, 2021 12:24:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:36.722Z: Cleaning up.
Sep 06, 2021 12:24:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:24:36.796Z: Stopping **** pool...
Sep 06, 2021 12:26:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:26:57.688Z: Autoscaling: Resized **** pool from 5 to 0.
Sep 06, 2021 12:26:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-06T00:26:57.727Z: Worker pool stopped.
Sep 06, 2021 12:27:42 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-09-05_17_20_54-5408869484429998752 finished with status DONE.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT
Load test results for test (ID): 89259fd4-967a-4dc6-9101-1f86da43fec6 and
timestamp: 2021-09-06T00:27:42.620000000Z:
Metric: Value:
write_time 49.268
Load test results for test (ID): 89259fd4-967a-4dc6-9101-1f86da43fec6 and
timestamp: 2021-09-06T00:27:42.620000000Z:
Metric: Value:
read_time 25.694
org.apache.beam.sdk.io.jdbc.JdbcIOIT STANDARD_ERROR
Sep 06, 2021 12:27:45 AM org.apache.beam.sdk.io.common.IOITHelper
executeWithRetry
WARNING: Attempt #1 of 3 failed: ERROR: table
"beamtest_it_2021_09_06_00_14_30_842" does not exist.
Sep 06, 2021 12:27:45 AM org.apache.beam.sdk.io.common.IOITHelper
executeWithRetry
WARNING: Retrying in 2000 ms.
Sep 06, 2021 12:27:47 AM org.apache.beam.sdk.io.common.IOITHelper
executeWithRetry
WARNING: Attempt #2 of 3 failed: ERROR: table
"beamtest_it_2021_09_06_00_14_30_842" does not exist.
Sep 06, 2021 12:27:47 AM org.apache.beam.sdk.io.common.IOITHelper
executeWithRetry
WARNING: Retrying in 4000 ms.
Sep 06, 2021 12:27:51 AM org.apache.beam.sdk.io.common.IOITHelper
executeWithRetry
WARNING: Attempt #3 of 3 failed: ERROR: table
"beamtest_it_2021_09_06_00_14_30_842" does not exist.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > classMethod FAILED
org.postgresql.util.PSQLException: ERROR: table
"beamtest_it_2021_09_06_00_14_30_842" does not exist
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)
at
org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:322)
at
org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:308)
at
org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:284)
at org.postgresql.jdbc.PgStatement.executeUpdate(PgStatement.java:258)
at
org.apache.beam.sdk.io.common.DatabaseTestHelper.deleteTable(DatabaseTestHelper.java:69)
at org.apache.beam.sdk.io.jdbc.JdbcIOIT.deleteTable(JdbcIOIT.java:129)
at
org.apache.beam.sdk.io.common.IOITHelper.executeWithRetry(IOITHelper.java:86)
at
org.apache.beam.sdk.io.common.IOITHelper.executeWithRetry(IOITHelper.java:66)
at org.apache.beam.sdk.io.jdbc.JdbcIOIT.tearDown(JdbcIOIT.java:125)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:jdbc:integrationTest FAILED
3 tests completed, 2 failed
Finished generating test XML results (0.208 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.107 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:sdks:java:io:jdbc:integrationTest (Thread[Execution **** for ':' Thread
7,5,main]) completed. Took 13 mins 41.803 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:jdbc:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 16m 37s
116 actionable tasks: 70 executed, 46 from cache
Publishing build scan...
https://gradle.com/s/7dmxiflkowb5e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
