See <https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/5892/display/redirect>
Changes: ------------------------------------------ [...truncated 317.67 KB...] Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:52.840Z: Fusing consumer Combine.globally(Top(Natural))/ProduceDefault into Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource) Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:52.871Z: Unzipping flatten s42-u187 for input s44.org.apache.beam.sdk.values.PCollection.<init>:408#2fbcfb9f4f3a715-c185 Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:52.894Z: Fusing unzipped copy of PAssert$2/GroupGlobally/GroupByKey/Reify, through flatten PAssert$2/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer PAssert$2/GroupGlobally/WithKeys/AddKeys/Map Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:52.947Z: Fusing consumer PAssert$1/GroupGlobally/WithKeys/AddKeys/Map into PAssert$1/GroupGlobally/Create.Values/Read(CreateSource) Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:52.980Z: Fusing consumer PAssert$3/GroupGlobally/WithKeys/AddKeys/Map into PAssert$3/GroupGlobally/Create.Values/Read(CreateSource) Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:53.014Z: Fusing consumer PAssert$4/GroupGlobally/WithKeys/AddKeys/Map into PAssert$4/GroupGlobally/Create.Values/Read(CreateSource) Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:53.071Z: Fusing consumer PAssert$2/GroupGlobally/WithKeys/AddKeys/Map into PAssert$2/GroupGlobally/Create.Values/Read(CreateSource) Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:53.130Z: Fusing consumer PAssert$1/GroupGlobally/GroupByKey/Reify into PAssert$1/GroupGlobally/WithKeys/AddKeys/Map Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:53.162Z: Fusing consumer PAssert$3/GroupGlobally/GroupByKey/Reify into PAssert$3/GroupGlobally/WithKeys/AddKeys/Map Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:53.194Z: Fusing consumer PAssert$4/GroupGlobally/GroupByKey/Reify into PAssert$4/GroupGlobally/WithKeys/AddKeys/Map Jan 04, 2022 12:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:53.240Z: Fusing consumer PAssert$2/GroupGlobally/GroupByKey/Reify into PAssert$2/GroupGlobally/WithKeys/AddKeys/Map Jan 04, 2022 12:14:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:53.679Z: Executing operation JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 04, 2022 12:14:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:14:53.758Z: Starting 5 ****s in us-central1-c... Jan 04, 2022 12:15:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:15:04.035Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jan 04, 2022 12:15:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:15:46.423Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s). Jan 04, 2022 12:16:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:16:09.897Z: Workers have started successfully. Jan 04, 2022 12:16:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:16:09.921Z: Workers have started successfully. Jan 04, 2022 12:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:11.407Z: Finished operation JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 04, 2022 12:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:11.579Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView Jan 04, 2022 12:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:11.634Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView Jan 04, 2022 12:17:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:11.776Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Jan 04, 2022 12:17:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:12.308Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Jan 04, 2022 12:17:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:12.439Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair with random key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:39.808Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair with random key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:39.879Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:39.940Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:39.991Z: Executing operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:40.024Z: Executing operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Create Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:40.065Z: Executing operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:40.087Z: Executing operation Count All/Combine.perKey(Count)/GroupByKey/Create Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:40.169Z: Finished operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:40.194Z: Finished operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Create Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:40.251Z: Finished operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:40.317Z: Finished operation Count All/Combine.perKey(Count)/GroupByKey/Create Jan 04, 2022 12:17:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:17:40.482Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count All/Combine.perKey(Count)/GroupByKey+Count All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count All/Combine.perKey(Count)/GroupByKey/Reify+Hash row contents/WithKeys/AddKeys/Map+Hash row contents/Combine.perKey(Hashing)/GroupByKey+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count All/Combine.perKey(Count)/GroupByKey/Write+Hash row contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.169Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count All/Combine.perKey(Count)/GroupByKey+Count All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count All/Combine.perKey(Count)/GroupByKey/Reify+Hash row contents/WithKeys/AddKeys/Map+Hash row contents/Combine.perKey(Hashing)/GroupByKey+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count All/Combine.perKey(Count)/GroupByKey/Write+Hash row contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.260Z: Executing operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Close Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.294Z: Executing operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.342Z: Executing operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.391Z: Executing operation Count All/Combine.perKey(Count)/GroupByKey/Close Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.392Z: Finished operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.413Z: Finished operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.495Z: Executing operation PAssert$3/GroupGlobally/GroupByKey/Create Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.542Z: Finished operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Close Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.558Z: Executing operation PAssert$4/GroupGlobally/GroupByKey/Create Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.657Z: Executing operation PAssert$2/GroupGlobally/GroupByKey/Create Jan 04, 2022 12:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.726Z: Finished operation Count All/Combine.perKey(Count)/GroupByKey/Close Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.752Z: Finished operation PAssert$3/GroupGlobally/GroupByKey/Create Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.763Z: Finished operation PAssert$4/GroupGlobally/GroupByKey/Create Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.792Z: Executing operation PAssert$1/GroupGlobally/GroupByKey/Create Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.857Z: Finished operation PAssert$2/GroupGlobally/GroupByKey/Create Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.979Z: Finished operation PAssert$1/GroupGlobally/GroupByKey/Create Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:09.995Z: Executing operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.041Z: Executing operation PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.084Z: Executing operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.130Z: Executing operation PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.174Z: Executing operation PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.207Z: Executing operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.312Z: Finished operation PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.323Z: Executing operation Count All/Combine.perKey(Count)/GroupByKey/Read+Count All/Combine.perKey(Count)/Combine.GroupedValues+Count All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.357Z: Executing operation PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.367Z: Finished operation PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.602Z: Finished operation PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:10.602Z: Finished operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:11.449Z: Finished operation PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:11.529Z: Executing operation PAssert$2/GroupGlobally/GroupByKey/Close Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:11.613Z: Finished operation PAssert$2/GroupGlobally/GroupByKey/Close Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:11.624Z: Finished operation Count All/Combine.perKey(Count)/GroupByKey/Read+Count All/Combine.perKey(Count)/Combine.GroupedValues+Count All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:11.707Z: Executing operation PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude) Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:11.843Z: Finished operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:11.869Z: Executing operation Count All/View.AsIterable/CreateDataflowView Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:11.922Z: Finished operation Count All/View.AsIterable/CreateDataflowView Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.045Z: Finished operation PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude) Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.068Z: Executing operation Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.112Z: Executing operation Count All/CreateVoid/Read(CreateSource)+Count All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.121Z: Finished operation Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.348Z: Executing operation Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.622Z: Finished operation Count All/CreateVoid/Read(CreateSource)+Count All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.715Z: Executing operation PAssert$1/GroupGlobally/GroupByKey/Close Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.751Z: Finished operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.780Z: Finished operation PAssert$1/GroupGlobally/GroupByKey/Close Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.915Z: Finished operation Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.918Z: Executing operation PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude) Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:12.973Z: Executing operation Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.017Z: Executing operation PAssert$3/GroupGlobally/GroupByKey/Close Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.042Z: Finished operation Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.095Z: Finished operation PAssert$3/GroupGlobally/GroupByKey/Close Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.237Z: Executing operation PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude) Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.269Z: Executing operation Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.273Z: Finished operation PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude) Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.599Z: Finished operation PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude) Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.767Z: Finished operation Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.825Z: Executing operation PAssert$4/GroupGlobally/GroupByKey/Close Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.887Z: Finished operation PAssert$4/GroupGlobally/GroupByKey/Close Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:13.954Z: Executing operation PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude) Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:14.263Z: Finished operation PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude) Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:14.425Z: Cleaning up. Jan 04, 2022 12:18:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:18:14.499Z: Stopping **** pool... Jan 04, 2022 12:20:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:20:42.197Z: Autoscaling: Resized **** pool from 5 to 0. Jan 04, 2022 12:20:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-04T12:20:42.286Z: Worker pool stopped. Jan 04, 2022 12:21:22 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-01-04_04_14_29-4709435611431221443 finished with status DONE. org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT Load test results for test (ID): c0d90da7-7d35-41ee-b7fb-c04632914adb and timestamp: 2022-01-04T12:21:22.495000000Z: Metric: Value: total_size 2.60857856E8 write_time 45.951 Load test results for test (ID): c0d90da7-7d35-41ee-b7fb-c04632914adb and timestamp: 2022-01-04T12:21:22.495000000Z: Metric: Value: read_time 27.829 Gradle Test Executor 1 finished executing tests. > Task :sdks:java:io:jdbc:integrationTest FAILED 2 tests completed, 1 failed Finished generating test XML results (0.03 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.035 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest> :sdks:java:io:jdbc:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 12 mins 21.321 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:jdbc:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 12m 50s 104 actionable tasks: 50 executed, 52 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/dxiox5y6zfjbs Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org