See <https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/5895/display/redirect?page=changes>
Changes: [Steve Niemitz] [BEAM-13459] Update CHANGES.md, add note about artifact caching for [noreply] [BEAM-13015] Use 20% of memory when the maximum has been configured. ------------------------------------------ [...truncated 321.93 KB...] Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.509Z: Fusing consumer Combine.globally(Top(Natural))/ProduceDefault into Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource) Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.563Z: Unzipping flatten s42-u187 for input s44.org.apache.beam.sdk.values.PCollection.<init>:408#43d0369d0f0559b7-c185 Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.586Z: Fusing unzipped copy of PAssert$2/GroupGlobally/GroupByKey/Reify, through flatten PAssert$2/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer PAssert$2/GroupGlobally/WithKeys/AddKeys/Map Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.608Z: Fusing consumer PAssert$1/GroupGlobally/WithKeys/AddKeys/Map into PAssert$1/GroupGlobally/Create.Values/Read(CreateSource) Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.630Z: Fusing consumer PAssert$3/GroupGlobally/WithKeys/AddKeys/Map into PAssert$3/GroupGlobally/Create.Values/Read(CreateSource) Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.654Z: Fusing consumer PAssert$4/GroupGlobally/WithKeys/AddKeys/Map into PAssert$4/GroupGlobally/Create.Values/Read(CreateSource) Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.678Z: Fusing consumer PAssert$2/GroupGlobally/WithKeys/AddKeys/Map into PAssert$2/GroupGlobally/Create.Values/Read(CreateSource) Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.698Z: Fusing consumer PAssert$1/GroupGlobally/GroupByKey/Reify into PAssert$1/GroupGlobally/WithKeys/AddKeys/Map Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.719Z: Fusing consumer PAssert$3/GroupGlobally/GroupByKey/Reify into PAssert$3/GroupGlobally/WithKeys/AddKeys/Map Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.742Z: Fusing consumer PAssert$4/GroupGlobally/GroupByKey/Reify into PAssert$4/GroupGlobally/WithKeys/AddKeys/Map Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:53.767Z: Fusing consumer PAssert$2/GroupGlobally/GroupByKey/Reify into PAssert$2/GroupGlobally/WithKeys/AddKeys/Map Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:54.126Z: Executing operation JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 05, 2022 6:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:24:54.195Z: Starting 5 ****s in us-central1-c... Jan 05, 2022 6:25:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:25:14.543Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jan 05, 2022 6:25:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:25:42.606Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s). Jan 05, 2022 6:26:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:26:09.802Z: Workers have started successfully. Jan 05, 2022 6:26:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:26:09.830Z: Workers have started successfully. Jan 05, 2022 6:27:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:13.115Z: Finished operation JdbcIO.Read/Create.Values/Read(CreateSource)+JdbcIO.Read/JdbcIO.ReadAll/ParDo(Read)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Consume/ParDo(Anonymous)+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 05, 2022 6:27:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:13.304Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView Jan 05, 2022 6:27:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:13.368Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/View.AsIterable/CreateDataflowView Jan 05, 2022 6:27:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:13.502Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Jan 05, 2022 6:27:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:13.943Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Jan 05, 2022 6:27:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:14.082Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair with random key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Jan 05, 2022 6:27:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:43.881Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Identity+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Pair with random key+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Jan 05, 2022 6:27:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:43.940Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Jan 05, 2022 6:27:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.007Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.060Z: Executing operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.117Z: Executing operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Create Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.145Z: Executing operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.172Z: Executing operation Count All/Combine.perKey(Count)/GroupByKey/Create Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.225Z: Finished operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Create Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.275Z: Finished operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Create Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.295Z: Finished operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Create Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.331Z: Finished operation Count All/Combine.perKey(Count)/GroupByKey/Create Jan 05, 2022 6:27:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:27:44.474Z: Executing operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count All/Combine.perKey(Count)/GroupByKey+Count All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count All/Combine.perKey(Count)/GroupByKey/Reify+Hash row contents/WithKeys/AddKeys/Map+Hash row contents/Combine.perKey(Hashing)/GroupByKey+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count All/Combine.perKey(Count)/GroupByKey/Write+Hash row contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.750Z: Finished operation JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+JdbcIO.Read/JdbcIO.ReadAll/JdbcIO.Reparallelize/Reshuffle.ViaRandomKey/Values/Values/Map+ParDo(TimeMonitor)+Count All/WithKeys/AddKeys/Map+ParDo(SelectName)+Combine.globally(Top(Reversed))/WithKeys/AddKeys/Map+Combine.globally(Top(Natural))/WithKeys/AddKeys/Map+Count All/Combine.perKey(Count)/GroupByKey+Count All/Combine.perKey(Count)/Combine.GroupedValues/Partial+Count All/Combine.perKey(Count)/GroupByKey/Reify+Hash row contents/WithKeys/AddKeys/Map+Hash row contents/Combine.perKey(Hashing)/GroupByKey+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Hash row contents/Combine.perKey(Hashing)/GroupByKey/Reify+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Partial+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Reify+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Partial+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Reify+Count All/Combine.perKey(Count)/GroupByKey/Write+Hash row contents/Combine.perKey(Hashing)/GroupByKey/Write+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Write+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.804Z: Executing operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.835Z: Executing operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.861Z: Finished operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.863Z: Executing operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.889Z: Finished operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.897Z: Executing operation Count All/Combine.perKey(Count)/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.920Z: Finished operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.930Z: Executing operation PAssert$2/GroupGlobally/GroupByKey/Create Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.955Z: Executing operation PAssert$3/GroupGlobally/GroupByKey/Create Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.956Z: Finished operation Count All/Combine.perKey(Count)/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:15.978Z: Executing operation PAssert$4/GroupGlobally/GroupByKey/Create Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.007Z: Executing operation PAssert$1/GroupGlobally/GroupByKey/Create Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.080Z: Finished operation PAssert$2/GroupGlobally/GroupByKey/Create Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.095Z: Finished operation PAssert$3/GroupGlobally/GroupByKey/Create Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.132Z: Finished operation PAssert$4/GroupGlobally/GroupByKey/Create Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.153Z: Finished operation PAssert$1/GroupGlobally/GroupByKey/Create Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.211Z: Executing operation PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.253Z: Executing operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.361Z: Executing operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.382Z: Executing operation PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.415Z: Executing operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.417Z: Finished operation PAssert$2/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.440Z: Executing operation PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.483Z: Executing operation Count All/Combine.perKey(Count)/GroupByKey/Read+Count All/Combine.perKey(Count)/Combine.GroupedValues+Count All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.505Z: Executing operation PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.563Z: Finished operation PAssert$3/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.563Z: Finished operation Hash row contents/Combine.perKey(Hashing)/GroupByKey/Read+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues+Hash row contents/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Hash row contents/Values/Values/Map+PAssert$2/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$2/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$2/GroupGlobally/WithKeys/AddKeys/Map+PAssert$2/GroupGlobally/GroupByKey/Reify+PAssert$2/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.632Z: Executing operation PAssert$2/GroupGlobally/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.653Z: Finished operation PAssert$4/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.683Z: Finished operation PAssert$2/GroupGlobally/GroupByKey/Close Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.709Z: Finished operation PAssert$1/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:16.745Z: Executing operation PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude) Jan 05, 2022 6:28:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:17.119Z: Finished operation PAssert$2/GroupGlobally/GroupByKey/Read+PAssert$2/GroupGlobally/GroupByKey/GroupByWindow+PAssert$2/GroupGlobally/Values/Values/Map+PAssert$2/GroupGlobally/ParDo(Concat)+PAssert$2/GetPane/Map+PAssert$2/RunChecks+PAssert$2/VerifyAssertions/ParDo(DefaultConclude) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:17.666Z: Finished operation Count All/Combine.perKey(Count)/GroupByKey/Read+Count All/Combine.perKey(Count)/Combine.GroupedValues+Count All/Combine.perKey(Count)/Combine.GroupedValues/Extract+Count All/Values/Values/Map+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write+Count All/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:17.815Z: Executing operation Count All/View.AsIterable/CreateDataflowView Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:17.858Z: Finished operation Count All/View.AsIterable/CreateDataflowView Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:17.918Z: Finished operation Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/GroupByKey/Read+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues+Combine.globally(Top(Natural))/Combine.perKey(Top(Natural))/Combine.GroupedValues/Extract+Combine.globally(Top(Natural))/Values/Values/Map+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Natural))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.009Z: Executing operation Count All/CreateVoid/Read(CreateSource)+Count All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.032Z: Finished operation Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/GroupByKey/Read+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues+Combine.globally(Top(Reversed))/Combine.perKey(Top(Reversed))/Combine.GroupedValues/Extract+Combine.globally(Top(Reversed))/Values/Values/Map+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write+Combine.globally(Top(Reversed))/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.052Z: Executing operation Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.105Z: Finished operation Combine.globally(Top(Natural))/View.AsIterable/CreateDataflowView Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.163Z: Executing operation Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.210Z: Finished operation Combine.globally(Top(Reversed))/View.AsIterable/CreateDataflowView Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.338Z: Executing operation Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.446Z: Finished operation Count All/CreateVoid/Read(CreateSource)+Count All/ProduceDefault+PAssert$1/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$1/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$1/GroupGlobally/WithKeys/AddKeys/Map+PAssert$1/GroupGlobally/GroupByKey/Reify+PAssert$1/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.455Z: Executing operation Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.504Z: Executing operation PAssert$1/GroupGlobally/GroupByKey/Close Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.562Z: Finished operation PAssert$1/GroupGlobally/GroupByKey/Close Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.628Z: Executing operation PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.726Z: Finished operation Combine.globally(Top(Natural))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Natural))/ProduceDefault+PAssert$4/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$4/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$4/GroupGlobally/WithKeys/AddKeys/Map+PAssert$4/GroupGlobally/GroupByKey/Reify+PAssert$4/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.803Z: Executing operation PAssert$4/GroupGlobally/GroupByKey/Close Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.866Z: Finished operation PAssert$4/GroupGlobally/GroupByKey/Close Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.914Z: Finished operation Combine.globally(Top(Reversed))/CreateVoid/Read(CreateSource)+Combine.globally(Top(Reversed))/ProduceDefault+PAssert$3/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$3/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$3/GroupGlobally/WithKeys/AddKeys/Map+PAssert$3/GroupGlobally/GroupByKey/Reify+PAssert$3/GroupGlobally/GroupByKey/Write Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.947Z: Executing operation PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:18.990Z: Executing operation PAssert$3/GroupGlobally/GroupByKey/Close Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:19.024Z: Finished operation PAssert$1/GroupGlobally/GroupByKey/Read+PAssert$1/GroupGlobally/GroupByKey/GroupByWindow+PAssert$1/GroupGlobally/Values/Values/Map+PAssert$1/GroupGlobally/ParDo(Concat)+PAssert$1/GetPane/Map+PAssert$1/RunChecks+PAssert$1/VerifyAssertions/ParDo(DefaultConclude) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:19.048Z: Finished operation PAssert$3/GroupGlobally/GroupByKey/Close Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:19.124Z: Executing operation PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:19.356Z: Finished operation PAssert$4/GroupGlobally/GroupByKey/Read+PAssert$4/GroupGlobally/GroupByKey/GroupByWindow+PAssert$4/GroupGlobally/Values/Values/Map+PAssert$4/GroupGlobally/ParDo(Concat)+PAssert$4/GetPane/Map+PAssert$4/RunChecks+PAssert$4/VerifyAssertions/ParDo(DefaultConclude) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:19.451Z: Finished operation PAssert$3/GroupGlobally/GroupByKey/Read+PAssert$3/GroupGlobally/GroupByKey/GroupByWindow+PAssert$3/GroupGlobally/Values/Values/Map+PAssert$3/GroupGlobally/ParDo(Concat)+PAssert$3/GetPane/Map+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude) Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:19.620Z: Cleaning up. Jan 05, 2022 6:28:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:28:19.708Z: Stopping **** pool... Jan 05, 2022 6:30:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:30:46.061Z: Autoscaling: Resized **** pool from 5 to 0. Jan 05, 2022 6:30:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-05T06:30:46.099Z: Worker pool stopped. Jan 05, 2022 6:31:28 AM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-01-04_22_24_38-15966816788755593000 finished with status DONE. org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteThenRead STANDARD_OUT Load test results for test (ID): e7dee8f1-c432-46fd-b7cd-7b5e2f20ca4f and timestamp: 2022-01-05T06:31:28.948000000Z: Metric: Value: write_time 66.275 total_size 2.60816896E8 Load test results for test (ID): e7dee8f1-c432-46fd-b7cd-7b5e2f20ca4f and timestamp: 2022-01-05T06:31:28.948000000Z: Metric: Value: read_time 29.374 Gradle Test Executor 1 finished executing tests. > Task :sdks:java:io:jdbc:integrationTest FAILED 3 tests completed, 2 failed Finished generating test XML results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.031 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest> :sdks:java:io:jdbc:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 12 mins 53.731 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:jdbc:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 13m 23s 104 actionable tasks: 50 executed, 52 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/c2y7qjhwuokzg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org