See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/231/display/redirect?page=changes>
Changes: [aydar.zaynutdinov] [BEAM-13737][Playground] [Robert Bradshaw] Make num-stages counter into an internal counter. [Kenneth Knowles] [BEAM-13768] Fix NullPointerException in BigQueryStorageSourceBase [Robert Bradshaw] Avoid packaging avro in the java harness jar. [mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare [noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing [noreply] [BEAM-13801] Add standard coder tests for state backed iterable. [noreply] [BEAM-13430] Fix provided configuration by removing extendsFrom for [noreply] [BEAM-12830] Print clearer go version fail message (#16693) [Jan Lukavský] Add reference to Books to Learning Resources in website [noreply] Use ThreadLocal for DESERIALIZATION_CONTEXT (#16680) [noreply] Minor: Add apt update after adding deadsnakes repository in dev env [noreply] [BEAM-13807] Regenerate container images to get TF 2.8.0 (#16707) [noreply] [BEAM-13399, BEAM-13683] Eagerly materialize artifacts for automated [noreply] Merge pull request #16617 from [BEAM-13743] [Playground] Add context [noreply] Merge pull request #16618 from [BEAM-13744] [Playground] Add context [noreply] Merge pull request #16698 from [BEAM-13802][Playground] [Bugfix] Clean [noreply] [BEAM-13293][BEAM-13806] Pipe a SchemaIO flag through Go integration [noreply] [BEAM-13605] Modify groupby.apply implementation in preparation for [noreply] Merge pull request #16436 from [BEAM-1330] - DatastoreIO Writes should ------------------------------------------ [...truncated 172.98 KB...] Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:08.896Z: Fusing consumer Step: 128/ParMultiDo(CounterOperation) into Step: 127/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:08.931Z: Fusing consumer Step: 129/ParMultiDo(CounterOperation) into Step: 128/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:08.966Z: Fusing consumer Step: 130/ParMultiDo(CounterOperation) into Step: 129/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:08.999Z: Fusing consumer Step: 131/ParMultiDo(CounterOperation) into Step: 130/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.034Z: Fusing consumer Step: 132/ParMultiDo(CounterOperation) into Step: 131/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.066Z: Fusing consumer Step: 133/ParMultiDo(CounterOperation) into Step: 132/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.089Z: Fusing consumer Step: 134/ParMultiDo(CounterOperation) into Step: 133/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.106Z: Fusing consumer Step: 135/ParMultiDo(CounterOperation) into Step: 134/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.129Z: Fusing consumer Step: 136/ParMultiDo(CounterOperation) into Step: 135/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.155Z: Fusing consumer Step: 137/ParMultiDo(CounterOperation) into Step: 136/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.190Z: Fusing consumer Step: 138/ParMultiDo(CounterOperation) into Step: 137/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.223Z: Fusing consumer Step: 139/ParMultiDo(CounterOperation) into Step: 138/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.257Z: Fusing consumer Step: 140/ParMultiDo(CounterOperation) into Step: 139/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.308Z: Fusing consumer Step: 141/ParMultiDo(CounterOperation) into Step: 140/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.337Z: Fusing consumer Step: 142/ParMultiDo(CounterOperation) into Step: 141/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.376Z: Fusing consumer Step: 143/ParMultiDo(CounterOperation) into Step: 142/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.407Z: Fusing consumer Step: 144/ParMultiDo(CounterOperation) into Step: 143/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.440Z: Fusing consumer Step: 145/ParMultiDo(CounterOperation) into Step: 144/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.471Z: Fusing consumer Step: 146/ParMultiDo(CounterOperation) into Step: 145/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.495Z: Fusing consumer Step: 147/ParMultiDo(CounterOperation) into Step: 146/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.529Z: Fusing consumer Step: 148/ParMultiDo(CounterOperation) into Step: 147/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.563Z: Fusing consumer Step: 149/ParMultiDo(CounterOperation) into Step: 148/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.596Z: Fusing consumer Step: 150/ParMultiDo(CounterOperation) into Step: 149/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.627Z: Fusing consumer Step: 151/ParMultiDo(CounterOperation) into Step: 150/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.662Z: Fusing consumer Step: 152/ParMultiDo(CounterOperation) into Step: 151/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.696Z: Fusing consumer Step: 153/ParMultiDo(CounterOperation) into Step: 152/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.729Z: Fusing consumer Step: 154/ParMultiDo(CounterOperation) into Step: 153/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.786Z: Fusing consumer Step: 155/ParMultiDo(CounterOperation) into Step: 154/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.812Z: Fusing consumer Step: 156/ParMultiDo(CounterOperation) into Step: 155/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.856Z: Fusing consumer Step: 157/ParMultiDo(CounterOperation) into Step: 156/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.900Z: Fusing consumer Step: 158/ParMultiDo(CounterOperation) into Step: 157/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.922Z: Fusing consumer Step: 159/ParMultiDo(CounterOperation) into Step: 158/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.944Z: Fusing consumer Step: 160/ParMultiDo(CounterOperation) into Step: 159/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.967Z: Fusing consumer Step: 161/ParMultiDo(CounterOperation) into Step: 160/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:09.989Z: Fusing consumer Step: 162/ParMultiDo(CounterOperation) into Step: 161/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.012Z: Fusing consumer Step: 163/ParMultiDo(CounterOperation) into Step: 162/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.032Z: Fusing consumer Step: 164/ParMultiDo(CounterOperation) into Step: 163/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.054Z: Fusing consumer Step: 165/ParMultiDo(CounterOperation) into Step: 164/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.086Z: Fusing consumer Step: 166/ParMultiDo(CounterOperation) into Step: 165/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.109Z: Fusing consumer Step: 167/ParMultiDo(CounterOperation) into Step: 166/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.132Z: Fusing consumer Step: 168/ParMultiDo(CounterOperation) into Step: 167/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.167Z: Fusing consumer Step: 169/ParMultiDo(CounterOperation) into Step: 168/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.199Z: Fusing consumer Step: 170/ParMultiDo(CounterOperation) into Step: 169/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.234Z: Fusing consumer Step: 171/ParMultiDo(CounterOperation) into Step: 170/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.306Z: Fusing consumer Step: 172/ParMultiDo(CounterOperation) into Step: 171/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.329Z: Fusing consumer Step: 173/ParMultiDo(CounterOperation) into Step: 172/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.353Z: Fusing consumer Step: 174/ParMultiDo(CounterOperation) into Step: 173/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.383Z: Fusing consumer Step: 175/ParMultiDo(CounterOperation) into Step: 174/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.410Z: Fusing consumer Step: 176/ParMultiDo(CounterOperation) into Step: 175/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.445Z: Fusing consumer Step: 177/ParMultiDo(CounterOperation) into Step: 176/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.477Z: Fusing consumer Step: 178/ParMultiDo(CounterOperation) into Step: 177/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.511Z: Fusing consumer Step: 179/ParMultiDo(CounterOperation) into Step: 178/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.543Z: Fusing consumer Step: 180/ParMultiDo(CounterOperation) into Step: 179/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.579Z: Fusing consumer Step: 181/ParMultiDo(CounterOperation) into Step: 180/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.612Z: Fusing consumer Step: 182/ParMultiDo(CounterOperation) into Step: 181/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.647Z: Fusing consumer Step: 183/ParMultiDo(CounterOperation) into Step: 182/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.681Z: Fusing consumer Step: 184/ParMultiDo(CounterOperation) into Step: 183/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.714Z: Fusing consumer Step: 185/ParMultiDo(CounterOperation) into Step: 184/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.750Z: Fusing consumer Step: 186/ParMultiDo(CounterOperation) into Step: 185/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.775Z: Fusing consumer Step: 187/ParMultiDo(CounterOperation) into Step: 186/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.799Z: Fusing consumer Step: 188/ParMultiDo(CounterOperation) into Step: 187/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.830Z: Fusing consumer Step: 189/ParMultiDo(CounterOperation) into Step: 188/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.865Z: Fusing consumer Step: 190/ParMultiDo(CounterOperation) into Step: 189/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.914Z: Fusing consumer Step: 191/ParMultiDo(CounterOperation) into Step: 190/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.947Z: Fusing consumer Step: 192/ParMultiDo(CounterOperation) into Step: 191/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:10.983Z: Fusing consumer Step: 193/ParMultiDo(CounterOperation) into Step: 192/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.009Z: Fusing consumer Step: 194/ParMultiDo(CounterOperation) into Step: 193/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.040Z: Fusing consumer Step: 195/ParMultiDo(CounterOperation) into Step: 194/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.074Z: Fusing consumer Step: 196/ParMultiDo(CounterOperation) into Step: 195/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.107Z: Fusing consumer Step: 197/ParMultiDo(CounterOperation) into Step: 196/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.131Z: Fusing consumer Step: 198/ParMultiDo(CounterOperation) into Step: 197/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.166Z: Fusing consumer Step: 199/ParMultiDo(CounterOperation) into Step: 198/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.189Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 199/ParMultiDo(CounterOperation) Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.553Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 03, 2022 3:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:11.625Z: Starting 5 ****s in us-central1-c... Feb 03, 2022 3:39:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:39:22.136Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 03, 2022 3:40:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:40:01.688Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s). Feb 03, 2022 3:40:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:40:54.873Z: Workers have started successfully. Feb 03, 2022 3:40:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:40:54.982Z: Workers have started successfully. Feb 03, 2022 3:41:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:41:14.276Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 03, 2022 3:41:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:41:14.525Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+Step: 10/ParMultiDo(CounterOperation)+Step: 11/ParMultiDo(CounterOperation)+Step: 12/ParMultiDo(CounterOperation)+Step: 13/ParMultiDo(CounterOperation)+Step: 14/ParMultiDo(CounterOperation)+Step: 15/ParMultiDo(CounterOperation)+Step: 16/ParMultiDo(CounterOperation)+Step: 17/ParMultiDo(CounterOperation)+Step: 18/ParMultiDo(CounterOperation)+Step: 19/ParMultiDo(CounterOperation)+Step: 20/ParMultiDo(CounterOperation)+Step: 21/ParMultiDo(CounterOperation)+Step: 22/ParMultiDo(CounterOperation)+Step: 23/ParMultiDo(CounterOperation)+Step: 24/ParMultiDo(CounterOperation)+Step: 25/ParMultiDo(CounterOperation)+Step: 26/ParMultiDo(CounterOperation)+Step: 27/ParMultiDo(CounterOperation)+Step: 28/ParMultiDo(CounterOperation)+Step: 29/ParMultiDo(CounterOperation)+Step: 30/ParMultiDo(CounterOperation)+Step: 31/ParMultiDo(CounterOperation)+Step: 32/ParMultiDo(CounterOperation)+Step: 33/ParMultiDo(CounterOperation)+Step: 34/ParMultiDo(CounterOperation)+Step: 35/ParMultiDo(CounterOperation)+Step: 36/ParMultiDo(CounterOperation)+Step: 37/ParMultiDo(CounterOperation)+Step: 38/ParMultiDo(CounterOperation)+Step: 39/ParMultiDo(CounterOperation)+Step: 40/ParMultiDo(CounterOperation)+Step: 41/ParMultiDo(CounterOperation)+Step: 42/ParMultiDo(CounterOperation)+Step: 43/ParMultiDo(CounterOperation)+Step: 44/ParMultiDo(CounterOperation)+Step: 45/ParMultiDo(CounterOperation)+Step: 46/ParMultiDo(CounterOperation)+Step: 47/ParMultiDo(CounterOperation)+Step: 48/ParMultiDo(CounterOperation)+Step: 49/ParMultiDo(CounterOperation)+Step: 50/ParMultiDo(CounterOperation)+Step: 51/ParMultiDo(CounterOperation)+Step: 52/ParMultiDo(CounterOperation)+Step: 53/ParMultiDo(CounterOperation)+Step: 54/ParMultiDo(CounterOperation)+Step: 55/ParMultiDo(CounterOperation)+Step: 56/ParMultiDo(CounterOperation)+Step: 57/ParMultiDo(CounterOperation)+Step: 58/ParMultiDo(CounterOperation)+Step: 59/ParMultiDo(CounterOperation)+Step: 60/ParMultiDo(CounterOperation)+Step: 61/ParMultiDo(CounterOperation)+Step: 62/ParMultiDo(CounterOperation)+Step: 63/ParMultiDo(CounterOperation)+Step: 64/ParMultiDo(CounterOperation)+Step: 65/ParMultiDo(CounterOperation)+Step: 66/ParMultiDo(CounterOperation)+Step: 67/ParMultiDo(CounterOperation)+Step: 68/ParMultiDo(CounterOperation)+Step: 69/ParMultiDo(CounterOperation)+Step: 70/ParMultiDo(CounterOperation)+Step: 71/ParMultiDo(CounterOperation)+Step: 72/ParMultiDo(CounterOperation)+Step: 73/ParMultiDo(CounterOperation)+Step: 74/ParMultiDo(CounterOperation)+Step: 75/ParMultiDo(CounterOperation)+Step: 76/ParMultiDo(CounterOperation)+Step: 77/ParMultiDo(CounterOperation)+Step: 78/ParMultiDo(CounterOperation)+Step: 79/ParMultiDo(CounterOperation)+Step: 80/ParMultiDo(CounterOperation)+Step: 81/ParMultiDo(CounterOperation)+Step: 82/ParMultiDo(CounterOperation)+Step: 83/ParMultiDo(CounterOperation)+Step: 84/ParMultiDo(CounterOperation)+Step: 85/ParMultiDo(CounterOperation)+Step: 86/ParMultiDo(CounterOperation)+Step: 87/ParMultiDo(CounterOperation)+Step: 88/ParMultiDo(CounterOperation)+Step: 89/ParMultiDo(CounterOperation)+Step: 90/ParMultiDo(CounterOperation)+Step: 91/ParMultiDo(CounterOperation)+Step: 92/ParMultiDo(CounterOperation)+Step: 93/ParMultiDo(CounterOperation)+Step: 94/ParMultiDo(CounterOperation)+Step: 95/ParMultiDo(CounterOperation)+Step: 96/ParMultiDo(CounterOperation)+Step: 97/ParMultiDo(CounterOperation)+Step: 98/ParMultiDo(CounterOperation)+Step: 99/ParMultiDo(CounterOperation)+Step: 100/ParMultiDo(CounterOperation)+Step: 101/ParMultiDo(CounterOperation)+Step: 102/ParMultiDo(CounterOperation)+Step: 103/ParMultiDo(CounterOperation)+Step: 104/ParMultiDo(CounterOperation)+Step: 105/ParMultiDo(CounterOperation)+Step: 106/ParMultiDo(CounterOperation)+Step: 107/ParMultiDo(CounterOperation)+Step: 108/ParMultiDo(CounterOperation)+Step: 109/ParMultiDo(CounterOperation)+Step: 110/ParMultiDo(CounterOperation)+Step: 111/ParMultiDo(CounterOperation)+Step: 112/ParMultiDo(CounterOperation)+Step: 113/ParMultiDo(CounterOperation)+Step: 114/ParMultiDo(CounterOperation)+Step: 115/ParMultiDo(CounterOperation)+Step: 116/ParMultiDo(CounterOperation)+Step: 117/ParMultiDo(CounterOperation)+Step: 118/ParMultiDo(CounterOperation)+Step: 119/ParMultiDo(CounterOperation)+Step: 120/ParMultiDo(CounterOperation)+Step: 121/ParMultiDo(CounterOperation)+Step: 122/ParMultiDo(CounterOperation)+Step: 123/ParMultiDo(CounterOperation)+Step: 124/ParMultiDo(CounterOperation)+Step: 125/ParMultiDo(CounterOperation)+Step: 126/ParMultiDo(CounterOperation)+Step: 127/ParMultiDo(CounterOperation)+Step: 128/ParMultiDo(CounterOperation)+Step: 129/ParMultiDo(CounterOperation)+Step: 130/ParMultiDo(CounterOperation)+Step: 131/ParMultiDo(CounterOperation)+Step: 132/ParMultiDo(CounterOperation)+Step: 133/ParMultiDo(CounterOperation)+Step: 134/ParMultiDo(CounterOperation)+Step: 135/ParMultiDo(CounterOperation)+Step: 136/ParMultiDo(CounterOperation)+Step: 137/ParMultiDo(CounterOperation)+Step: 138/ParMultiDo(CounterOperation)+Step: 139/ParMultiDo(CounterOperation)+Step: 140/ParMultiDo(CounterOperation)+Step: 141/ParMultiDo(CounterOperation)+Step: 142/ParMultiDo(CounterOperation)+Step: 143/ParMultiDo(CounterOperation)+Step: 144/ParMultiDo(CounterOperation)+Step: 145/ParMultiDo(CounterOperation)+Step: 146/ParMultiDo(CounterOperation)+Step: 147/ParMultiDo(CounterOperation)+Step: 148/ParMultiDo(CounterOperation)+Step: 149/ParMultiDo(CounterOperation)+Step: 150/ParMultiDo(CounterOperation)+Step: 151/ParMultiDo(CounterOperation)+Step: 152/ParMultiDo(CounterOperation)+Step: 153/ParMultiDo(CounterOperation)+Step: 154/ParMultiDo(CounterOperation)+Step: 155/ParMultiDo(CounterOperation)+Step: 156/ParMultiDo(CounterOperation)+Step: 157/ParMultiDo(CounterOperation)+Step: 158/ParMultiDo(CounterOperation)+Step: 159/ParMultiDo(CounterOperation)+Step: 160/ParMultiDo(CounterOperation)+Step: 161/ParMultiDo(CounterOperation)+Step: 162/ParMultiDo(CounterOperation)+Step: 163/ParMultiDo(CounterOperation)+Step: 164/ParMultiDo(CounterOperation)+Step: 165/ParMultiDo(CounterOperation)+Step: 166/ParMultiDo(CounterOperation)+Step: 167/ParMultiDo(CounterOperation)+Step: 168/ParMultiDo(CounterOperation)+Step: 169/ParMultiDo(CounterOperation)+Step: 170/ParMultiDo(CounterOperation)+Step: 171/ParMultiDo(CounterOperation)+Step: 172/ParMultiDo(CounterOperation)+Step: 173/ParMultiDo(CounterOperation)+Step: 174/ParMultiDo(CounterOperation)+Step: 175/ParMultiDo(CounterOperation)+Step: 176/ParMultiDo(CounterOperation)+Step: 177/ParMultiDo(CounterOperation)+Step: 178/ParMultiDo(CounterOperation)+Step: 179/ParMultiDo(CounterOperation)+Step: 180/ParMultiDo(CounterOperation)+Step: 181/ParMultiDo(CounterOperation)+Step: 182/ParMultiDo(CounterOperation)+Step: 183/ParMultiDo(CounterOperation)+Step: 184/ParMultiDo(CounterOperation)+Step: 185/ParMultiDo(CounterOperation)+Step: 186/ParMultiDo(CounterOperation)+Step: 187/ParMultiDo(CounterOperation)+Step: 188/ParMultiDo(CounterOperation)+Step: 189/ParMultiDo(CounterOperation)+Step: 190/ParMultiDo(CounterOperation)+Step: 191/ParMultiDo(CounterOperation)+Step: 192/ParMultiDo(CounterOperation)+Step: 193/ParMultiDo(CounterOperation)+Step: 194/ParMultiDo(CounterOperation)+Step: 195/ParMultiDo(CounterOperation)+Step: 196/ParMultiDo(CounterOperation)+Step: 197/ParMultiDo(CounterOperation)+Step: 198/ParMultiDo(CounterOperation)+Step: 199/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) Feb 03, 2022 3:42:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:42:26.701Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+Step: 10/ParMultiDo(CounterOperation)+Step: 11/ParMultiDo(CounterOperation)+Step: 12/ParMultiDo(CounterOperation)+Step: 13/ParMultiDo(CounterOperation)+Step: 14/ParMultiDo(CounterOperation)+Step: 15/ParMultiDo(CounterOperation)+Step: 16/ParMultiDo(CounterOperation)+Step: 17/ParMultiDo(CounterOperation)+Step: 18/ParMultiDo(CounterOperation)+Step: 19/ParMultiDo(CounterOperation)+Step: 20/ParMultiDo(CounterOperation)+Step: 21/ParMultiDo(CounterOperation)+Step: 22/ParMultiDo(CounterOperation)+Step: 23/ParMultiDo(CounterOperation)+Step: 24/ParMultiDo(CounterOperation)+Step: 25/ParMultiDo(CounterOperation)+Step: 26/ParMultiDo(CounterOperation)+Step: 27/ParMultiDo(CounterOperation)+Step: 28/ParMultiDo(CounterOperation)+Step: 29/ParMultiDo(CounterOperation)+Step: 30/ParMultiDo(CounterOperation)+Step: 31/ParMultiDo(CounterOperation)+Step: 32/ParMultiDo(CounterOperation)+Step: 33/ParMultiDo(CounterOperation)+Step: 34/ParMultiDo(CounterOperation)+Step: 35/ParMultiDo(CounterOperation)+Step: 36/ParMultiDo(CounterOperation)+Step: 37/ParMultiDo(CounterOperation)+Step: 38/ParMultiDo(CounterOperation)+Step: 39/ParMultiDo(CounterOperation)+Step: 40/ParMultiDo(CounterOperation)+Step: 41/ParMultiDo(CounterOperation)+Step: 42/ParMultiDo(CounterOperation)+Step: 43/ParMultiDo(CounterOperation)+Step: 44/ParMultiDo(CounterOperation)+Step: 45/ParMultiDo(CounterOperation)+Step: 46/ParMultiDo(CounterOperation)+Step: 47/ParMultiDo(CounterOperation)+Step: 48/ParMultiDo(CounterOperation)+Step: 49/ParMultiDo(CounterOperation)+Step: 50/ParMultiDo(CounterOperation)+Step: 51/ParMultiDo(CounterOperation)+Step: 52/ParMultiDo(CounterOperation)+Step: 53/ParMultiDo(CounterOperation)+Step: 54/ParMultiDo(CounterOperation)+Step: 55/ParMultiDo(CounterOperation)+Step: 56/ParMultiDo(CounterOperation)+Step: 57/ParMultiDo(CounterOperation)+Step: 58/ParMultiDo(CounterOperation)+Step: 59/ParMultiDo(CounterOperation)+Step: 60/ParMultiDo(CounterOperation)+Step: 61/ParMultiDo(CounterOperation)+Step: 62/ParMultiDo(CounterOperation)+Step: 63/ParMultiDo(CounterOperation)+Step: 64/ParMultiDo(CounterOperation)+Step: 65/ParMultiDo(CounterOperation)+Step: 66/ParMultiDo(CounterOperation)+Step: 67/ParMultiDo(CounterOperation)+Step: 68/ParMultiDo(CounterOperation)+Step: 69/ParMultiDo(CounterOperation)+Step: 70/ParMultiDo(CounterOperation)+Step: 71/ParMultiDo(CounterOperation)+Step: 72/ParMultiDo(CounterOperation)+Step: 73/ParMultiDo(CounterOperation)+Step: 74/ParMultiDo(CounterOperation)+Step: 75/ParMultiDo(CounterOperation)+Step: 76/ParMultiDo(CounterOperation)+Step: 77/ParMultiDo(CounterOperation)+Step: 78/ParMultiDo(CounterOperation)+Step: 79/ParMultiDo(CounterOperation)+Step: 80/ParMultiDo(CounterOperation)+Step: 81/ParMultiDo(CounterOperation)+Step: 82/ParMultiDo(CounterOperation)+Step: 83/ParMultiDo(CounterOperation)+Step: 84/ParMultiDo(CounterOperation)+Step: 85/ParMultiDo(CounterOperation)+Step: 86/ParMultiDo(CounterOperation)+Step: 87/ParMultiDo(CounterOperation)+Step: 88/ParMultiDo(CounterOperation)+Step: 89/ParMultiDo(CounterOperation)+Step: 90/ParMultiDo(CounterOperation)+Step: 91/ParMultiDo(CounterOperation)+Step: 92/ParMultiDo(CounterOperation)+Step: 93/ParMultiDo(CounterOperation)+Step: 94/ParMultiDo(CounterOperation)+Step: 95/ParMultiDo(CounterOperation)+Step: 96/ParMultiDo(CounterOperation)+Step: 97/ParMultiDo(CounterOperation)+Step: 98/ParMultiDo(CounterOperation)+Step: 99/ParMultiDo(CounterOperation)+Step: 100/ParMultiDo(CounterOperation)+Step: 101/ParMultiDo(CounterOperation)+Step: 102/ParMultiDo(CounterOperation)+Step: 103/ParMultiDo(CounterOperation)+Step: 104/ParMultiDo(CounterOperation)+Step: 105/ParMultiDo(CounterOperation)+Step: 106/ParMultiDo(CounterOperation)+Step: 107/ParMultiDo(CounterOperation)+Step: 108/ParMultiDo(CounterOperation)+Step: 109/ParMultiDo(CounterOperation)+Step: 110/ParMultiDo(CounterOperation)+Step: 111/ParMultiDo(CounterOperation)+Step: 112/ParMultiDo(CounterOperation)+Step: 113/ParMultiDo(CounterOperation)+Step: 114/ParMultiDo(CounterOperation)+Step: 115/ParMultiDo(CounterOperation)+Step: 116/ParMultiDo(CounterOperation)+Step: 117/ParMultiDo(CounterOperation)+Step: 118/ParMultiDo(CounterOperation)+Step: 119/ParMultiDo(CounterOperation)+Step: 120/ParMultiDo(CounterOperation)+Step: 121/ParMultiDo(CounterOperation)+Step: 122/ParMultiDo(CounterOperation)+Step: 123/ParMultiDo(CounterOperation)+Step: 124/ParMultiDo(CounterOperation)+Step: 125/ParMultiDo(CounterOperation)+Step: 126/ParMultiDo(CounterOperation)+Step: 127/ParMultiDo(CounterOperation)+Step: 128/ParMultiDo(CounterOperation)+Step: 129/ParMultiDo(CounterOperation)+Step: 130/ParMultiDo(CounterOperation)+Step: 131/ParMultiDo(CounterOperation)+Step: 132/ParMultiDo(CounterOperation)+Step: 133/ParMultiDo(CounterOperation)+Step: 134/ParMultiDo(CounterOperation)+Step: 135/ParMultiDo(CounterOperation)+Step: 136/ParMultiDo(CounterOperation)+Step: 137/ParMultiDo(CounterOperation)+Step: 138/ParMultiDo(CounterOperation)+Step: 139/ParMultiDo(CounterOperation)+Step: 140/ParMultiDo(CounterOperation)+Step: 141/ParMultiDo(CounterOperation)+Step: 142/ParMultiDo(CounterOperation)+Step: 143/ParMultiDo(CounterOperation)+Step: 144/ParMultiDo(CounterOperation)+Step: 145/ParMultiDo(CounterOperation)+Step: 146/ParMultiDo(CounterOperation)+Step: 147/ParMultiDo(CounterOperation)+Step: 148/ParMultiDo(CounterOperation)+Step: 149/ParMultiDo(CounterOperation)+Step: 150/ParMultiDo(CounterOperation)+Step: 151/ParMultiDo(CounterOperation)+Step: 152/ParMultiDo(CounterOperation)+Step: 153/ParMultiDo(CounterOperation)+Step: 154/ParMultiDo(CounterOperation)+Step: 155/ParMultiDo(CounterOperation)+Step: 156/ParMultiDo(CounterOperation)+Step: 157/ParMultiDo(CounterOperation)+Step: 158/ParMultiDo(CounterOperation)+Step: 159/ParMultiDo(CounterOperation)+Step: 160/ParMultiDo(CounterOperation)+Step: 161/ParMultiDo(CounterOperation)+Step: 162/ParMultiDo(CounterOperation)+Step: 163/ParMultiDo(CounterOperation)+Step: 164/ParMultiDo(CounterOperation)+Step: 165/ParMultiDo(CounterOperation)+Step: 166/ParMultiDo(CounterOperation)+Step: 167/ParMultiDo(CounterOperation)+Step: 168/ParMultiDo(CounterOperation)+Step: 169/ParMultiDo(CounterOperation)+Step: 170/ParMultiDo(CounterOperation)+Step: 171/ParMultiDo(CounterOperation)+Step: 172/ParMultiDo(CounterOperation)+Step: 173/ParMultiDo(CounterOperation)+Step: 174/ParMultiDo(CounterOperation)+Step: 175/ParMultiDo(CounterOperation)+Step: 176/ParMultiDo(CounterOperation)+Step: 177/ParMultiDo(CounterOperation)+Step: 178/ParMultiDo(CounterOperation)+Step: 179/ParMultiDo(CounterOperation)+Step: 180/ParMultiDo(CounterOperation)+Step: 181/ParMultiDo(CounterOperation)+Step: 182/ParMultiDo(CounterOperation)+Step: 183/ParMultiDo(CounterOperation)+Step: 184/ParMultiDo(CounterOperation)+Step: 185/ParMultiDo(CounterOperation)+Step: 186/ParMultiDo(CounterOperation)+Step: 187/ParMultiDo(CounterOperation)+Step: 188/ParMultiDo(CounterOperation)+Step: 189/ParMultiDo(CounterOperation)+Step: 190/ParMultiDo(CounterOperation)+Step: 191/ParMultiDo(CounterOperation)+Step: 192/ParMultiDo(CounterOperation)+Step: 193/ParMultiDo(CounterOperation)+Step: 194/ParMultiDo(CounterOperation)+Step: 195/ParMultiDo(CounterOperation)+Step: 196/ParMultiDo(CounterOperation)+Step: 197/ParMultiDo(CounterOperation)+Step: 198/ParMultiDo(CounterOperation)+Step: 199/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) Feb 03, 2022 3:42:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:42:26.866Z: Cleaning up. Feb 03, 2022 3:42:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:42:26.939Z: Stopping **** pool... Feb 03, 2022 3:44:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:44:48.183Z: Autoscaling: Resized **** pool from 5 to 0. Feb 03, 2022 3:44:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-03T15:44:48.271Z: Worker pool stopped. Feb 03, 2022 3:44:56 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-02-03_07_38_53-10485729638757858350 finished with status DONE. Load test results for test (ID): f259d0d7-9d9b-445e-ab5a-306f615f46f8 and timestamp: 2022-02-03T15:38:47.070000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 67.382 dataflow_v2_java11_total_bytes_count 2.0E9 Feb 03, 2022 3:44:57 PM org.apache.beam.sdk.testutils.publishing.InfluxDBPublisher publishWithCheck WARNING: Unable to publish metrics due to error: Response code: 500. Reason: "open /var/lib/influxdb/meta/meta.dbtmp: no space left on device" > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220203153814 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b922a6c69f02e59bd1c615820e737638bb37800695d76d23abdf3d07918a04e2 Deleted: sha256:a4f907481009a0e29ba7f5c0a6bb591ffad4b3a21dcfc5a36c393c555b0f3ae7 Deleted: sha256:48968dfaeb10e8c6915d56fa71f90d07a2521dfd4782ddae061e5e48da641581 Deleted: sha256:c33d242eba62af40b3c25097a2b97cdfbaf25c2e03fba4bd436ecd450f6736f8 Deleted: sha256:0d3c3313460f921ed5266ddd403b0b423ae0a295aa23b5058152ed3440b0c2ae Deleted: sha256:a682adb0228dbbaa05c6276fa617278f47bec902ea1cb9083967fdae893afb2d Deleted: sha256:63abca3f8b545d700a61d32240a8e069e49692cef881a584940fb1b48c68a288 Deleted: sha256:0a7b1f63eea1ef7cf83416a091208d8e47de56009ef35d8ff18f1a7769633364 Deleted: sha256:513c0ffd94c1a0a4856be1743e9a93a55008445e130ff4db6fbe21c469a37bdb Deleted: sha256:1bc3aee3ad6a0dc48b21a5f2a1aa56f19bcf51f4017f8ac3d5de5d2aa77c95e4 Deleted: sha256:a0becdbe94173de121b5e54044f8f74002b59f6374a6e2a1e7d7f021c086f92d Deleted: sha256:6603fc8b981a9ddb9dd050de22f40e3531f89e79497ed11e38d014659e31a4d7 Deleted: sha256:19230d1d675e4a352e2201bca7bf1067397875d927ea9deb9f84217409b90392 Deleted: sha256:b1d5fdb7ab4c607c99ec174684b591c4ae066de33bc3984e357505cf404c53d7 Deleted: sha256:a01759da07d48d540cae656d2793d82ca71aa33913a90b8d2a82505bf19e56f6 Deleted: sha256:3779d4adbf9793914db1b28454b44e5b6cc269fccfb4ea0a2a57947485126dbf Deleted: sha256:c61a8c0f671d0205b642831622049600570bf719b38871ee375fd0ed191e22f1 Deleted: sha256:2279e7caba8fcfcb3d21f9ffa671f66476ca4f30ada713e5a41fd0b54ac531c7 Deleted: sha256:bdb6f4d78aeb84c18c8701dad0d3dffcc85f958332801efec995f33f05a6a698 Deleted: sha256:9729ed1d5ee84c25148e5af7888502e2f1fe1e8b63594af0f68e5272c25e159e Deleted: sha256:0eff1a80a92e6ad70e78cdc09b9e0a1b4945eae93af0df38542eaa003ebdb2a4 Deleted: sha256:90b81e83d9e92be196ecc932dfdae375383e0f41e93032fb14b6c439972995db Deleted: sha256:54a073e1c7b564cd891524cf119f16fdf18fefd496f9220e11915b88fd33c487 Deleted: sha256:15d6e62004857d7c1cae669bb4968b862481e988e7fa981ddb466285aef79dbf Deleted: sha256:1d3ad41de73ed38d860699648c459c203b49c96a47225abe82c942f1e498a3a5 Deleted: sha256:e805e43c5da9cb415b42ae92ac549183f41dae3ca0352b68a94180073c52e281 Deleted: sha256:177d210ed6f402d1b5aa0d32a64adccea4e1529556efdbc5fa5fcaf77009d73b Deleted: sha256:d6fdae0dbe8ab100f9697505011ef9024d97456e32f22bfb5eb7ad774a4470c9 Deleted: sha256:87caf1067d911070b18d5a30c3296c438c96115b6e5d1596acfa73ce104665c1 Deleted: sha256:9e535bd40ba143e4ff34af068eda0a70f321640f01d5c84f809c07ca18a87b56 Deleted: sha256:124344e3e7a82b3b346d7d9ac64644c985f73aa3e04e01766f9a9f96023f8116 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220203153814] FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 294 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 6m 46s 104 actionable tasks: 8 executed, 96 up-to-date Publishing build scan... https://gradle.com/s/ojjw3vxvkqaes Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
