See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/503/display/redirect?page=changes>
Changes: [Robert Bradshaw] Move logging to its own module. [Robert Bradshaw] Cleanup worker logging. [Robert Bradshaw] Add basic counter setting and getting to the typescript SDK. [Robert Bradshaw] Support metrics over the portability API. [Robert Bradshaw] Add distribution metric type. [Robert Bradshaw] old prettier change [noreply] Immediately truncate full restriction on drain of periodic impulse [noreply] [Task]: PR Bot will push commits only if they are non-empty (#23937) [noreply] Bump cloud.google.com/go/datastore from 1.8.0 to 1.9.0 in /sdks (#23916) [Robert Bradshaw] Remove obsolete TODO. [Robert Bradshaw] Only report counters that were actually used. [noreply] Add custom inference fn suport to the sklearn model handlers (#23642) [noreply] removed trailing whitespace (#23987) [noreply] Beam starter projects blog post (#23964) [noreply] Enable more portable-runner requiring tests. (#23970) [noreply] Website add and update logos (#23899) ------------------------------------------ [...truncated 177.80 KB...] Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:58.856Z: Fusing consumer Step: 116/ParMultiDo(CounterOperation) into Step: 115/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:58.888Z: Fusing consumer Step: 117/ParMultiDo(CounterOperation) into Step: 116/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:58.924Z: Fusing consumer Step: 118/ParMultiDo(CounterOperation) into Step: 117/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:58.958Z: Fusing consumer Step: 119/ParMultiDo(CounterOperation) into Step: 118/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:58.995Z: Fusing consumer Step: 120/ParMultiDo(CounterOperation) into Step: 119/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.027Z: Fusing consumer Step: 121/ParMultiDo(CounterOperation) into Step: 120/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.060Z: Fusing consumer Step: 122/ParMultiDo(CounterOperation) into Step: 121/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.093Z: Fusing consumer Step: 123/ParMultiDo(CounterOperation) into Step: 122/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.128Z: Fusing consumer Step: 124/ParMultiDo(CounterOperation) into Step: 123/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.152Z: Fusing consumer Step: 125/ParMultiDo(CounterOperation) into Step: 124/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.185Z: Fusing consumer Step: 126/ParMultiDo(CounterOperation) into Step: 125/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.218Z: Fusing consumer Step: 127/ParMultiDo(CounterOperation) into Step: 126/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.253Z: Fusing consumer Step: 128/ParMultiDo(CounterOperation) into Step: 127/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.286Z: Fusing consumer Step: 129/ParMultiDo(CounterOperation) into Step: 128/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.319Z: Fusing consumer Step: 130/ParMultiDo(CounterOperation) into Step: 129/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.351Z: Fusing consumer Step: 131/ParMultiDo(CounterOperation) into Step: 130/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.383Z: Fusing consumer Step: 132/ParMultiDo(CounterOperation) into Step: 131/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.413Z: Fusing consumer Step: 133/ParMultiDo(CounterOperation) into Step: 132/ParMultiDo(CounterOperation) Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.438Z: Fusing consumer Step: 134/ParMultiDo(CounterOperation) into Step: 133/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.474Z: Fusing consumer Step: 135/ParMultiDo(CounterOperation) into Step: 134/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.510Z: Fusing consumer Step: 136/ParMultiDo(CounterOperation) into Step: 135/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.543Z: Fusing consumer Step: 137/ParMultiDo(CounterOperation) into Step: 136/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.577Z: Fusing consumer Step: 138/ParMultiDo(CounterOperation) into Step: 137/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.610Z: Fusing consumer Step: 139/ParMultiDo(CounterOperation) into Step: 138/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.635Z: Fusing consumer Step: 140/ParMultiDo(CounterOperation) into Step: 139/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.667Z: Fusing consumer Step: 141/ParMultiDo(CounterOperation) into Step: 140/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.695Z: Fusing consumer Step: 142/ParMultiDo(CounterOperation) into Step: 141/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.721Z: Fusing consumer Step: 143/ParMultiDo(CounterOperation) into Step: 142/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.754Z: Fusing consumer Step: 144/ParMultiDo(CounterOperation) into Step: 143/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.790Z: Fusing consumer Step: 145/ParMultiDo(CounterOperation) into Step: 144/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.817Z: Fusing consumer Step: 146/ParMultiDo(CounterOperation) into Step: 145/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.842Z: Fusing consumer Step: 147/ParMultiDo(CounterOperation) into Step: 146/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.875Z: Fusing consumer Step: 148/ParMultiDo(CounterOperation) into Step: 147/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.900Z: Fusing consumer Step: 149/ParMultiDo(CounterOperation) into Step: 148/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.933Z: Fusing consumer Step: 150/ParMultiDo(CounterOperation) into Step: 149/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.967Z: Fusing consumer Step: 151/ParMultiDo(CounterOperation) into Step: 150/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:48:59.994Z: Fusing consumer Step: 152/ParMultiDo(CounterOperation) into Step: 151/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.024Z: Fusing consumer Step: 153/ParMultiDo(CounterOperation) into Step: 152/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.046Z: Fusing consumer Step: 154/ParMultiDo(CounterOperation) into Step: 153/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.077Z: Fusing consumer Step: 155/ParMultiDo(CounterOperation) into Step: 154/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.111Z: Fusing consumer Step: 156/ParMultiDo(CounterOperation) into Step: 155/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.133Z: Fusing consumer Step: 157/ParMultiDo(CounterOperation) into Step: 156/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.163Z: Fusing consumer Step: 158/ParMultiDo(CounterOperation) into Step: 157/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.197Z: Fusing consumer Step: 159/ParMultiDo(CounterOperation) into Step: 158/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.234Z: Fusing consumer Step: 160/ParMultiDo(CounterOperation) into Step: 159/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.268Z: Fusing consumer Step: 161/ParMultiDo(CounterOperation) into Step: 160/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.301Z: Fusing consumer Step: 162/ParMultiDo(CounterOperation) into Step: 161/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.333Z: Fusing consumer Step: 163/ParMultiDo(CounterOperation) into Step: 162/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.360Z: Fusing consumer Step: 164/ParMultiDo(CounterOperation) into Step: 163/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.402Z: Fusing consumer Step: 165/ParMultiDo(CounterOperation) into Step: 164/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.430Z: Fusing consumer Step: 166/ParMultiDo(CounterOperation) into Step: 165/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.461Z: Fusing consumer Step: 167/ParMultiDo(CounterOperation) into Step: 166/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.493Z: Fusing consumer Step: 168/ParMultiDo(CounterOperation) into Step: 167/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.526Z: Fusing consumer Step: 169/ParMultiDo(CounterOperation) into Step: 168/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.573Z: Fusing consumer Step: 170/ParMultiDo(CounterOperation) into Step: 169/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.601Z: Fusing consumer Step: 171/ParMultiDo(CounterOperation) into Step: 170/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.624Z: Fusing consumer Step: 172/ParMultiDo(CounterOperation) into Step: 171/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.656Z: Fusing consumer Step: 173/ParMultiDo(CounterOperation) into Step: 172/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.680Z: Fusing consumer Step: 174/ParMultiDo(CounterOperation) into Step: 173/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.713Z: Fusing consumer Step: 175/ParMultiDo(CounterOperation) into Step: 174/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.740Z: Fusing consumer Step: 176/ParMultiDo(CounterOperation) into Step: 175/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.770Z: Fusing consumer Step: 177/ParMultiDo(CounterOperation) into Step: 176/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.812Z: Fusing consumer Step: 178/ParMultiDo(CounterOperation) into Step: 177/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.834Z: Fusing consumer Step: 179/ParMultiDo(CounterOperation) into Step: 178/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.866Z: Fusing consumer Step: 180/ParMultiDo(CounterOperation) into Step: 179/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.905Z: Fusing consumer Step: 181/ParMultiDo(CounterOperation) into Step: 180/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.930Z: Fusing consumer Step: 182/ParMultiDo(CounterOperation) into Step: 181/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.968Z: Fusing consumer Step: 183/ParMultiDo(CounterOperation) into Step: 182/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:00.999Z: Fusing consumer Step: 184/ParMultiDo(CounterOperation) into Step: 183/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.045Z: Fusing consumer Step: 185/ParMultiDo(CounterOperation) into Step: 184/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.079Z: Fusing consumer Step: 186/ParMultiDo(CounterOperation) into Step: 185/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.107Z: Fusing consumer Step: 187/ParMultiDo(CounterOperation) into Step: 186/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.130Z: Fusing consumer Step: 188/ParMultiDo(CounterOperation) into Step: 187/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.151Z: Fusing consumer Step: 189/ParMultiDo(CounterOperation) into Step: 188/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.191Z: Fusing consumer Step: 190/ParMultiDo(CounterOperation) into Step: 189/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.216Z: Fusing consumer Step: 191/ParMultiDo(CounterOperation) into Step: 190/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.244Z: Fusing consumer Step: 192/ParMultiDo(CounterOperation) into Step: 191/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.278Z: Fusing consumer Step: 193/ParMultiDo(CounterOperation) into Step: 192/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.327Z: Fusing consumer Step: 194/ParMultiDo(CounterOperation) into Step: 193/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.361Z: Fusing consumer Step: 195/ParMultiDo(CounterOperation) into Step: 194/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.388Z: Fusing consumer Step: 196/ParMultiDo(CounterOperation) into Step: 195/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.420Z: Fusing consumer Step: 197/ParMultiDo(CounterOperation) into Step: 196/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.469Z: Fusing consumer Step: 198/ParMultiDo(CounterOperation) into Step: 197/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.497Z: Fusing consumer Step: 199/ParMultiDo(CounterOperation) into Step: 198/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.530Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 199/ParMultiDo(CounterOperation) Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:01.931Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:02.005Z: Starting 5 ****s in us-central1-b... Nov 05, 2022 12:49:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:24.793Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 05, 2022 12:49:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:49:45.534Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s). Nov 05, 2022 12:50:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:50:52.291Z: Workers have started successfully. Nov 05, 2022 12:51:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:51:14.507Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 05, 2022 12:51:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:51:14.633Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+Step: 10/ParMultiDo(CounterOperation)+Step: 11/ParMultiDo(CounterOperation)+Step: 12/ParMultiDo(CounterOperation)+Step: 13/ParMultiDo(CounterOperation)+Step: 14/ParMultiDo(CounterOperation)+Step: 15/ParMultiDo(CounterOperation)+Step: 16/ParMultiDo(CounterOperation)+Step: 17/ParMultiDo(CounterOperation)+Step: 18/ParMultiDo(CounterOperation)+Step: 19/ParMultiDo(CounterOperation)+Step: 20/ParMultiDo(CounterOperation)+Step: 21/ParMultiDo(CounterOperation)+Step: 22/ParMultiDo(CounterOperation)+Step: 23/ParMultiDo(CounterOperation)+Step: 24/ParMultiDo(CounterOperation)+Step: 25/ParMultiDo(CounterOperation)+Step: 26/ParMultiDo(CounterOperation)+Step: 27/ParMultiDo(CounterOperation)+Step: 28/ParMultiDo(CounterOperation)+Step: 29/ParMultiDo(CounterOperation)+Step: 30/ParMultiDo(CounterOperation)+Step: 31/ParMultiDo(CounterOperation)+Step: 32/ParMultiDo(CounterOperation)+Step: 33/ParMultiDo(CounterOperation)+Step: 34/ParMultiDo(CounterOperation)+Step: 35/ParMultiDo(CounterOperation)+Step: 36/ParMultiDo(CounterOperation)+Step: 37/ParMultiDo(CounterOperation)+Step: 38/ParMultiDo(CounterOperation)+Step: 39/ParMultiDo(CounterOperation)+Step: 40/ParMultiDo(CounterOperation)+Step: 41/ParMultiDo(CounterOperation)+Step: 42/ParMultiDo(CounterOperation)+Step: 43/ParMultiDo(CounterOperation)+Step: 44/ParMultiDo(CounterOperation)+Step: 45/ParMultiDo(CounterOperation)+Step: 46/ParMultiDo(CounterOperation)+Step: 47/ParMultiDo(CounterOperation)+Step: 48/ParMultiDo(CounterOperation)+Step: 49/ParMultiDo(CounterOperation)+Step: 50/ParMultiDo(CounterOperation)+Step: 51/ParMultiDo(CounterOperation)+Step: 52/ParMultiDo(CounterOperation)+Step: 53/ParMultiDo(CounterOperation)+Step: 54/ParMultiDo(CounterOperation)+Step: 55/ParMultiDo(CounterOperation)+Step: 56/ParMultiDo(CounterOperation)+Step: 57/ParMultiDo(CounterOperation)+Step: 58/ParMultiDo(CounterOperation)+Step: 59/ParMultiDo(CounterOperation)+Step: 60/ParMultiDo(CounterOperation)+Step: 61/ParMultiDo(CounterOperation)+Step: 62/ParMultiDo(CounterOperation)+Step: 63/ParMultiDo(CounterOperation)+Step: 64/ParMultiDo(CounterOperation)+Step: 65/ParMultiDo(CounterOperation)+Step: 66/ParMultiDo(CounterOperation)+Step: 67/ParMultiDo(CounterOperation)+Step: 68/ParMultiDo(CounterOperation)+Step: 69/ParMultiDo(CounterOperation)+Step: 70/ParMultiDo(CounterOperation)+Step: 71/ParMultiDo(CounterOperation)+Step: 72/ParMultiDo(CounterOperation)+Step: 73/ParMultiDo(CounterOperation)+Step: 74/ParMultiDo(CounterOperation)+Step: 75/ParMultiDo(CounterOperation)+Step: 76/ParMultiDo(CounterOperation)+Step: 77/ParMultiDo(CounterOperation)+Step: 78/ParMultiDo(CounterOperation)+Step: 79/ParMultiDo(CounterOperation)+Step: 80/ParMultiDo(CounterOperation)+Step: 81/ParMultiDo(CounterOperation)+Step: 82/ParMultiDo(CounterOperation)+Step: 83/ParMultiDo(CounterOperation)+Step: 84/ParMultiDo(CounterOperation)+Step: 85/ParMultiDo(CounterOperation)+Step: 86/ParMultiDo(CounterOperation)+Step: 87/ParMultiDo(CounterOperation)+Step: 88/ParMultiDo(CounterOperation)+Step: 89/ParMultiDo(CounterOperation)+Step: 90/ParMultiDo(CounterOperation)+Step: 91/ParMultiDo(CounterOperation)+Step: 92/ParMultiDo(CounterOperation)+Step: 93/ParMultiDo(CounterOperation)+Step: 94/ParMultiDo(CounterOperation)+Step: 95/ParMultiDo(CounterOperation)+Step: 96/ParMultiDo(CounterOperation)+Step: 97/ParMultiDo(CounterOperation)+Step: 98/ParMultiDo(CounterOperation)+Step: 99/ParMultiDo(CounterOperation)+Step: 100/ParMultiDo(CounterOperation)+Step: 101/ParMultiDo(CounterOperation)+Step: 102/ParMultiDo(CounterOperation)+Step: 103/ParMultiDo(CounterOperation)+Step: 104/ParMultiDo(CounterOperation)+Step: 105/ParMultiDo(CounterOperation)+Step: 106/ParMultiDo(CounterOperation)+Step: 107/ParMultiDo(CounterOperation)+Step: 108/ParMultiDo(CounterOperation)+Step: 109/ParMultiDo(CounterOperation)+Step: 110/ParMultiDo(CounterOperation)+Step: 111/ParMultiDo(CounterOperation)+Step: 112/ParMultiDo(CounterOperation)+Step: 113/ParMultiDo(CounterOperation)+Step: 114/ParMultiDo(CounterOperation)+Step: 115/ParMultiDo(CounterOperation)+Step: 116/ParMultiDo(CounterOperation)+Step: 117/ParMultiDo(CounterOperation)+Step: 118/ParMultiDo(CounterOperation)+Step: 119/ParMultiDo(CounterOperation)+Step: 120/ParMultiDo(CounterOperation)+Step: 121/ParMultiDo(CounterOperation)+Step: 122/ParMultiDo(CounterOperation)+Step: 123/ParMultiDo(CounterOperation)+Step: 124/ParMultiDo(CounterOperation)+Step: 125/ParMultiDo(CounterOperation)+Step: 126/ParMultiDo(CounterOperation)+Step: 127/ParMultiDo(CounterOperation)+Step: 128/ParMultiDo(CounterOperation)+Step: 129/ParMultiDo(CounterOperation)+Step: 130/ParMultiDo(CounterOperation)+Step: 131/ParMultiDo(CounterOperation)+Step: 132/ParMultiDo(CounterOperation)+Step: 133/ParMultiDo(CounterOperation)+Step: 134/ParMultiDo(CounterOperation)+Step: 135/ParMultiDo(CounterOperation)+Step: 136/ParMultiDo(CounterOperation)+Step: 137/ParMultiDo(CounterOperation)+Step: 138/ParMultiDo(CounterOperation)+Step: 139/ParMultiDo(CounterOperation)+Step: 140/ParMultiDo(CounterOperation)+Step: 141/ParMultiDo(CounterOperation)+Step: 142/ParMultiDo(CounterOperation)+Step: 143/ParMultiDo(CounterOperation)+Step: 144/ParMultiDo(CounterOperation)+Step: 145/ParMultiDo(CounterOperation)+Step: 146/ParMultiDo(CounterOperation)+Step: 147/ParMultiDo(CounterOperation)+Step: 148/ParMultiDo(CounterOperation)+Step: 149/ParMultiDo(CounterOperation)+Step: 150/ParMultiDo(CounterOperation)+Step: 151/ParMultiDo(CounterOperation)+Step: 152/ParMultiDo(CounterOperation)+Step: 153/ParMultiDo(CounterOperation)+Step: 154/ParMultiDo(CounterOperation)+Step: 155/ParMultiDo(CounterOperation)+Step: 156/ParMultiDo(CounterOperation)+Step: 157/ParMultiDo(CounterOperation)+Step: 158/ParMultiDo(CounterOperation)+Step: 159/ParMultiDo(CounterOperation)+Step: 160/ParMultiDo(CounterOperation)+Step: 161/ParMultiDo(CounterOperation)+Step: 162/ParMultiDo(CounterOperation)+Step: 163/ParMultiDo(CounterOperation)+Step: 164/ParMultiDo(CounterOperation)+Step: 165/ParMultiDo(CounterOperation)+Step: 166/ParMultiDo(CounterOperation)+Step: 167/ParMultiDo(CounterOperation)+Step: 168/ParMultiDo(CounterOperation)+Step: 169/ParMultiDo(CounterOperation)+Step: 170/ParMultiDo(CounterOperation)+Step: 171/ParMultiDo(CounterOperation)+Step: 172/ParMultiDo(CounterOperation)+Step: 173/ParMultiDo(CounterOperation)+Step: 174/ParMultiDo(CounterOperation)+Step: 175/ParMultiDo(CounterOperation)+Step: 176/ParMultiDo(CounterOperation)+Step: 177/ParMultiDo(CounterOperation)+Step: 178/ParMultiDo(CounterOperation)+Step: 179/ParMultiDo(CounterOperation)+Step: 180/ParMultiDo(CounterOperation)+Step: 181/ParMultiDo(CounterOperation)+Step: 182/ParMultiDo(CounterOperation)+Step: 183/ParMultiDo(CounterOperation)+Step: 184/ParMultiDo(CounterOperation)+Step: 185/ParMultiDo(CounterOperation)+Step: 186/ParMultiDo(CounterOperation)+Step: 187/ParMultiDo(CounterOperation)+Step: 188/ParMultiDo(CounterOperation)+Step: 189/ParMultiDo(CounterOperation)+Step: 190/ParMultiDo(CounterOperation)+Step: 191/ParMultiDo(CounterOperation)+Step: 192/ParMultiDo(CounterOperation)+Step: 193/ParMultiDo(CounterOperation)+Step: 194/ParMultiDo(CounterOperation)+Step: 195/ParMultiDo(CounterOperation)+Step: 196/ParMultiDo(CounterOperation)+Step: 197/ParMultiDo(CounterOperation)+Step: 198/ParMultiDo(CounterOperation)+Step: 199/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) Nov 05, 2022 12:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:52:25.178Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+Step: 10/ParMultiDo(CounterOperation)+Step: 11/ParMultiDo(CounterOperation)+Step: 12/ParMultiDo(CounterOperation)+Step: 13/ParMultiDo(CounterOperation)+Step: 14/ParMultiDo(CounterOperation)+Step: 15/ParMultiDo(CounterOperation)+Step: 16/ParMultiDo(CounterOperation)+Step: 17/ParMultiDo(CounterOperation)+Step: 18/ParMultiDo(CounterOperation)+Step: 19/ParMultiDo(CounterOperation)+Step: 20/ParMultiDo(CounterOperation)+Step: 21/ParMultiDo(CounterOperation)+Step: 22/ParMultiDo(CounterOperation)+Step: 23/ParMultiDo(CounterOperation)+Step: 24/ParMultiDo(CounterOperation)+Step: 25/ParMultiDo(CounterOperation)+Step: 26/ParMultiDo(CounterOperation)+Step: 27/ParMultiDo(CounterOperation)+Step: 28/ParMultiDo(CounterOperation)+Step: 29/ParMultiDo(CounterOperation)+Step: 30/ParMultiDo(CounterOperation)+Step: 31/ParMultiDo(CounterOperation)+Step: 32/ParMultiDo(CounterOperation)+Step: 33/ParMultiDo(CounterOperation)+Step: 34/ParMultiDo(CounterOperation)+Step: 35/ParMultiDo(CounterOperation)+Step: 36/ParMultiDo(CounterOperation)+Step: 37/ParMultiDo(CounterOperation)+Step: 38/ParMultiDo(CounterOperation)+Step: 39/ParMultiDo(CounterOperation)+Step: 40/ParMultiDo(CounterOperation)+Step: 41/ParMultiDo(CounterOperation)+Step: 42/ParMultiDo(CounterOperation)+Step: 43/ParMultiDo(CounterOperation)+Step: 44/ParMultiDo(CounterOperation)+Step: 45/ParMultiDo(CounterOperation)+Step: 46/ParMultiDo(CounterOperation)+Step: 47/ParMultiDo(CounterOperation)+Step: 48/ParMultiDo(CounterOperation)+Step: 49/ParMultiDo(CounterOperation)+Step: 50/ParMultiDo(CounterOperation)+Step: 51/ParMultiDo(CounterOperation)+Step: 52/ParMultiDo(CounterOperation)+Step: 53/ParMultiDo(CounterOperation)+Step: 54/ParMultiDo(CounterOperation)+Step: 55/ParMultiDo(CounterOperation)+Step: 56/ParMultiDo(CounterOperation)+Step: 57/ParMultiDo(CounterOperation)+Step: 58/ParMultiDo(CounterOperation)+Step: 59/ParMultiDo(CounterOperation)+Step: 60/ParMultiDo(CounterOperation)+Step: 61/ParMultiDo(CounterOperation)+Step: 62/ParMultiDo(CounterOperation)+Step: 63/ParMultiDo(CounterOperation)+Step: 64/ParMultiDo(CounterOperation)+Step: 65/ParMultiDo(CounterOperation)+Step: 66/ParMultiDo(CounterOperation)+Step: 67/ParMultiDo(CounterOperation)+Step: 68/ParMultiDo(CounterOperation)+Step: 69/ParMultiDo(CounterOperation)+Step: 70/ParMultiDo(CounterOperation)+Step: 71/ParMultiDo(CounterOperation)+Step: 72/ParMultiDo(CounterOperation)+Step: 73/ParMultiDo(CounterOperation)+Step: 74/ParMultiDo(CounterOperation)+Step: 75/ParMultiDo(CounterOperation)+Step: 76/ParMultiDo(CounterOperation)+Step: 77/ParMultiDo(CounterOperation)+Step: 78/ParMultiDo(CounterOperation)+Step: 79/ParMultiDo(CounterOperation)+Step: 80/ParMultiDo(CounterOperation)+Step: 81/ParMultiDo(CounterOperation)+Step: 82/ParMultiDo(CounterOperation)+Step: 83/ParMultiDo(CounterOperation)+Step: 84/ParMultiDo(CounterOperation)+Step: 85/ParMultiDo(CounterOperation)+Step: 86/ParMultiDo(CounterOperation)+Step: 87/ParMultiDo(CounterOperation)+Step: 88/ParMultiDo(CounterOperation)+Step: 89/ParMultiDo(CounterOperation)+Step: 90/ParMultiDo(CounterOperation)+Step: 91/ParMultiDo(CounterOperation)+Step: 92/ParMultiDo(CounterOperation)+Step: 93/ParMultiDo(CounterOperation)+Step: 94/ParMultiDo(CounterOperation)+Step: 95/ParMultiDo(CounterOperation)+Step: 96/ParMultiDo(CounterOperation)+Step: 97/ParMultiDo(CounterOperation)+Step: 98/ParMultiDo(CounterOperation)+Step: 99/ParMultiDo(CounterOperation)+Step: 100/ParMultiDo(CounterOperation)+Step: 101/ParMultiDo(CounterOperation)+Step: 102/ParMultiDo(CounterOperation)+Step: 103/ParMultiDo(CounterOperation)+Step: 104/ParMultiDo(CounterOperation)+Step: 105/ParMultiDo(CounterOperation)+Step: 106/ParMultiDo(CounterOperation)+Step: 107/ParMultiDo(CounterOperation)+Step: 108/ParMultiDo(CounterOperation)+Step: 109/ParMultiDo(CounterOperation)+Step: 110/ParMultiDo(CounterOperation)+Step: 111/ParMultiDo(CounterOperation)+Step: 112/ParMultiDo(CounterOperation)+Step: 113/ParMultiDo(CounterOperation)+Step: 114/ParMultiDo(CounterOperation)+Step: 115/ParMultiDo(CounterOperation)+Step: 116/ParMultiDo(CounterOperation)+Step: 117/ParMultiDo(CounterOperation)+Step: 118/ParMultiDo(CounterOperation)+Step: 119/ParMultiDo(CounterOperation)+Step: 120/ParMultiDo(CounterOperation)+Step: 121/ParMultiDo(CounterOperation)+Step: 122/ParMultiDo(CounterOperation)+Step: 123/ParMultiDo(CounterOperation)+Step: 124/ParMultiDo(CounterOperation)+Step: 125/ParMultiDo(CounterOperation)+Step: 126/ParMultiDo(CounterOperation)+Step: 127/ParMultiDo(CounterOperation)+Step: 128/ParMultiDo(CounterOperation)+Step: 129/ParMultiDo(CounterOperation)+Step: 130/ParMultiDo(CounterOperation)+Step: 131/ParMultiDo(CounterOperation)+Step: 132/ParMultiDo(CounterOperation)+Step: 133/ParMultiDo(CounterOperation)+Step: 134/ParMultiDo(CounterOperation)+Step: 135/ParMultiDo(CounterOperation)+Step: 136/ParMultiDo(CounterOperation)+Step: 137/ParMultiDo(CounterOperation)+Step: 138/ParMultiDo(CounterOperation)+Step: 139/ParMultiDo(CounterOperation)+Step: 140/ParMultiDo(CounterOperation)+Step: 141/ParMultiDo(CounterOperation)+Step: 142/ParMultiDo(CounterOperation)+Step: 143/ParMultiDo(CounterOperation)+Step: 144/ParMultiDo(CounterOperation)+Step: 145/ParMultiDo(CounterOperation)+Step: 146/ParMultiDo(CounterOperation)+Step: 147/ParMultiDo(CounterOperation)+Step: 148/ParMultiDo(CounterOperation)+Step: 149/ParMultiDo(CounterOperation)+Step: 150/ParMultiDo(CounterOperation)+Step: 151/ParMultiDo(CounterOperation)+Step: 152/ParMultiDo(CounterOperation)+Step: 153/ParMultiDo(CounterOperation)+Step: 154/ParMultiDo(CounterOperation)+Step: 155/ParMultiDo(CounterOperation)+Step: 156/ParMultiDo(CounterOperation)+Step: 157/ParMultiDo(CounterOperation)+Step: 158/ParMultiDo(CounterOperation)+Step: 159/ParMultiDo(CounterOperation)+Step: 160/ParMultiDo(CounterOperation)+Step: 161/ParMultiDo(CounterOperation)+Step: 162/ParMultiDo(CounterOperation)+Step: 163/ParMultiDo(CounterOperation)+Step: 164/ParMultiDo(CounterOperation)+Step: 165/ParMultiDo(CounterOperation)+Step: 166/ParMultiDo(CounterOperation)+Step: 167/ParMultiDo(CounterOperation)+Step: 168/ParMultiDo(CounterOperation)+Step: 169/ParMultiDo(CounterOperation)+Step: 170/ParMultiDo(CounterOperation)+Step: 171/ParMultiDo(CounterOperation)+Step: 172/ParMultiDo(CounterOperation)+Step: 173/ParMultiDo(CounterOperation)+Step: 174/ParMultiDo(CounterOperation)+Step: 175/ParMultiDo(CounterOperation)+Step: 176/ParMultiDo(CounterOperation)+Step: 177/ParMultiDo(CounterOperation)+Step: 178/ParMultiDo(CounterOperation)+Step: 179/ParMultiDo(CounterOperation)+Step: 180/ParMultiDo(CounterOperation)+Step: 181/ParMultiDo(CounterOperation)+Step: 182/ParMultiDo(CounterOperation)+Step: 183/ParMultiDo(CounterOperation)+Step: 184/ParMultiDo(CounterOperation)+Step: 185/ParMultiDo(CounterOperation)+Step: 186/ParMultiDo(CounterOperation)+Step: 187/ParMultiDo(CounterOperation)+Step: 188/ParMultiDo(CounterOperation)+Step: 189/ParMultiDo(CounterOperation)+Step: 190/ParMultiDo(CounterOperation)+Step: 191/ParMultiDo(CounterOperation)+Step: 192/ParMultiDo(CounterOperation)+Step: 193/ParMultiDo(CounterOperation)+Step: 194/ParMultiDo(CounterOperation)+Step: 195/ParMultiDo(CounterOperation)+Step: 196/ParMultiDo(CounterOperation)+Step: 197/ParMultiDo(CounterOperation)+Step: 198/ParMultiDo(CounterOperation)+Step: 199/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) Nov 05, 2022 12:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:52:25.336Z: Cleaning up. Nov 05, 2022 12:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:52:25.416Z: Stopping **** pool... Nov 05, 2022 12:54:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:54:41.949Z: Autoscaling: Resized **** pool from 5 to 0. Nov 05, 2022 12:54:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-05T12:54:41.994Z: Worker pool stopped. Nov 05, 2022 12:54:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-11-05_05_48_45-17081102429661737479 finished with status DONE. Load test results for test (ID): f2bc3cac-841c-4b95-92d0-1af6eaf5d153 and timestamp: 2022-11-05T12:48:39.136000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 65.364 dataflow_v2_java11_total_bytes_count 2.0E9 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221105124803 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221105124803] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221105124803] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155 ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'content-encoding': 'gzip', 'date': 'Sat, 05 Nov 2022 12:54:59 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 404} Failed to compute blob liveness for manifest: 'sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 304 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 6m 57s 109 actionable tasks: 9 executed, 100 up-to-date Publishing build scan... https://gradle.com/s/b7vdllwbvgnje Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
