See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java17/52/display/redirect?page=changes>
Changes: [noreply] Update README.md [marco.robles] Update README with latest PreCommit Jobs [marco.robles] Update Postcommit jobs with latest jobs [marco.robles] Update Performace job tests in readme [marco.robles] update load job tests with latest updates [marco.robles] update other jobs test with latest updates [marco.robles] mismatch links fix [marco.robles] update trigger phrase for some postCommit jobs [marco.robles] correct trigger phrases in readme [marco.robles] add pending jobs to readme [noreply] Update README.md [mmack] [BEAM-13246] Add support for S3 Bucket Key at the object level (AWS Sdk [Pablo Estrada] Output successful rows from BQ Streaming Inserts [schapman] BEAM-13439 Type annotation for ptransform_fn [noreply] [BEAM-13606] Fail bundles with failed BigTable mutations (#16751) [mmack] [adhoc] Remove remaining usage of Powermock from aws2. [marco.robles] fix broken links in jobs & remove the invalid ones [Kyle Weaver] Update Dataflow Python dev container images. [Kiley Sok] Add java 17 to changes [noreply] [BEAM-12914] Add missing 3.9 opcodes to type inference. (#16761) [noreply] [BEAM-13321] Initial BigQueryIO externalization. (#16489) [noreply] [BEAM-13193] Enable process bundle response elements embedding in Java [noreply] [BEAM-13830] added a debeziumio_expansion_addr flag to GoSDK (#16780) [noreply] Apply spotless. (#16783) [Daniel Oliveira] [BEAM-13732] Switch x-lang BigQueryIO expansion service to GCP one. [noreply] [BEAM-13858] Fix broken github action on :sdks:go:examples:wordCount [Kiley Sok] add jira for runner v2 [noreply] [BEAM-13732] Go SDK BigQuery IO wrapper. Initial implementation. [noreply] [BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786) [noreply] Update CHANGES.md with Go SDK milestones. (#16787) [noreply] [BEAM-13193] Allow BeamFnDataOutboundObserver to flush elements. ------------------------------------------ [...truncated 169.49 KB...] Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:55.803Z: Fusing consumer Step: 118/ParMultiDo(CounterOperation) into Step: 117/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:55.850Z: Fusing consumer Step: 119/ParMultiDo(CounterOperation) into Step: 118/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:55.880Z: Fusing consumer Step: 120/ParMultiDo(CounterOperation) into Step: 119/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:55.912Z: Fusing consumer Step: 121/ParMultiDo(CounterOperation) into Step: 120/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:55.943Z: Fusing consumer Step: 122/ParMultiDo(CounterOperation) into Step: 121/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:55.984Z: Fusing consumer Step: 123/ParMultiDo(CounterOperation) into Step: 122/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.028Z: Fusing consumer Step: 124/ParMultiDo(CounterOperation) into Step: 123/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.060Z: Fusing consumer Step: 125/ParMultiDo(CounterOperation) into Step: 124/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.102Z: Fusing consumer Step: 126/ParMultiDo(CounterOperation) into Step: 125/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.145Z: Fusing consumer Step: 127/ParMultiDo(CounterOperation) into Step: 126/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.169Z: Fusing consumer Step: 128/ParMultiDo(CounterOperation) into Step: 127/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.210Z: Fusing consumer Step: 129/ParMultiDo(CounterOperation) into Step: 128/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.233Z: Fusing consumer Step: 130/ParMultiDo(CounterOperation) into Step: 129/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.256Z: Fusing consumer Step: 131/ParMultiDo(CounterOperation) into Step: 130/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.317Z: Fusing consumer Step: 132/ParMultiDo(CounterOperation) into Step: 131/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.355Z: Fusing consumer Step: 133/ParMultiDo(CounterOperation) into Step: 132/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.394Z: Fusing consumer Step: 134/ParMultiDo(CounterOperation) into Step: 133/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.434Z: Fusing consumer Step: 135/ParMultiDo(CounterOperation) into Step: 134/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.473Z: Fusing consumer Step: 136/ParMultiDo(CounterOperation) into Step: 135/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.513Z: Fusing consumer Step: 137/ParMultiDo(CounterOperation) into Step: 136/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.564Z: Fusing consumer Step: 138/ParMultiDo(CounterOperation) into Step: 137/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.612Z: Fusing consumer Step: 139/ParMultiDo(CounterOperation) into Step: 138/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.648Z: Fusing consumer Step: 140/ParMultiDo(CounterOperation) into Step: 139/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.693Z: Fusing consumer Step: 141/ParMultiDo(CounterOperation) into Step: 140/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.731Z: Fusing consumer Step: 142/ParMultiDo(CounterOperation) into Step: 141/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.777Z: Fusing consumer Step: 143/ParMultiDo(CounterOperation) into Step: 142/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.824Z: Fusing consumer Step: 144/ParMultiDo(CounterOperation) into Step: 143/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.881Z: Fusing consumer Step: 145/ParMultiDo(CounterOperation) into Step: 144/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.924Z: Fusing consumer Step: 146/ParMultiDo(CounterOperation) into Step: 145/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.958Z: Fusing consumer Step: 147/ParMultiDo(CounterOperation) into Step: 146/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:56.988Z: Fusing consumer Step: 148/ParMultiDo(CounterOperation) into Step: 147/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.030Z: Fusing consumer Step: 149/ParMultiDo(CounterOperation) into Step: 148/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.066Z: Fusing consumer Step: 150/ParMultiDo(CounterOperation) into Step: 149/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.097Z: Fusing consumer Step: 151/ParMultiDo(CounterOperation) into Step: 150/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.137Z: Fusing consumer Step: 152/ParMultiDo(CounterOperation) into Step: 151/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.171Z: Fusing consumer Step: 153/ParMultiDo(CounterOperation) into Step: 152/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.205Z: Fusing consumer Step: 154/ParMultiDo(CounterOperation) into Step: 153/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.236Z: Fusing consumer Step: 155/ParMultiDo(CounterOperation) into Step: 154/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.302Z: Fusing consumer Step: 156/ParMultiDo(CounterOperation) into Step: 155/ParMultiDo(CounterOperation) Feb 09, 2022 1:06:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.378Z: Fusing consumer Step: 157/ParMultiDo(CounterOperation) into Step: 156/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.433Z: Fusing consumer Step: 158/ParMultiDo(CounterOperation) into Step: 157/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.495Z: Fusing consumer Step: 159/ParMultiDo(CounterOperation) into Step: 158/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.541Z: Fusing consumer Step: 160/ParMultiDo(CounterOperation) into Step: 159/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.596Z: Fusing consumer Step: 161/ParMultiDo(CounterOperation) into Step: 160/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.633Z: Fusing consumer Step: 162/ParMultiDo(CounterOperation) into Step: 161/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.684Z: Fusing consumer Step: 163/ParMultiDo(CounterOperation) into Step: 162/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.723Z: Fusing consumer Step: 164/ParMultiDo(CounterOperation) into Step: 163/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.758Z: Fusing consumer Step: 165/ParMultiDo(CounterOperation) into Step: 164/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.790Z: Fusing consumer Step: 166/ParMultiDo(CounterOperation) into Step: 165/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.823Z: Fusing consumer Step: 167/ParMultiDo(CounterOperation) into Step: 166/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.880Z: Fusing consumer Step: 168/ParMultiDo(CounterOperation) into Step: 167/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.914Z: Fusing consumer Step: 169/ParMultiDo(CounterOperation) into Step: 168/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.946Z: Fusing consumer Step: 170/ParMultiDo(CounterOperation) into Step: 169/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:57.987Z: Fusing consumer Step: 171/ParMultiDo(CounterOperation) into Step: 170/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.018Z: Fusing consumer Step: 172/ParMultiDo(CounterOperation) into Step: 171/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.040Z: Fusing consumer Step: 173/ParMultiDo(CounterOperation) into Step: 172/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.077Z: Fusing consumer Step: 174/ParMultiDo(CounterOperation) into Step: 173/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.129Z: Fusing consumer Step: 175/ParMultiDo(CounterOperation) into Step: 174/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.171Z: Fusing consumer Step: 176/ParMultiDo(CounterOperation) into Step: 175/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.202Z: Fusing consumer Step: 177/ParMultiDo(CounterOperation) into Step: 176/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.246Z: Fusing consumer Step: 178/ParMultiDo(CounterOperation) into Step: 177/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.299Z: Fusing consumer Step: 179/ParMultiDo(CounterOperation) into Step: 178/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.342Z: Fusing consumer Step: 180/ParMultiDo(CounterOperation) into Step: 179/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.389Z: Fusing consumer Step: 181/ParMultiDo(CounterOperation) into Step: 180/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.434Z: Fusing consumer Step: 182/ParMultiDo(CounterOperation) into Step: 181/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.465Z: Fusing consumer Step: 183/ParMultiDo(CounterOperation) into Step: 182/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.498Z: Fusing consumer Step: 184/ParMultiDo(CounterOperation) into Step: 183/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.530Z: Fusing consumer Step: 185/ParMultiDo(CounterOperation) into Step: 184/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.566Z: Fusing consumer Step: 186/ParMultiDo(CounterOperation) into Step: 185/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.610Z: Fusing consumer Step: 187/ParMultiDo(CounterOperation) into Step: 186/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.654Z: Fusing consumer Step: 188/ParMultiDo(CounterOperation) into Step: 187/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.695Z: Fusing consumer Step: 189/ParMultiDo(CounterOperation) into Step: 188/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.728Z: Fusing consumer Step: 190/ParMultiDo(CounterOperation) into Step: 189/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.759Z: Fusing consumer Step: 191/ParMultiDo(CounterOperation) into Step: 190/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.795Z: Fusing consumer Step: 192/ParMultiDo(CounterOperation) into Step: 191/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.830Z: Fusing consumer Step: 193/ParMultiDo(CounterOperation) into Step: 192/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.883Z: Fusing consumer Step: 194/ParMultiDo(CounterOperation) into Step: 193/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.917Z: Fusing consumer Step: 195/ParMultiDo(CounterOperation) into Step: 194/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.957Z: Fusing consumer Step: 196/ParMultiDo(CounterOperation) into Step: 195/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:58.991Z: Fusing consumer Step: 197/ParMultiDo(CounterOperation) into Step: 196/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:59.032Z: Fusing consumer Step: 198/ParMultiDo(CounterOperation) into Step: 197/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:59.064Z: Fusing consumer Step: 199/ParMultiDo(CounterOperation) into Step: 198/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:59.098Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 199/ParMultiDo(CounterOperation) Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:59.574Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 09, 2022 1:07:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:06:59.688Z: Starting 5 ****s in us-central1-c... Feb 09, 2022 1:07:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:07:18.111Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 09, 2022 1:07:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:07:42.959Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s). Feb 09, 2022 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:08:41.782Z: Workers have started successfully. Feb 09, 2022 1:08:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:08:41.836Z: Workers have started successfully. Feb 09, 2022 1:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:08:59.718Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 09, 2022 1:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:08:59.901Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+Step: 10/ParMultiDo(CounterOperation)+Step: 11/ParMultiDo(CounterOperation)+Step: 12/ParMultiDo(CounterOperation)+Step: 13/ParMultiDo(CounterOperation)+Step: 14/ParMultiDo(CounterOperation)+Step: 15/ParMultiDo(CounterOperation)+Step: 16/ParMultiDo(CounterOperation)+Step: 17/ParMultiDo(CounterOperation)+Step: 18/ParMultiDo(CounterOperation)+Step: 19/ParMultiDo(CounterOperation)+Step: 20/ParMultiDo(CounterOperation)+Step: 21/ParMultiDo(CounterOperation)+Step: 22/ParMultiDo(CounterOperation)+Step: 23/ParMultiDo(CounterOperation)+Step: 24/ParMultiDo(CounterOperation)+Step: 25/ParMultiDo(CounterOperation)+Step: 26/ParMultiDo(CounterOperation)+Step: 27/ParMultiDo(CounterOperation)+Step: 28/ParMultiDo(CounterOperation)+Step: 29/ParMultiDo(CounterOperation)+Step: 30/ParMultiDo(CounterOperation)+Step: 31/ParMultiDo(CounterOperation)+Step: 32/ParMultiDo(CounterOperation)+Step: 33/ParMultiDo(CounterOperation)+Step: 34/ParMultiDo(CounterOperation)+Step: 35/ParMultiDo(CounterOperation)+Step: 36/ParMultiDo(CounterOperation)+Step: 37/ParMultiDo(CounterOperation)+Step: 38/ParMultiDo(CounterOperation)+Step: 39/ParMultiDo(CounterOperation)+Step: 40/ParMultiDo(CounterOperation)+Step: 41/ParMultiDo(CounterOperation)+Step: 42/ParMultiDo(CounterOperation)+Step: 43/ParMultiDo(CounterOperation)+Step: 44/ParMultiDo(CounterOperation)+Step: 45/ParMultiDo(CounterOperation)+Step: 46/ParMultiDo(CounterOperation)+Step: 47/ParMultiDo(CounterOperation)+Step: 48/ParMultiDo(CounterOperation)+Step: 49/ParMultiDo(CounterOperation)+Step: 50/ParMultiDo(CounterOperation)+Step: 51/ParMultiDo(CounterOperation)+Step: 52/ParMultiDo(CounterOperation)+Step: 53/ParMultiDo(CounterOperation)+Step: 54/ParMultiDo(CounterOperation)+Step: 55/ParMultiDo(CounterOperation)+Step: 56/ParMultiDo(CounterOperation)+Step: 57/ParMultiDo(CounterOperation)+Step: 58/ParMultiDo(CounterOperation)+Step: 59/ParMultiDo(CounterOperation)+Step: 60/ParMultiDo(CounterOperation)+Step: 61/ParMultiDo(CounterOperation)+Step: 62/ParMultiDo(CounterOperation)+Step: 63/ParMultiDo(CounterOperation)+Step: 64/ParMultiDo(CounterOperation)+Step: 65/ParMultiDo(CounterOperation)+Step: 66/ParMultiDo(CounterOperation)+Step: 67/ParMultiDo(CounterOperation)+Step: 68/ParMultiDo(CounterOperation)+Step: 69/ParMultiDo(CounterOperation)+Step: 70/ParMultiDo(CounterOperation)+Step: 71/ParMultiDo(CounterOperation)+Step: 72/ParMultiDo(CounterOperation)+Step: 73/ParMultiDo(CounterOperation)+Step: 74/ParMultiDo(CounterOperation)+Step: 75/ParMultiDo(CounterOperation)+Step: 76/ParMultiDo(CounterOperation)+Step: 77/ParMultiDo(CounterOperation)+Step: 78/ParMultiDo(CounterOperation)+Step: 79/ParMultiDo(CounterOperation)+Step: 80/ParMultiDo(CounterOperation)+Step: 81/ParMultiDo(CounterOperation)+Step: 82/ParMultiDo(CounterOperation)+Step: 83/ParMultiDo(CounterOperation)+Step: 84/ParMultiDo(CounterOperation)+Step: 85/ParMultiDo(CounterOperation)+Step: 86/ParMultiDo(CounterOperation)+Step: 87/ParMultiDo(CounterOperation)+Step: 88/ParMultiDo(CounterOperation)+Step: 89/ParMultiDo(CounterOperation)+Step: 90/ParMultiDo(CounterOperation)+Step: 91/ParMultiDo(CounterOperation)+Step: 92/ParMultiDo(CounterOperation)+Step: 93/ParMultiDo(CounterOperation)+Step: 94/ParMultiDo(CounterOperation)+Step: 95/ParMultiDo(CounterOperation)+Step: 96/ParMultiDo(CounterOperation)+Step: 97/ParMultiDo(CounterOperation)+Step: 98/ParMultiDo(CounterOperation)+Step: 99/ParMultiDo(CounterOperation)+Step: 100/ParMultiDo(CounterOperation)+Step: 101/ParMultiDo(CounterOperation)+Step: 102/ParMultiDo(CounterOperation)+Step: 103/ParMultiDo(CounterOperation)+Step: 104/ParMultiDo(CounterOperation)+Step: 105/ParMultiDo(CounterOperation)+Step: 106/ParMultiDo(CounterOperation)+Step: 107/ParMultiDo(CounterOperation)+Step: 108/ParMultiDo(CounterOperation)+Step: 109/ParMultiDo(CounterOperation)+Step: 110/ParMultiDo(CounterOperation)+Step: 111/ParMultiDo(CounterOperation)+Step: 112/ParMultiDo(CounterOperation)+Step: 113/ParMultiDo(CounterOperation)+Step: 114/ParMultiDo(CounterOperation)+Step: 115/ParMultiDo(CounterOperation)+Step: 116/ParMultiDo(CounterOperation)+Step: 117/ParMultiDo(CounterOperation)+Step: 118/ParMultiDo(CounterOperation)+Step: 119/ParMultiDo(CounterOperation)+Step: 120/ParMultiDo(CounterOperation)+Step: 121/ParMultiDo(CounterOperation)+Step: 122/ParMultiDo(CounterOperation)+Step: 123/ParMultiDo(CounterOperation)+Step: 124/ParMultiDo(CounterOperation)+Step: 125/ParMultiDo(CounterOperation)+Step: 126/ParMultiDo(CounterOperation)+Step: 127/ParMultiDo(CounterOperation)+Step: 128/ParMultiDo(CounterOperation)+Step: 129/ParMultiDo(CounterOperation)+Step: 130/ParMultiDo(CounterOperation)+Step: 131/ParMultiDo(CounterOperation)+Step: 132/ParMultiDo(CounterOperation)+Step: 133/ParMultiDo(CounterOperation)+Step: 134/ParMultiDo(CounterOperation)+Step: 135/ParMultiDo(CounterOperation)+Step: 136/ParMultiDo(CounterOperation)+Step: 137/ParMultiDo(CounterOperation)+Step: 138/ParMultiDo(CounterOperation)+Step: 139/ParMultiDo(CounterOperation)+Step: 140/ParMultiDo(CounterOperation)+Step: 141/ParMultiDo(CounterOperation)+Step: 142/ParMultiDo(CounterOperation)+Step: 143/ParMultiDo(CounterOperation)+Step: 144/ParMultiDo(CounterOperation)+Step: 145/ParMultiDo(CounterOperation)+Step: 146/ParMultiDo(CounterOperation)+Step: 147/ParMultiDo(CounterOperation)+Step: 148/ParMultiDo(CounterOperation)+Step: 149/ParMultiDo(CounterOperation)+Step: 150/ParMultiDo(CounterOperation)+Step: 151/ParMultiDo(CounterOperation)+Step: 152/ParMultiDo(CounterOperation)+Step: 153/ParMultiDo(CounterOperation)+Step: 154/ParMultiDo(CounterOperation)+Step: 155/ParMultiDo(CounterOperation)+Step: 156/ParMultiDo(CounterOperation)+Step: 157/ParMultiDo(CounterOperation)+Step: 158/ParMultiDo(CounterOperation)+Step: 159/ParMultiDo(CounterOperation)+Step: 160/ParMultiDo(CounterOperation)+Step: 161/ParMultiDo(CounterOperation)+Step: 162/ParMultiDo(CounterOperation)+Step: 163/ParMultiDo(CounterOperation)+Step: 164/ParMultiDo(CounterOperation)+Step: 165/ParMultiDo(CounterOperation)+Step: 166/ParMultiDo(CounterOperation)+Step: 167/ParMultiDo(CounterOperation)+Step: 168/ParMultiDo(CounterOperation)+Step: 169/ParMultiDo(CounterOperation)+Step: 170/ParMultiDo(CounterOperation)+Step: 171/ParMultiDo(CounterOperation)+Step: 172/ParMultiDo(CounterOperation)+Step: 173/ParMultiDo(CounterOperation)+Step: 174/ParMultiDo(CounterOperation)+Step: 175/ParMultiDo(CounterOperation)+Step: 176/ParMultiDo(CounterOperation)+Step: 177/ParMultiDo(CounterOperation)+Step: 178/ParMultiDo(CounterOperation)+Step: 179/ParMultiDo(CounterOperation)+Step: 180/ParMultiDo(CounterOperation)+Step: 181/ParMultiDo(CounterOperation)+Step: 182/ParMultiDo(CounterOperation)+Step: 183/ParMultiDo(CounterOperation)+Step: 184/ParMultiDo(CounterOperation)+Step: 185/ParMultiDo(CounterOperation)+Step: 186/ParMultiDo(CounterOperation)+Step: 187/ParMultiDo(CounterOperation)+Step: 188/ParMultiDo(CounterOperation)+Step: 189/ParMultiDo(CounterOperation)+Step: 190/ParMultiDo(CounterOperation)+Step: 191/ParMultiDo(CounterOperation)+Step: 192/ParMultiDo(CounterOperation)+Step: 193/ParMultiDo(CounterOperation)+Step: 194/ParMultiDo(CounterOperation)+Step: 195/ParMultiDo(CounterOperation)+Step: 196/ParMultiDo(CounterOperation)+Step: 197/ParMultiDo(CounterOperation)+Step: 198/ParMultiDo(CounterOperation)+Step: 199/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) Feb 09, 2022 1:10:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:10:27.306Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+Step: 10/ParMultiDo(CounterOperation)+Step: 11/ParMultiDo(CounterOperation)+Step: 12/ParMultiDo(CounterOperation)+Step: 13/ParMultiDo(CounterOperation)+Step: 14/ParMultiDo(CounterOperation)+Step: 15/ParMultiDo(CounterOperation)+Step: 16/ParMultiDo(CounterOperation)+Step: 17/ParMultiDo(CounterOperation)+Step: 18/ParMultiDo(CounterOperation)+Step: 19/ParMultiDo(CounterOperation)+Step: 20/ParMultiDo(CounterOperation)+Step: 21/ParMultiDo(CounterOperation)+Step: 22/ParMultiDo(CounterOperation)+Step: 23/ParMultiDo(CounterOperation)+Step: 24/ParMultiDo(CounterOperation)+Step: 25/ParMultiDo(CounterOperation)+Step: 26/ParMultiDo(CounterOperation)+Step: 27/ParMultiDo(CounterOperation)+Step: 28/ParMultiDo(CounterOperation)+Step: 29/ParMultiDo(CounterOperation)+Step: 30/ParMultiDo(CounterOperation)+Step: 31/ParMultiDo(CounterOperation)+Step: 32/ParMultiDo(CounterOperation)+Step: 33/ParMultiDo(CounterOperation)+Step: 34/ParMultiDo(CounterOperation)+Step: 35/ParMultiDo(CounterOperation)+Step: 36/ParMultiDo(CounterOperation)+Step: 37/ParMultiDo(CounterOperation)+Step: 38/ParMultiDo(CounterOperation)+Step: 39/ParMultiDo(CounterOperation)+Step: 40/ParMultiDo(CounterOperation)+Step: 41/ParMultiDo(CounterOperation)+Step: 42/ParMultiDo(CounterOperation)+Step: 43/ParMultiDo(CounterOperation)+Step: 44/ParMultiDo(CounterOperation)+Step: 45/ParMultiDo(CounterOperation)+Step: 46/ParMultiDo(CounterOperation)+Step: 47/ParMultiDo(CounterOperation)+Step: 48/ParMultiDo(CounterOperation)+Step: 49/ParMultiDo(CounterOperation)+Step: 50/ParMultiDo(CounterOperation)+Step: 51/ParMultiDo(CounterOperation)+Step: 52/ParMultiDo(CounterOperation)+Step: 53/ParMultiDo(CounterOperation)+Step: 54/ParMultiDo(CounterOperation)+Step: 55/ParMultiDo(CounterOperation)+Step: 56/ParMultiDo(CounterOperation)+Step: 57/ParMultiDo(CounterOperation)+Step: 58/ParMultiDo(CounterOperation)+Step: 59/ParMultiDo(CounterOperation)+Step: 60/ParMultiDo(CounterOperation)+Step: 61/ParMultiDo(CounterOperation)+Step: 62/ParMultiDo(CounterOperation)+Step: 63/ParMultiDo(CounterOperation)+Step: 64/ParMultiDo(CounterOperation)+Step: 65/ParMultiDo(CounterOperation)+Step: 66/ParMultiDo(CounterOperation)+Step: 67/ParMultiDo(CounterOperation)+Step: 68/ParMultiDo(CounterOperation)+Step: 69/ParMultiDo(CounterOperation)+Step: 70/ParMultiDo(CounterOperation)+Step: 71/ParMultiDo(CounterOperation)+Step: 72/ParMultiDo(CounterOperation)+Step: 73/ParMultiDo(CounterOperation)+Step: 74/ParMultiDo(CounterOperation)+Step: 75/ParMultiDo(CounterOperation)+Step: 76/ParMultiDo(CounterOperation)+Step: 77/ParMultiDo(CounterOperation)+Step: 78/ParMultiDo(CounterOperation)+Step: 79/ParMultiDo(CounterOperation)+Step: 80/ParMultiDo(CounterOperation)+Step: 81/ParMultiDo(CounterOperation)+Step: 82/ParMultiDo(CounterOperation)+Step: 83/ParMultiDo(CounterOperation)+Step: 84/ParMultiDo(CounterOperation)+Step: 85/ParMultiDo(CounterOperation)+Step: 86/ParMultiDo(CounterOperation)+Step: 87/ParMultiDo(CounterOperation)+Step: 88/ParMultiDo(CounterOperation)+Step: 89/ParMultiDo(CounterOperation)+Step: 90/ParMultiDo(CounterOperation)+Step: 91/ParMultiDo(CounterOperation)+Step: 92/ParMultiDo(CounterOperation)+Step: 93/ParMultiDo(CounterOperation)+Step: 94/ParMultiDo(CounterOperation)+Step: 95/ParMultiDo(CounterOperation)+Step: 96/ParMultiDo(CounterOperation)+Step: 97/ParMultiDo(CounterOperation)+Step: 98/ParMultiDo(CounterOperation)+Step: 99/ParMultiDo(CounterOperation)+Step: 100/ParMultiDo(CounterOperation)+Step: 101/ParMultiDo(CounterOperation)+Step: 102/ParMultiDo(CounterOperation)+Step: 103/ParMultiDo(CounterOperation)+Step: 104/ParMultiDo(CounterOperation)+Step: 105/ParMultiDo(CounterOperation)+Step: 106/ParMultiDo(CounterOperation)+Step: 107/ParMultiDo(CounterOperation)+Step: 108/ParMultiDo(CounterOperation)+Step: 109/ParMultiDo(CounterOperation)+Step: 110/ParMultiDo(CounterOperation)+Step: 111/ParMultiDo(CounterOperation)+Step: 112/ParMultiDo(CounterOperation)+Step: 113/ParMultiDo(CounterOperation)+Step: 114/ParMultiDo(CounterOperation)+Step: 115/ParMultiDo(CounterOperation)+Step: 116/ParMultiDo(CounterOperation)+Step: 117/ParMultiDo(CounterOperation)+Step: 118/ParMultiDo(CounterOperation)+Step: 119/ParMultiDo(CounterOperation)+Step: 120/ParMultiDo(CounterOperation)+Step: 121/ParMultiDo(CounterOperation)+Step: 122/ParMultiDo(CounterOperation)+Step: 123/ParMultiDo(CounterOperation)+Step: 124/ParMultiDo(CounterOperation)+Step: 125/ParMultiDo(CounterOperation)+Step: 126/ParMultiDo(CounterOperation)+Step: 127/ParMultiDo(CounterOperation)+Step: 128/ParMultiDo(CounterOperation)+Step: 129/ParMultiDo(CounterOperation)+Step: 130/ParMultiDo(CounterOperation)+Step: 131/ParMultiDo(CounterOperation)+Step: 132/ParMultiDo(CounterOperation)+Step: 133/ParMultiDo(CounterOperation)+Step: 134/ParMultiDo(CounterOperation)+Step: 135/ParMultiDo(CounterOperation)+Step: 136/ParMultiDo(CounterOperation)+Step: 137/ParMultiDo(CounterOperation)+Step: 138/ParMultiDo(CounterOperation)+Step: 139/ParMultiDo(CounterOperation)+Step: 140/ParMultiDo(CounterOperation)+Step: 141/ParMultiDo(CounterOperation)+Step: 142/ParMultiDo(CounterOperation)+Step: 143/ParMultiDo(CounterOperation)+Step: 144/ParMultiDo(CounterOperation)+Step: 145/ParMultiDo(CounterOperation)+Step: 146/ParMultiDo(CounterOperation)+Step: 147/ParMultiDo(CounterOperation)+Step: 148/ParMultiDo(CounterOperation)+Step: 149/ParMultiDo(CounterOperation)+Step: 150/ParMultiDo(CounterOperation)+Step: 151/ParMultiDo(CounterOperation)+Step: 152/ParMultiDo(CounterOperation)+Step: 153/ParMultiDo(CounterOperation)+Step: 154/ParMultiDo(CounterOperation)+Step: 155/ParMultiDo(CounterOperation)+Step: 156/ParMultiDo(CounterOperation)+Step: 157/ParMultiDo(CounterOperation)+Step: 158/ParMultiDo(CounterOperation)+Step: 159/ParMultiDo(CounterOperation)+Step: 160/ParMultiDo(CounterOperation)+Step: 161/ParMultiDo(CounterOperation)+Step: 162/ParMultiDo(CounterOperation)+Step: 163/ParMultiDo(CounterOperation)+Step: 164/ParMultiDo(CounterOperation)+Step: 165/ParMultiDo(CounterOperation)+Step: 166/ParMultiDo(CounterOperation)+Step: 167/ParMultiDo(CounterOperation)+Step: 168/ParMultiDo(CounterOperation)+Step: 169/ParMultiDo(CounterOperation)+Step: 170/ParMultiDo(CounterOperation)+Step: 171/ParMultiDo(CounterOperation)+Step: 172/ParMultiDo(CounterOperation)+Step: 173/ParMultiDo(CounterOperation)+Step: 174/ParMultiDo(CounterOperation)+Step: 175/ParMultiDo(CounterOperation)+Step: 176/ParMultiDo(CounterOperation)+Step: 177/ParMultiDo(CounterOperation)+Step: 178/ParMultiDo(CounterOperation)+Step: 179/ParMultiDo(CounterOperation)+Step: 180/ParMultiDo(CounterOperation)+Step: 181/ParMultiDo(CounterOperation)+Step: 182/ParMultiDo(CounterOperation)+Step: 183/ParMultiDo(CounterOperation)+Step: 184/ParMultiDo(CounterOperation)+Step: 185/ParMultiDo(CounterOperation)+Step: 186/ParMultiDo(CounterOperation)+Step: 187/ParMultiDo(CounterOperation)+Step: 188/ParMultiDo(CounterOperation)+Step: 189/ParMultiDo(CounterOperation)+Step: 190/ParMultiDo(CounterOperation)+Step: 191/ParMultiDo(CounterOperation)+Step: 192/ParMultiDo(CounterOperation)+Step: 193/ParMultiDo(CounterOperation)+Step: 194/ParMultiDo(CounterOperation)+Step: 195/ParMultiDo(CounterOperation)+Step: 196/ParMultiDo(CounterOperation)+Step: 197/ParMultiDo(CounterOperation)+Step: 198/ParMultiDo(CounterOperation)+Step: 199/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) Feb 09, 2022 1:10:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:10:27.499Z: Cleaning up. Feb 09, 2022 1:10:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:10:27.594Z: Stopping **** pool... Feb 09, 2022 1:12:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:12:45.885Z: Autoscaling: Resized **** pool from 5 to 0. Feb 09, 2022 1:12:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-09T13:12:46.004Z: Worker pool stopped. Feb 09, 2022 1:12:57 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-02-09_05_06_37-4570140129554082421 finished with status DONE. Load test results for test (ID): 26c12438-7c46-494c-9c55-0dce071a3ced and timestamp: 2022-02-09T13:06:31.150000000Z: Metric: Value: dataflow_v2_java17_runtime_sec 83.25 dataflow_v2_java17_total_bytes_count 2.0E9 Feb 09, 2022 1:12:58 PM org.apache.beam.sdk.testutils.publishing.InfluxDBPublisher publishWithCheck WARNING: Unable to publish metrics due to error: Response code: 500. Reason: "open /var/lib/influxdb/meta/meta.dbtmp: no space left on device" > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220209130557 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ac79a6e820a67aeae3aca7202d8bcbcc14bcfde1b0961ce7ab8c896c569f4bc Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220209130557] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ac79a6e820a67aeae3aca7202d8bcbcc14bcfde1b0961ce7ab8c896c569f4bc] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220209130557] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ac79a6e820a67aeae3aca7202d8bcbcc14bcfde1b0961ce7ab8c896c569f4bc])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ac79a6e820a67aeae3aca7202d8bcbcc14bcfde1b0961ce7ab8c896c569f4bc Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5ac79a6e820a67aeae3aca7202d8bcbcc14bcfde1b0961ce7ab8c896c569f4bc ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Wed, 09 Feb 2022 13:13:04 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'} Failed to compute blob liveness for manifest: 'sha256:5ac79a6e820a67aeae3aca7202d8bcbcc14bcfde1b0961ce7ab8c896c569f4bc': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 297 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 7m 8s 104 actionable tasks: 8 executed, 96 up-to-date Publishing build scan... https://gradle.com/s/h2p2zhsyd3r5o Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
