See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/534/display/redirect?page=changes>
Changes:
[noreply] Update nbconvert requirement in /sdks/python
[bulatkazan] [Website] center the main content #24521
[Moritz Mack] [Spark Dataset runner] Add @Experimental and reduce visibility
where
[Moritz Mack] [Spark Dataset runner] Broadcast pipeline options
[noreply] Fix grafana dashboard id (#24524)
[noreply] [Spark runner] Support running (VR) tests with Java 17 (closes #24400)
[noreply] Replaced deprecated finalize with DoFn Teardown (#24516)
[noreply] Bump cloud.google.com/go/storage from 1.28.0 to 1.28.1 in /sdks
(#24517)
[noreply] add clarifier to error message (#24449)
[noreply] Batch rename requests in fileio.WriteToFiles (#24341)
[noreply] Bump golang.org/x/text from 0.4.0 to 0.5.0 in /sdks (#24520)
[noreply] Support for JsonSchema in Kafka Read Schema Transform (#24272)
[noreply] Run go fmt over full go directory with go 1.19 (#24525)
[noreply] Cloudbuild+manualsetup+playground (#24144)
[noreply] Bump golang.org/x/sys from 0.2.0 to 0.3.0 in /sdks (#24519)
[noreply] Bump cloud.google.com/go/bigtable from 1.18.0 to 1.18.1 in /sdks
[noreply] Update from interface{} -> any for core packages (#24505)
[noreply] Implement FileWriteSchemaTransformConfiguration (#24479)
[noreply] Bump cloud.google.com/go/pubsub from 1.27.0 to 1.27.1 in /sdks
(#24518)
[noreply] [Playground] Healthcheck was added (#24227)
[noreply] Update dataflow container version for Pandas upgrade (#24532)
[bulatkazan] [Website] update copy icon positioning #24426
------------------------------------------
[...truncated 172.92 KB...]
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.140Z: Fusing consumer Step:
106/ParMultiDo(CounterOperation) into Step: 105/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.164Z: Fusing consumer Step:
107/ParMultiDo(CounterOperation) into Step: 106/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.197Z: Fusing consumer Step:
108/ParMultiDo(CounterOperation) into Step: 107/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.233Z: Fusing consumer Step:
109/ParMultiDo(CounterOperation) into Step: 108/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.272Z: Fusing consumer Step:
110/ParMultiDo(CounterOperation) into Step: 109/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.302Z: Fusing consumer Step:
111/ParMultiDo(CounterOperation) into Step: 110/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.335Z: Fusing consumer Step:
112/ParMultiDo(CounterOperation) into Step: 111/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.366Z: Fusing consumer Step:
113/ParMultiDo(CounterOperation) into Step: 112/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.393Z: Fusing consumer Step:
114/ParMultiDo(CounterOperation) into Step: 113/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.422Z: Fusing consumer Step:
115/ParMultiDo(CounterOperation) into Step: 114/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.444Z: Fusing consumer Step:
116/ParMultiDo(CounterOperation) into Step: 115/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.494Z: Fusing consumer Step:
117/ParMultiDo(CounterOperation) into Step: 116/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.528Z: Fusing consumer Step:
118/ParMultiDo(CounterOperation) into Step: 117/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.556Z: Fusing consumer Step:
119/ParMultiDo(CounterOperation) into Step: 118/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.592Z: Fusing consumer Step:
120/ParMultiDo(CounterOperation) into Step: 119/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.632Z: Fusing consumer Step:
121/ParMultiDo(CounterOperation) into Step: 120/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.660Z: Fusing consumer Step:
122/ParMultiDo(CounterOperation) into Step: 121/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.698Z: Fusing consumer Step:
123/ParMultiDo(CounterOperation) into Step: 122/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.727Z: Fusing consumer Step:
124/ParMultiDo(CounterOperation) into Step: 123/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.752Z: Fusing consumer Step:
125/ParMultiDo(CounterOperation) into Step: 124/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.785Z: Fusing consumer Step:
126/ParMultiDo(CounterOperation) into Step: 125/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.822Z: Fusing consumer Step:
127/ParMultiDo(CounterOperation) into Step: 126/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.846Z: Fusing consumer Step:
128/ParMultiDo(CounterOperation) into Step: 127/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.876Z: Fusing consumer Step:
129/ParMultiDo(CounterOperation) into Step: 128/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.924Z: Fusing consumer Step:
130/ParMultiDo(CounterOperation) into Step: 129/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:33.951Z: Fusing consumer Step:
131/ParMultiDo(CounterOperation) into Step: 130/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.008Z: Fusing consumer Step:
132/ParMultiDo(CounterOperation) into Step: 131/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.044Z: Fusing consumer Step:
133/ParMultiDo(CounterOperation) into Step: 132/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.080Z: Fusing consumer Step:
134/ParMultiDo(CounterOperation) into Step: 133/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.124Z: Fusing consumer Step:
135/ParMultiDo(CounterOperation) into Step: 134/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.160Z: Fusing consumer Step:
136/ParMultiDo(CounterOperation) into Step: 135/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.208Z: Fusing consumer Step:
137/ParMultiDo(CounterOperation) into Step: 136/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.244Z: Fusing consumer Step:
138/ParMultiDo(CounterOperation) into Step: 137/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.270Z: Fusing consumer Step:
139/ParMultiDo(CounterOperation) into Step: 138/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.304Z: Fusing consumer Step:
140/ParMultiDo(CounterOperation) into Step: 139/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.326Z: Fusing consumer Step:
141/ParMultiDo(CounterOperation) into Step: 140/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.361Z: Fusing consumer Step:
142/ParMultiDo(CounterOperation) into Step: 141/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.393Z: Fusing consumer Step:
143/ParMultiDo(CounterOperation) into Step: 142/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.438Z: Fusing consumer Step:
144/ParMultiDo(CounterOperation) into Step: 143/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.467Z: Fusing consumer Step:
145/ParMultiDo(CounterOperation) into Step: 144/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.502Z: Fusing consumer Step:
146/ParMultiDo(CounterOperation) into Step: 145/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.530Z: Fusing consumer Step:
147/ParMultiDo(CounterOperation) into Step: 146/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.558Z: Fusing consumer Step:
148/ParMultiDo(CounterOperation) into Step: 147/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.583Z: Fusing consumer Step:
149/ParMultiDo(CounterOperation) into Step: 148/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.618Z: Fusing consumer Step:
150/ParMultiDo(CounterOperation) into Step: 149/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.648Z: Fusing consumer Step:
151/ParMultiDo(CounterOperation) into Step: 150/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.679Z: Fusing consumer Step:
152/ParMultiDo(CounterOperation) into Step: 151/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.708Z: Fusing consumer Step:
153/ParMultiDo(CounterOperation) into Step: 152/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.734Z: Fusing consumer Step:
154/ParMultiDo(CounterOperation) into Step: 153/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.753Z: Fusing consumer Step:
155/ParMultiDo(CounterOperation) into Step: 154/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.780Z: Fusing consumer Step:
156/ParMultiDo(CounterOperation) into Step: 155/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.828Z: Fusing consumer Step:
157/ParMultiDo(CounterOperation) into Step: 156/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.863Z: Fusing consumer Step:
158/ParMultiDo(CounterOperation) into Step: 157/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.906Z: Fusing consumer Step:
159/ParMultiDo(CounterOperation) into Step: 158/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.930Z: Fusing consumer Step:
160/ParMultiDo(CounterOperation) into Step: 159/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:34.969Z: Fusing consumer Step:
161/ParMultiDo(CounterOperation) into Step: 160/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.026Z: Fusing consumer Step:
162/ParMultiDo(CounterOperation) into Step: 161/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.061Z: Fusing consumer Step:
163/ParMultiDo(CounterOperation) into Step: 162/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.087Z: Fusing consumer Step:
164/ParMultiDo(CounterOperation) into Step: 163/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.121Z: Fusing consumer Step:
165/ParMultiDo(CounterOperation) into Step: 164/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.167Z: Fusing consumer Step:
166/ParMultiDo(CounterOperation) into Step: 165/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.201Z: Fusing consumer Step:
167/ParMultiDo(CounterOperation) into Step: 166/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.227Z: Fusing consumer Step:
168/ParMultiDo(CounterOperation) into Step: 167/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.256Z: Fusing consumer Step:
169/ParMultiDo(CounterOperation) into Step: 168/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.287Z: Fusing consumer Step:
170/ParMultiDo(CounterOperation) into Step: 169/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.322Z: Fusing consumer Step:
171/ParMultiDo(CounterOperation) into Step: 170/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.355Z: Fusing consumer Step:
172/ParMultiDo(CounterOperation) into Step: 171/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.388Z: Fusing consumer Step:
173/ParMultiDo(CounterOperation) into Step: 172/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.424Z: Fusing consumer Step:
174/ParMultiDo(CounterOperation) into Step: 173/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.460Z: Fusing consumer Step:
175/ParMultiDo(CounterOperation) into Step: 174/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.499Z: Fusing consumer Step:
176/ParMultiDo(CounterOperation) into Step: 175/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.524Z: Fusing consumer Step:
177/ParMultiDo(CounterOperation) into Step: 176/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.551Z: Fusing consumer Step:
178/ParMultiDo(CounterOperation) into Step: 177/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.586Z: Fusing consumer Step:
179/ParMultiDo(CounterOperation) into Step: 178/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.617Z: Fusing consumer Step:
180/ParMultiDo(CounterOperation) into Step: 179/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.642Z: Fusing consumer Step:
181/ParMultiDo(CounterOperation) into Step: 180/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.678Z: Fusing consumer Step:
182/ParMultiDo(CounterOperation) into Step: 181/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.697Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.703Z: Fusing consumer Step:
183/ParMultiDo(CounterOperation) into Step: 182/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.734Z: Fusing consumer Step:
184/ParMultiDo(CounterOperation) into Step: 183/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.757Z: Fusing consumer Step:
185/ParMultiDo(CounterOperation) into Step: 184/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.789Z: Fusing consumer Step:
186/ParMultiDo(CounterOperation) into Step: 185/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.824Z: Fusing consumer Step:
187/ParMultiDo(CounterOperation) into Step: 186/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.862Z: Fusing consumer Step:
188/ParMultiDo(CounterOperation) into Step: 187/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.896Z: Fusing consumer Step:
189/ParMultiDo(CounterOperation) into Step: 188/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.935Z: Fusing consumer Step:
190/ParMultiDo(CounterOperation) into Step: 189/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.962Z: Fusing consumer Step:
191/ParMultiDo(CounterOperation) into Step: 190/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:35.997Z: Fusing consumer Step:
192/ParMultiDo(CounterOperation) into Step: 191/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.025Z: Fusing consumer Step:
193/ParMultiDo(CounterOperation) into Step: 192/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.064Z: Fusing consumer Step:
194/ParMultiDo(CounterOperation) into Step: 193/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.104Z: Fusing consumer Step:
195/ParMultiDo(CounterOperation) into Step: 194/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.129Z: Fusing consumer Step:
196/ParMultiDo(CounterOperation) into Step: 195/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.171Z: Fusing consumer Step:
197/ParMultiDo(CounterOperation) into Step: 196/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.201Z: Fusing consumer Step:
198/ParMultiDo(CounterOperation) into Step: 197/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.238Z: Fusing consumer Step:
199/ParMultiDo(CounterOperation) into Step: 198/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.271Z: Fusing consumer
ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step:
199/ParMultiDo(CounterOperation)
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.670Z: Executing operation Read input/Impulse+Read
input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Dec 06, 2022 12:48:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:48:36.775Z: Starting 5 ****s in us-central1-b...
Dec 06, 2022 12:49:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:49:19.926Z: Autoscaling: Raised the number of ****s to 5
based on the rate of progress in the currently running stage(s).
Dec 06, 2022 12:50:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T12:50:27.077Z: Workers have started successfully.
Dec 06, 2022 12:50:36 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_04_48_18-12665057276034152199
> Task :sdks:java:testing:load-tests:run FAILED
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=4da438a3-c28c-4bff-88c9-54a71e529c9c,
currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 1196410
log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-1196410.out.log
----- Last 20 lines from daemon log file - daemon-1196410.out.log -----
Dec 06, 2022 12:50:36 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_04_48_18-12665057276034152199
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:231)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
