See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_Streaming/862/display/redirect>
Changes: ------------------------------------------ [...truncated 150.51 KB...] INFO: 2021-09-27T12:22:45.015Z: Fusing consumer Step: 127 into Step: 126 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.038Z: Fusing consumer Step: 128 into Step: 127 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.062Z: Fusing consumer Step: 129 into Step: 128 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.106Z: Fusing consumer Step: 130 into Step: 129 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.131Z: Fusing consumer Step: 131 into Step: 130 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.157Z: Fusing consumer Step: 132 into Step: 131 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.188Z: Fusing consumer Step: 133 into Step: 132 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.223Z: Fusing consumer Step: 134 into Step: 133 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.247Z: Fusing consumer Step: 135 into Step: 134 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.272Z: Fusing consumer Step: 136 into Step: 135 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.296Z: Fusing consumer Step: 137 into Step: 136 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.341Z: Fusing consumer Step: 138 into Step: 137 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.378Z: Fusing consumer Step: 139 into Step: 138 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.412Z: Fusing consumer Step: 140 into Step: 139 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.435Z: Fusing consumer Step: 141 into Step: 140 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.465Z: Fusing consumer Step: 142 into Step: 141 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.498Z: Fusing consumer Step: 143 into Step: 142 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.536Z: Fusing consumer Step: 144 into Step: 143 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.586Z: Fusing consumer Step: 145 into Step: 144 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.613Z: Fusing consumer Step: 146 into Step: 145 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.645Z: Fusing consumer Step: 147 into Step: 146 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.671Z: Fusing consumer Step: 148 into Step: 147 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.695Z: Fusing consumer Step: 149 into Step: 148 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.729Z: Fusing consumer Step: 150 into Step: 149 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.761Z: Fusing consumer Step: 151 into Step: 150 Sep 27, 2021 12:22:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.787Z: Fusing consumer Step: 152 into Step: 151 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.814Z: Fusing consumer Step: 153 into Step: 152 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.849Z: Fusing consumer Step: 154 into Step: 153 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.881Z: Fusing consumer Step: 155 into Step: 154 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.909Z: Fusing consumer Step: 156 into Step: 155 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.938Z: Fusing consumer Step: 157 into Step: 156 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:45.972Z: Fusing consumer Step: 158 into Step: 157 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.004Z: Fusing consumer Step: 159 into Step: 158 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.039Z: Fusing consumer Step: 160 into Step: 159 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.072Z: Fusing consumer Step: 161 into Step: 160 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.109Z: Fusing consumer Step: 162 into Step: 161 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.145Z: Fusing consumer Step: 163 into Step: 162 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.173Z: Fusing consumer Step: 164 into Step: 163 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.209Z: Fusing consumer Step: 165 into Step: 164 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.244Z: Fusing consumer Step: 166 into Step: 165 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.278Z: Fusing consumer Step: 167 into Step: 166 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.312Z: Fusing consumer Step: 168 into Step: 167 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.349Z: Fusing consumer Step: 169 into Step: 168 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.382Z: Fusing consumer Step: 170 into Step: 169 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.404Z: Fusing consumer Step: 171 into Step: 170 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.429Z: Fusing consumer Step: 172 into Step: 171 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.456Z: Fusing consumer Step: 173 into Step: 172 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.526Z: Fusing consumer Step: 174 into Step: 173 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.579Z: Fusing consumer Step: 175 into Step: 174 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.609Z: Fusing consumer Step: 176 into Step: 175 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.647Z: Fusing consumer Step: 177 into Step: 176 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.680Z: Fusing consumer Step: 178 into Step: 177 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.713Z: Fusing consumer Step: 179 into Step: 178 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.744Z: Fusing consumer Step: 180 into Step: 179 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.767Z: Fusing consumer Step: 181 into Step: 180 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.790Z: Fusing consumer Step: 182 into Step: 181 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.825Z: Fusing consumer Step: 183 into Step: 182 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.858Z: Fusing consumer Step: 184 into Step: 183 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.889Z: Fusing consumer Step: 185 into Step: 184 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.925Z: Fusing consumer Step: 186 into Step: 185 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.956Z: Fusing consumer Step: 187 into Step: 186 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:46.990Z: Fusing consumer Step: 188 into Step: 187 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.014Z: Fusing consumer Step: 189 into Step: 188 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.046Z: Fusing consumer Step: 190 into Step: 189 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.081Z: Fusing consumer Step: 191 into Step: 190 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.111Z: Fusing consumer Step: 192 into Step: 191 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.137Z: Fusing consumer Step: 193 into Step: 192 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.170Z: Fusing consumer Step: 194 into Step: 193 Sep 27, 2021 12:22:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.204Z: Fusing consumer Step: 195 into Step: 194 Sep 27, 2021 12:22:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.237Z: Fusing consumer Step: 196 into Step: 195 Sep 27, 2021 12:22:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.272Z: Fusing consumer Step: 197 into Step: 196 Sep 27, 2021 12:22:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.306Z: Fusing consumer Step: 198 into Step: 197 Sep 27, 2021 12:22:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.332Z: Fusing consumer Step: 199 into Step: 198 Sep 27, 2021 12:22:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.359Z: Fusing consumer ParDo(TimeMonitor)2 into Step: 199 Sep 27, 2021 12:22:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.807Z: Executing operation Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Read input/StripIds+ParDo(TimeMonitor)+ParDo(ByteMonitor)+Step: 0+Step: 1+Step: 2+Step: 3+Step: 4+Step: 5+Step: 6+Step: 7+Step: 8+Step: 9+Step: 10+Step: 11+Step: 12+Step: 13+Step: 14+Step: 15+Step: 16+Step: 17+Step: 18+Step: 19+Step: 20+Step: 21+Step: 22+Step: 23+Step: 24+Step: 25+Step: 26+Step: 27+Step: 28+Step: 29+Step: 30+Step: 31+Step: 32+Step: 33+Step: 34+Step: 35+Step: 36+Step: 37+Step: 38+Step: 39+Step: 40+Step: 41+Step: 42+Step: 43+Step: 44+Step: 45+Step: 46+Step: 47+Step: 48+Step: 49+Step: 50+Step: 51+Step: 52+Step: 53+Step: 54+Step: 55+Step: 56+Step: 57+Step: 58+Step: 59+Step: 60+Step: 61+Step: 62+Step: 63+Step: 64+Step: 65+Step: 66+Step: 67+Step: 68+Step: 69+Step: 70+Step: 71+Step: 72+Step: 73+Step: 74+Step: 75+Step: 76+Step: 77+Step: 78+Step: 79+Step: 80+Step: 81+Step: 82+Step: 83+Step: 84+Step: 85+Step: 86+Step: 87+Step: 88+Step: 89+Step: 90+Step: 91+Step: 92+Step: 93+Step: 94+Step: 95+Step: 96+Step: 97+Step: 98+Step: 99+Step: 100+Step: 101+Step: 102+Step: 103+Step: 104+Step: 105+Step: 106+Step: 107+Step: 108+Step: 109+Step: 110+Step: 111+Step: 112+Step: 113+Step: 114+Step: 115+Step: 116+Step: 117+Step: 118+Step: 119+Step: 120+Step: 121+Step: 122+Step: 123+Step: 124+Step: 125+Step: 126+Step: 127+Step: 128+Step: 129+Step: 130+Step: 131+Step: 132+Step: 133+Step: 134+Step: 135+Step: 136+Step: 137+Step: 138+Step: 139+Step: 140+Step: 141+Step: 142+Step: 143+Step: 144+Step: 145+Step: 146+Step: 147+Step: 148+Step: 149+Step: 150+Step: 151+Step: 152+Step: 153+Step: 154+Step: 155+Step: 156+Step: 157+Step: 158+Step: 159+Step: 160+Step: 161+Step: 162+Step: 163+Step: 164+Step: 165+Step: 166+Step: 167+Step: 168+Step: 169+Step: 170+Step: 171+Step: 172+Step: 173+Step: 174+Step: 175+Step: 176+Step: 177+Step: 178+Step: 179+Step: 180+Step: 181+Step: 182+Step: 183+Step: 184+Step: 185+Step: 186+Step: 187+Step: 188+Step: 189+Step: 190+Step: 191+Step: 192+Step: 193+Step: 194+Step: 195+Step: 196+Step: 197+Step: 198+Step: 199+ParDo(TimeMonitor)2 Sep 27, 2021 12:22:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:22:47.875Z: Starting 5 ****s in us-central1-a... Sep 27, 2021 12:23:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:23:16.265Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Sep 27, 2021 12:23:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:23:32.345Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 27, 2021 12:23:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:23:56.220Z: Workers have started successfully. Sep 27, 2021 12:23:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:23:56.247Z: Workers have started successfully. Sep 27, 2021 12:29:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:29:53.980Z: Finished operation Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Read input/StripIds+ParDo(TimeMonitor)+ParDo(ByteMonitor)+Step: 0+Step: 1+Step: 2+Step: 3+Step: 4+Step: 5+Step: 6+Step: 7+Step: 8+Step: 9+Step: 10+Step: 11+Step: 12+Step: 13+Step: 14+Step: 15+Step: 16+Step: 17+Step: 18+Step: 19+Step: 20+Step: 21+Step: 22+Step: 23+Step: 24+Step: 25+Step: 26+Step: 27+Step: 28+Step: 29+Step: 30+Step: 31+Step: 32+Step: 33+Step: 34+Step: 35+Step: 36+Step: 37+Step: 38+Step: 39+Step: 40+Step: 41+Step: 42+Step: 43+Step: 44+Step: 45+Step: 46+Step: 47+Step: 48+Step: 49+Step: 50+Step: 51+Step: 52+Step: 53+Step: 54+Step: 55+Step: 56+Step: 57+Step: 58+Step: 59+Step: 60+Step: 61+Step: 62+Step: 63+Step: 64+Step: 65+Step: 66+Step: 67+Step: 68+Step: 69+Step: 70+Step: 71+Step: 72+Step: 73+Step: 74+Step: 75+Step: 76+Step: 77+Step: 78+Step: 79+Step: 80+Step: 81+Step: 82+Step: 83+Step: 84+Step: 85+Step: 86+Step: 87+Step: 88+Step: 89+Step: 90+Step: 91+Step: 92+Step: 93+Step: 94+Step: 95+Step: 96+Step: 97+Step: 98+Step: 99+Step: 100+Step: 101+Step: 102+Step: 103+Step: 104+Step: 105+Step: 106+Step: 107+Step: 108+Step: 109+Step: 110+Step: 111+Step: 112+Step: 113+Step: 114+Step: 115+Step: 116+Step: 117+Step: 118+Step: 119+Step: 120+Step: 121+Step: 122+Step: 123+Step: 124+Step: 125+Step: 126+Step: 127+Step: 128+Step: 129+Step: 130+Step: 131+Step: 132+Step: 133+Step: 134+Step: 135+Step: 136+Step: 137+Step: 138+Step: 139+Step: 140+Step: 141+Step: 142+Step: 143+Step: 144+Step: 145+Step: 146+Step: 147+Step: 148+Step: 149+Step: 150+Step: 151+Step: 152+Step: 153+Step: 154+Step: 155+Step: 156+Step: 157+Step: 158+Step: 159+Step: 160+Step: 161+Step: 162+Step: 163+Step: 164+Step: 165+Step: 166+Step: 167+Step: 168+Step: 169+Step: 170+Step: 171+Step: 172+Step: 173+Step: 174+Step: 175+Step: 176+Step: 177+Step: 178+Step: 179+Step: 180+Step: 181+Step: 182+Step: 183+Step: 184+Step: 185+Step: 186+Step: 187+Step: 188+Step: 189+Step: 190+Step: 191+Step: 192+Step: 193+Step: 194+Step: 195+Step: 196+Step: 197+Step: 198+Step: 199+ParDo(TimeMonitor)2 Sep 27, 2021 12:29:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:29:54.054Z: Cleaning up. Sep 27, 2021 12:29:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:29:54.123Z: Stopping **** pool... Sep 27, 2021 12:32:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:32:20.983Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Sep 27, 2021 12:32:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-27T12:32:21.033Z: Worker pool stopped. Sep 27, 2021 12:32:30 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-09-27_05_22_29-16543029441263143721 finished with status DONE. Load test results for test (ID): 794a020c-b0d8-4803-b298-ccd0a2466420 and timestamp: 2021-09-27T12:22:23.247000000Z: Metric: Value: dataflow_runtime_sec 221.886 dataflow_total_bytes_count 1.999998E9 Exception in thread "main" com.google.cloud.bigquery.BigQueryException: 502 Bad Gateway POST https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/load_test/tables/java_dataflow_streaming_ParDo_2/insertAll?prettyPrint=false <!DOCTYPE html> <html lang=en> <meta charset=utf-8> <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width"> <title>Error 502 (Server Error)!!1</title> <style> *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px} </style> <a href=//www.google.com/><span id=logo aria-label=Google></span></a> <p><b>502.</b> <ins>That’s an error.</ins> <p>The server encountered a temporary error and could not complete your request.<p>Please try again in 30 seconds. <ins>That’s all we know.</ins> at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.translate(HttpBigQueryRpc.java:115) at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.insertAll(HttpBigQueryRpc.java:494) at com.google.cloud.bigquery.BigQueryImpl.insertAll(BigQueryImpl.java:1065) at org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertAll(BigQueryClient.java:123) at org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertAll(BigQueryClient.java:110) at org.apache.beam.sdk.testutils.publishing.BigQueryResultsPublisher.publish(BigQueryResultsPublisher.java:57) at org.apache.beam.sdk.loadtests.LoadTest.publishResultsToBigQuery(LoadTest.java:194) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:144) at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53) at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103) Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 502 Bad Gateway POST https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/load_test/tables/java_dataflow_streaming_ParDo_2/insertAll?prettyPrint=false <!DOCTYPE html> <html lang=en> <meta charset=utf-8> <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width"> <title>Error 502 (Server Error)!!1</title> <style> *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px} </style> <a href=//www.google.com/><span id=logo aria-label=Google></span></a> <p><b>502.</b> <ins>That’s an error.</ins> <p>The server encountered a temporary error and could not complete your request.<p>Please try again in 30 seconds. <ins>That’s all we know.</ins> at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146) at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:118) at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:37) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:428) at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1111) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:514) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:455) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565) at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.insertAll(HttpBigQueryRpc.java:492) ... 8 more > Task :sdks:java:testing:load-tests:run FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 10m 27s 90 actionable tasks: 1 executed, 89 up-to-date Publishing build scan... https://gradle.com/s/bxb2lv6hcdufm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
