See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_Streaming/461/display/redirect>
Changes: ------------------------------------------ [...truncated 112.80 KB...] INFO: Adding Step: 109 as step s114 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 110 as step s115 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 111 as step s116 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 112 as step s117 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 113 as step s118 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 114 as step s119 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 115 as step s120 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 116 as step s121 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 117 as step s122 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 118 as step s123 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 119 as step s124 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 120 as step s125 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 121 as step s126 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 122 as step s127 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 123 as step s128 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 124 as step s129 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 125 as step s130 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 126 as step s131 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 127 as step s132 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 128 as step s133 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 129 as step s134 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 130 as step s135 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 131 as step s136 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 132 as step s137 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 133 as step s138 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 134 as step s139 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 135 as step s140 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 136 as step s141 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 137 as step s142 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 138 as step s143 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 139 as step s144 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 140 as step s145 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 141 as step s146 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 142 as step s147 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 143 as step s148 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 144 as step s149 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 145 as step s150 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 146 as step s151 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 147 as step s152 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 148 as step s153 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 149 as step s154 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 150 as step s155 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 151 as step s156 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 152 as step s157 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 153 as step s158 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 154 as step s159 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 155 as step s160 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 156 as step s161 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 157 as step s162 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 158 as step s163 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 159 as step s164 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 160 as step s165 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 161 as step s166 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 162 as step s167 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 163 as step s168 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 164 as step s169 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 165 as step s170 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 166 as step s171 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 167 as step s172 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 168 as step s173 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 169 as step s174 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 170 as step s175 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 171 as step s176 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 172 as step s177 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 173 as step s178 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 174 as step s179 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 175 as step s180 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 176 as step s181 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 177 as step s182 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 178 as step s183 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 179 as step s184 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 180 as step s185 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 181 as step s186 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 182 as step s187 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 183 as step s188 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 184 as step s189 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 185 as step s190 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 186 as step s191 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 187 as step s192 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 188 as step s193 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 189 as step s194 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 190 as step s195 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 191 as step s196 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 192 as step s197 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 193 as step s198 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 194 as step s199 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 195 as step s200 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 196 as step s201 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 197 as step s202 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 198 as step s203 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 199 as step s204 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding ParDo(TimeMonitor)2 as step s205 Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging pipeline description to gs://temp-storage-for-perf-tests/loadtests/staging/ Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <374861 bytes, hash 9d86e97b0be3ac496835e2d11498c3036950a371d5a29ae8cb501f7e2647a219> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-nYbpewvjrEloNeLRFJjDA2lQo3HVoproy1AffiZHohk.pb Aug 17, 2020 12:12:51 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.25.0-SNAPSHOT Aug 17, 2020 12:12:52 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-17_05_12_51-4196584382543804923?project=apache-beam-testing Aug 17, 2020 12:12:52 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2020-08-17_05_12_51-4196584382543804923 Aug 17, 2020 12:12:52 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2020-08-17_05_12_51-4196584382543804923 Aug 17, 2020 12:12:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2020-08-17T12:12:55.816Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java0dataflow0streaming0pardo02-jenkins-0817121-2wnr. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Aug 17, 2020 12:12:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:12:59.099Z: Worker configuration: n1-standard-4 in us-central1-f. Aug 17, 2020 12:12:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2020-08-17T12:12:59.456Z: Workflow failed. Causes: The Compute Engine API has not fully initialized. Please try again in a few minutes., Unable to get information for region us-central1. Aug 17, 2020 12:12:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:12:59.467Z: Cleaning up. Aug 17, 2020 12:12:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:12:59.508Z: Worker pool stopped. Aug 17, 2020 12:12:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:12:59.520Z: Stopping **** pool... Aug 17, 2020 12:13:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2020-08-17T12:13:02.628Z: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Aug 17, 2020 12:13:07 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2020-08-17_05_12_51-4196584382543804923 failed with status FAILED. Aug 17, 2020 12:13:07 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric totalBytes.count, from namespace pardo Load test results for test (ID): c7e13448-d43b-4968-82d0-be337cef8135 and timestamp: 2020-08-17T12:12:47.568000000Z: Metric: Value: dataflow_runtime_sec 0.0 dataflow_total_bytes_count -1.0 Exception in thread "main" java.lang.RuntimeException: Invalid job state: FAILED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:134) at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53) at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103) > Task :sdks:java:testing:load-tests:run FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 25s 73 actionable tasks: 1 executed, 72 up-to-date Publishing build scan... https://gradle.com/s/w7t6fqf6pdj2c Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
