See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/174/display/redirect?page=changes>
Changes: [heejong] [BEAM-13092] Adding dummy external transform translators for Dataflow [stranniknm] [BEAM-13112]: playground embedded version [zyichi] [BEAM-13388] Fix broken google cloud dlp test. [relax] don't store unserializable DatasetService as a member variable [noreply] [BEAM-13236] Properly close kinesis producer on teardown (#15955) [noreply] Merge pull request #16150 from [BEAM-13396][Playground][Bugfix] Issues [noreply] Merge pull request #16148 from [BEAM-13394][Playground] [Bugfix] Fix [noreply] Avoid overriding explicit portable job submission disabling. (#16143) [noreply] Merge pull request #16151 from [BEAM-13350][Playground] Support running [zyichi] [BEAM-13373] Increase python post commit timeout to reduce chance of [melissapa] [BEAM-11758] Final cleanup for Beam Basics doc content [msbukal] Exclude FhirIOPatientEverything from v2 dataflow runner intg test. [noreply] [BEAM-13371] Fix bug where DataFrame overview snippets don't show up [dpcollins] Add a workaround for https://github.com/googleapis/gax-java/issues/1577 [noreply] [BEAM-12976] Implement pipeline visitor to get global field access in… [noreply] [BEAM-13388] Use 3.0.0 as lower bound for google-cloud-dlp (#16164) [noreply] Merge pull request #16127 from [BEAM-13366] [Playground] Add support ------------------------------------------ [...truncated 81.20 KB...] passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. Dec 08, 2021 3:44:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-12-08T15:44:34.446Z: generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:771 Dec 08, 2021 3:49:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T15:49:17.267Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Dec 08, 2021 3:52:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T15:52:20.536Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Dec 08, 2021 3:53:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T15:53:23.898Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Dec 08, 2021 3:57:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T15:57:26.147Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Dec 08, 2021 4:00:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T16:00:30.324Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Dec 08, 2021 4:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T16:00:32.499Z: Cancel request is committed for workflow job: 2021-12-08_04_28_03-10880404350525751905. Dec 08, 2021 4:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T16:00:32.527Z: Cleaning up. Dec 08, 2021 4:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T16:00:32.599Z: Stopping **** pool... Dec 08, 2021 4:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T16:00:32.652Z: Stopping **** pool... Dec 08, 2021 4:03:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T16:03:14.903Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Dec 08, 2021 4:03:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-12-08T16:03:14.937Z: Worker pool stopped. Dec 08, 2021 4:03:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-12-08_04_28_03-10880404350525751905 finished with status CANCELLED. Load test results for test (ID): 38e4e598-266d-4e4b-908b-b87129f249be and timestamp: 2021-12-08T12:27:49.379000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 1989.3 dataflow_v2_java11_total_bytes_count 6.35346466E9 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139) at org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57) at org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211208122425 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:06b0c953c20d36f1007c239b314f23b7879658934fda2bada0bfc56674dc54d5 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211208122425] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:06b0c953c20d36f1007c239b314f23b7879658934fda2bada0bfc56674dc54d5] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211208122425] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:06b0c953c20d36f1007c239b314f23b7879658934fda2bada0bfc56674dc54d5])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:06b0c953c20d36f1007c239b314f23b7879658934fda2bada0bfc56674dc54d5 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:06b0c953c20d36f1007c239b314f23b7879658934fda2bada0bfc56674dc54d5 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:06b0c953c20d36f1007c239b314f23b7879658934fda2bada0bfc56674dc54d5]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 39m 42s 101 actionable tasks: 71 executed, 28 from cache, 2 up-to-date Publishing build scan... Publishing failed. The build scan server appears to be unavailable. Please check https://status.gradle.com for the latest service status. If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste: ---------- Gradle version: 6.9.1 Plugin version: 3.4.1 Request URL: https://status.gradle.com Request ID: b40f5406-90f3-49e8-8ae2-cf0c6dd93d22 Response status code: 405 Response server type: Varnish ---------- Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
