See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/524/display/redirect?page=changes>
Changes:
[noreply] Update java-multi-language-pipelines.md (#24345)
------------------------------------------
[...truncated 118.61 KB...]
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
328423cdbe4d: Preparing
2bcc1ccb6923: Preparing
b9910d0ae654: Preparing
ecef552ac5af: Preparing
0516d647c022: Preparing
a2d9266d1e2f: Preparing
0cbc80862ff7: Preparing
4c9798a692e1: Preparing
3307b9349ce6: Preparing
657b5124b2d5: Preparing
7b2bffb08f50: Preparing
4f1d4df34b4d: Preparing
b7736df11b89: Preparing
b0e26f894b87: Preparing
87ffe4c3f85a: Preparing
7b7f3078e1db: Preparing
826c3ddbb29c: Preparing
b626401ef603: Preparing
9b55156abf26: Preparing
293d5db30c9f: Preparing
03127cdb479b: Preparing
9c742cd6c7a5: Preparing
a2d9266d1e2f: Waiting
87ffe4c3f85a: Waiting
0cbc80862ff7: Waiting
7b7f3078e1db: Waiting
826c3ddbb29c: Waiting
4c9798a692e1: Waiting
b626401ef603: Waiting
3307b9349ce6: Waiting
9b55156abf26: Waiting
293d5db30c9f: Waiting
657b5124b2d5: Waiting
03127cdb479b: Waiting
7b2bffb08f50: Waiting
9c742cd6c7a5: Waiting
4f1d4df34b4d: Waiting
b7736df11b89: Waiting
b0e26f894b87: Waiting
2bcc1ccb6923: Pushed
0516d647c022: Pushed
ecef552ac5af: Pushed
b9910d0ae654: Pushed
328423cdbe4d: Pushed
4c9798a692e1: Pushed
0cbc80862ff7: Pushed
657b5124b2d5: Pushed
4f1d4df34b4d: Pushed
a2d9266d1e2f: Pushed
7b2bffb08f50: Pushed
7b7f3078e1db: Layer already exists
826c3ddbb29c: Layer already exists
b626401ef603: Layer already exists
9b55156abf26: Layer already exists
293d5db30c9f: Layer already exists
03127cdb479b: Layer already exists
9c742cd6c7a5: Layer already exists
b0e26f894b87: Pushed
3307b9349ce6: Pushed
87ffe4c3f85a: Pushed
b7736df11b89: Pushed
20221126133805: digest:
sha256:3baec8d90b9f163336231ce8eaa319759423d609f519b4cfc2be6151390ec583 size:
4935
> Task :sdks:java:testing:load-tests:run
Nov 26, 2022 1:39:07 PM
org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory
create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Nov 26, 2022 1:39:09 PM org.apache.beam.runners.dataflow.DataflowRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from
the classpath: will stage 229 files. Enable logging at DEBUG level to see which
files will be staged.
Nov 26, 2022 1:39:12 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: Window.Into()
Nov 26, 2022 1:39:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Nov 26, 2022 1:39:19 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 229 files from PipelineOptions.filesToStage to staging location
to prepare for execution.
Nov 26, 2022 1:39:20 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 229 files cached, 0 files newly uploaded in 1
seconds
Nov 26, 2022 1:39:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to
gs://temp-storage-for-perf-tests/loadtests/staging/
Nov 26, 2022 1:39:20 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <122673 bytes, hash
014619e7c6180caad534b830a95c5b1fde604a7def9824473f3beace387cb08b> to
gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-AUYZ58YYDKrVNLgwqVxbH95gSn3vmCRHPzvqzjh8sIs.pb
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as
step s1
Nov 26, 2022 1:39:25 PM
org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles: [SyntheticUnboundedSource{startOffset=0,
endOffset=1000000}, SyntheticUnboundedSource{startOffset=1000000,
endOffset=2000000}, SyntheticUnboundedSource{startOffset=2000000,
endOffset=3000000}, SyntheticUnboundedSource{startOffset=3000000,
endOffset=4000000}, SyntheticUnboundedSource{startOffset=4000000,
endOffset=5000000}, SyntheticUnboundedSource{startOffset=5000000,
endOffset=6000000}, SyntheticUnboundedSource{startOffset=6000000,
endOffset=7000000}, SyntheticUnboundedSource{startOffset=7000000,
endOffset=8000000}, SyntheticUnboundedSource{startOffset=8000000,
endOffset=9000000}, SyntheticUnboundedSource{startOffset=9000000,
endOffset=10000000}, SyntheticUnboundedSource{startOffset=10000000,
endOffset=11000000}, SyntheticUnboundedSource{startOffset=11000000,
endOffset=12000000}, SyntheticUnboundedSource{startOffset=12000000,
endOffset=13000000}, SyntheticUnboundedSource{startOffset=13000000,
endOffset=14000000}, SyntheticUnboundedSource{startOffset=14000000,
endOffset=15000000}, SyntheticUnboundedSource{startOffset=15000000,
endOffset=16000000}, SyntheticUnboundedSource{startOffset=16000000,
endOffset=17000000}, SyntheticUnboundedSource{startOffset=17000000,
endOffset=18000000}, SyntheticUnboundedSource{startOffset=18000000,
endOffset=19000000}, SyntheticUnboundedSource{startOffset=19000000,
endOffset=20000000}]
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect start time metrics (input) as step s3
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Window.Into()/Window.Assign as step s4
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as
step s5
Nov 26, 2022 1:39:25 PM
org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles: [SyntheticUnboundedSource{startOffset=0,
endOffset=100000}, SyntheticUnboundedSource{startOffset=100000,
endOffset=200000}, SyntheticUnboundedSource{startOffset=200000,
endOffset=300000}, SyntheticUnboundedSource{startOffset=300000,
endOffset=400000}, SyntheticUnboundedSource{startOffset=400000,
endOffset=500000}, SyntheticUnboundedSource{startOffset=500000,
endOffset=600000}, SyntheticUnboundedSource{startOffset=600000,
endOffset=700000}, SyntheticUnboundedSource{startOffset=700000,
endOffset=800000}, SyntheticUnboundedSource{startOffset=800000,
endOffset=900000}, SyntheticUnboundedSource{startOffset=900000,
endOffset=1000000}, SyntheticUnboundedSource{startOffset=1000000,
endOffset=1100000}, SyntheticUnboundedSource{startOffset=1100000,
endOffset=1200000}, SyntheticUnboundedSource{startOffset=1200000,
endOffset=1300000}, SyntheticUnboundedSource{startOffset=1300000,
endOffset=1400000}, SyntheticUnboundedSource{startOffset=1400000,
endOffset=1500000}, SyntheticUnboundedSource{startOffset=1500000,
endOffset=1600000}, SyntheticUnboundedSource{startOffset=1600000,
endOffset=1700000}, SyntheticUnboundedSource{startOffset=1700000,
endOffset=1800000}, SyntheticUnboundedSource{startOffset=1800000,
endOffset=1900000}, SyntheticUnboundedSource{startOffset=1900000,
endOffset=2000000}]
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read co-input/StripIds as step s6
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect start time metrics (co-input) as step s7
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Window.Into()2/Window.Assign as step s8
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/Flatten as step s11
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/GBK as step s12
Nov 26, 2022 1:39:25 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13
Nov 26, 2022 1:39:26 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate as step s14
Nov 26, 2022 1:39:26 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect total bytes as step s15
Nov 26, 2022 1:39:26 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics as step s16
Nov 26, 2022 1:39:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.44.0-SNAPSHOT
Nov 26, 2022 1:39:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-11-26_05_39_26-4717884068579218541?project=apache-beam-testing
Nov 26, 2022 1:39:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2022-11-26_05_39_26-4717884068579218541
Nov 26, 2022 1:39:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-11-26_05_39_26-4717884068579218541
Nov 26, 2022 1:39:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-11-26T13:39:31.282Z: The workflow name is not a valid Cloud
Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring
will be labeled with this modified job name:
load0tests0java110dataflow0v20streaming0cogbk02-jenkins-11-mkey. For the best
monitoring experience, please name your job with a valid Cloud Label. For
details, see:
https://cloud.google.com/compute/docs/labeling-resources#restrictions
Nov 26, 2022 1:39:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:42.621Z: Worker configuration: e2-standard-2 in
us-central1-b.
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.080Z: Expanding SplittableParDo operations into
optimizable parts.
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.114Z: Expanding CollectionToSingleton operations into
optimizable parts.
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.179Z: Expanding CoGroupByKey operations into
optimizable parts.
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.251Z: Expanding SplittableProcessKeyed operations
into optimizable parts.
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.280Z: Expanding GroupByKey operations into streaming
Read/Write steps
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.358Z: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.457Z: Fusing adjacent ParDo, Read, Write, and Flatten
operations
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.518Z: Unzipping flatten CoGroupByKey-Flatten for
input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.548Z: Fusing unzipped copy of
CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into
producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.576Z: Fusing consumer CoGroupByKey/GBK/WriteStream
into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.608Z: Fusing consumer Read
input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read
input/Impulse
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.648Z: Fusing consumer
Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.689Z: Fusing consumer
Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing
into
Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.709Z: Fusing consumer Read
input/ParDo(StripIds)/ParMultiDo(StripIds) into
Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.739Z: Fusing consumer Collect start time metrics
(input)/ParMultiDo(TimeMonitor) into Read
input/ParDo(StripIds)/ParMultiDo(StripIds)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.769Z: Fusing consumer Window.Into()/Window.Assign
into Collect start time metrics (input)/ParMultiDo(TimeMonitor)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.799Z: Fusing consumer
CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into
Window.Into()/Window.Assign
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.836Z: Fusing consumer Read
co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read
co-input/Impulse
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.868Z: Fusing consumer
Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.895Z: Fusing consumer
Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing
into
Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.923Z: Fusing consumer Read
co-input/ParDo(StripIds)/ParMultiDo(StripIds) into
Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.949Z: Fusing consumer Collect start time metrics
(co-input)/ParMultiDo(TimeMonitor) into Read
co-input/ParDo(StripIds)/ParMultiDo(StripIds)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:44.979Z: Fusing consumer Window.Into()2/Window.Assign
into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:45.008Z: Fusing consumer
CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into
Window.Into()2/Window.Assign
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:45.036Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets
into CoGroupByKey/GBK/ReadStream
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:45.061Z: Fusing consumer
CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into
CoGroupByKey/GBK/MergeBuckets
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:45.089Z: Fusing consumer Ungroup and
reiterate/ParMultiDo(UngroupAndReiterate) into
CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:45.117Z: Fusing consumer Collect total
bytes/ParMultiDo(ByteMonitor) into Ungroup and
reiterate/ParMultiDo(UngroupAndReiterate)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:45.151Z: Fusing consumer Collect end time
metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor)
Nov 26, 2022 1:39:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:45.306Z: Running job using Streaming Engine
Nov 26, 2022 1:39:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:46.520Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Nov 26, 2022 1:39:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:39:46.549Z: Starting 5 ****s in us-central1-b...
Nov 26, 2022 1:40:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:40:29.111Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 26, 2022 1:41:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:41:31.996Z: All ****s have finished the startup processes
and began to receive work requests.
Nov 26, 2022 1:41:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-26T13:41:34.950Z: Workers have started successfully.
Nov 26, 2022 2:18:39 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-11-26_05_39_26-4717884068579218541
> Task :sdks:java:testing:load-tests:run FAILED
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=4f87a8db-1072-46e9-b7b9-4de5094df2de,
currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 2044473
log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-2044473.out.log
----- Last 20 lines from daemon log file - daemon-2044473.out.log -----
Nov 26, 2022 2:18:39 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-11-26_05_39_26-4717884068579218541
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:231)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
