See
<https://ci-beam.apache.org/job/beam_PerformanceTests_JDBC/7384/display/redirect>
Changes:
------------------------------------------
[...truncated 372.20 KB...]
INFO: 2023-02-24T14:09:38.656Z: Fusing consumer
JdbcIOIT.GenerateRecordsStream/PeriodicSequence/ParDo(PeriodicSequence)/ParMultiDo(PeriodicSequence)/Assign
unique key/AddKeys/Map into
JdbcIOIT.GenerateRecordsStream/PeriodicSequence/ParDo(PeriodicSequence)/ParMultiDo(PeriodicSequence)/Explode
windows
Feb 24, 2023 2:09:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.690Z: Fusing consumer
s7/GroupByKeyRaw/WriteStream into
JdbcIOIT.GenerateRecordsStream/PeriodicSequence/ParDo(PeriodicSequence)/ParMultiDo(PeriodicSequence)/Assign
unique key/AddKeys/Map
Feb 24, 2023 2:09:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.718Z: Fusing consumer s7/SplittableProcess into
s7/GroupByKeyRaw/ReadStream
Feb 24, 2023 2:09:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.752Z: Fusing consumer
JdbcIOIT.GenerateRecordsStream/Add dumb key into s7/SplittableProcess
Feb 24, 2023 2:09:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.786Z: Fusing consumer
JdbcIOIT.GenerateRecordsStream/ParDo(DeterministicallyConstructTestRow) into
JdbcIOIT.GenerateRecordsStream/ParDo(EmitSequence)
Feb 24, 2023 2:09:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.821Z: Fusing consumer ParDo(TimeMonitor) into
JdbcIOIT.GenerateRecordsStream/ParDo(DeterministicallyConstructTestRow)
Feb 24, 2023 2:09:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.850Z: Fusing consumer
JdbcIO.Write/WithKeys/AddKeys/Map into ParDo(TimeMonitor)
Feb 24, 2023 2:09:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.872Z: Fusing consumer
JdbcIO.Write/GroupIntoBatches.WithShardedKey/GroupIntoBatches.WithShardedKey/MapElements/Map
into JdbcIO.Write/WithKeys/AddKeys/Map
Feb 24, 2023 2:09:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.897Z: Fusing consumer
JdbcIO.Write/Values/Values/Map into
JdbcIO.Write/GroupIntoBatches.WithShardedKey/GroupIntoBatches.WithShardedKey/GroupIntoBatches/ParDo(GroupIntoBatches)
Feb 24, 2023 2:09:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:38.927Z: Fusing consumer JdbcIO.Write/ParDo(Write)
into JdbcIO.Write/Values/Values/Map
Feb 24, 2023 2:09:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:39.046Z: Running job using Streaming Engine
Feb 24, 2023 2:09:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:40.286Z: Starting 5 ****s in us-central1-b...
Feb 24, 2023 2:09:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:09:44.568Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Feb 24, 2023 2:10:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:10:28.810Z: Autoscaling: Raised the number of ****s to
5 so that the pipeline can catch up with its backlog and keep up with its input
rate.
Feb 24, 2023 2:11:02 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:11:01.504Z: Workers have started successfully.
Feb 24, 2023 2:11:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:11:26.360Z: All ****s have finished the startup
processes and began to receive work requests.
Feb 24, 2023 2:14:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:14:37.402Z: Cleaning up.
Feb 24, 2023 2:14:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:14:37.481Z: Stopping **** pool...
Feb 24, 2023 2:14:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:14:37.561Z: Stopping **** pool...
Feb 24, 2023 2:16:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:16:48.362Z: Autoscaling: Reduced the number of ****s to
0 based on low average **** CPU utilization, and the pipeline having
sufficiently low backlog and keeping up with input rate.
Feb 24, 2023 2:16:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:16:48.407Z: Worker pool stopped.
Feb 24, 2023 2:16:54 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2023-02-24_06_09_10-7665071307506373983 finished with status DONE.
org.apache.beam.sdk.io.jdbc.JdbcIOIT > testWriteWithWriteResults STANDARD_ERROR
Feb 24, 2023 2:16:55 PM org.apache.beam.runners.dataflow.DataflowRunner
validateSdkContainerImageOptions
WARNING: Prefer --sdkContainerImage over deprecated legacy option
--****HarnessContainerImage.
Feb 24, 2023 2:16:55 PM
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory
tryCreateDefaultBucket
INFO: No tempLocation specified, attempting to use default bucket:
dataflow-staging-us-central1-844138762903
Feb 24, 2023 2:16:55 PM
org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler
handleResponse
WARNING: Request failed with code 409, performed 0 retries due to
IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP
framework says request can be retried, (caller responsible for retrying):
https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
Feb 24, 2023 2:16:55 PM
org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory
create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Feb 24, 2023 2:16:56 PM org.apache.beam.runners.dataflow.DataflowRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 292 files. Enable logging at DEBUG level to see
which files will be staged.
Feb 24, 2023 2:16:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Feb 24, 2023 2:16:58 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 293 files from PipelineOptions.filesToStage to staging
location to prepare for execution.
Feb 24, 2023 2:16:58 PM
org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes
forFileToStage
INFO: Staging custom dataflow-****.jar as
beam-runners-google-cloud-dataflow-java-legacy-****-2.47.0-SNAPSHOT-np3xmcKCqJHv-yTgtYGNytr3qHzv25uov7WNup-oO9c.jar
Feb 24, 2023 2:16:59 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 293 files cached, 0 files newly uploaded in 0
seconds
Feb 24, 2023 2:16:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to
gs://dataflow-staging-us-central1-844138762903/temp/staging/
Feb 24, 2023 2:16:59 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <196552 bytes, hash
11c02ef6a2272548ca2c7f400276e8b721acfccac218c170a4b2f961fd9fd5c6> to
gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-EcAu9qInJUjKLH9AAnbotyGs_MrCGMFwpLL5Yf2f1cY.pb
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding GenerateSequence/Read(BoundedCountingSource) as step s1
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding FlatMapElements/FlatMap as step s2
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding JdbcIO.WriteWithResults/ParDo(Anonymous) as step s3
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding JdbcIO.WriteWithResults/ParDo(Write) as step s4
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Combine.globally(Count)/WithKeys/AddKeys/Map as step s5
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Combine.globally(Count)/Combine.perKey(Count)/GroupByKey as
step s6
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues as step s7
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Combine.globally(Count)/Values/Values/Map as step s8
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) as
step s9
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Combine.globally(Count)/View.AsIterable/CreateDataflowView as
step s10
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Combine.globally(Count)/CreateVoid/Read(CreateSource) as step
s11
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Combine.globally(Count)/ProduceDefault as step s12
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Combine.globally(Count)/Flatten.PCollections as step s13
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) as step
s14
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(ToSingletonIterables) as step s15
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Create.Values/Read(CreateSource) as
step s16
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Flatten.PCollections as step s17
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Window.Into()/Flatten.PCollections as
step s18
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/WithKeys/AddKeys/Map as step s19
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/GroupByKey as step s20
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Values/Values/Map as step s21
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(Concat) as step s22
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GetPane/Map as step s23
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/RunChecks as step s24
Feb 24, 2023 2:17:01 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/VerifyAssertions/ParDo(DefaultConclude) as step s25
Feb 24, 2023 2:17:01 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.47.0-SNAPSHOT
Feb 24, 2023 2:17:02 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-02-24_06_17_01-2755363159681526455?project=apache-beam-testing
Feb 24, 2023 2:17:02 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-02-24_06_17_01-2755363159681526455
Feb 24, 2023 2:17:02 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2023-02-24_06_17_01-2755363159681526455
Feb 24, 2023 2:17:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:18.989Z: Worker configuration: e2-standard-2 in
us-central1-b.
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.370Z: Expanding CoGroupByKey operations into
optimizable parts.
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.449Z: Expanding GroupByKey operations into
optimizable parts.
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.477Z: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.562Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.618Z: Fusing adjacent ParDo, Read, Write, and
Flatten operations
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.644Z: Elided trivial flatten
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.669Z: Unzipping flatten s17 for input
s15.org.apache.beam.sdk.values.PCollection.<init>:405#dda1859988aa034b
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.696Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map, through flatten
PAssert$0/GroupGlobally/Flatten.PCollections, into producer
PAssert$0/GroupGlobally/ParDo(ToSingletonIterables)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.723Z: Unzipping flatten s13 for input
s12.org.apache.beam.sdk.values.PCollection.<init>:405#56b99bb29b40d50c
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.757Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous), through flatten
Combine.globally(Count)/Flatten.PCollections, into producer
Combine.globally(Count)/ProduceDefault
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.790Z: Fusing consumer
PAssert$0/GroupGlobally/GroupByKey/Write into
PAssert$0/GroupGlobally/GroupByKey/Reify
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.823Z: Fusing consumer
PAssert$0/GroupGlobally/GroupByKey/GroupByWindow into
PAssert$0/GroupGlobally/GroupByKey/Read
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.856Z: Fusing consumer
PAssert$0/GroupGlobally/Values/Values/Map into
PAssert$0/GroupGlobally/GroupByKey/GroupByWindow
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.890Z: Fusing consumer
PAssert$0/GroupGlobally/ParDo(Concat) into
PAssert$0/GroupGlobally/Values/Values/Map
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.923Z: Fusing consumer PAssert$0/GetPane/Map into
PAssert$0/GroupGlobally/ParDo(Concat)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.956Z: Fusing consumer PAssert$0/RunChecks into
PAssert$0/GetPane/Map
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:20.990Z: Fusing consumer
PAssert$0/VerifyAssertions/ParDo(DefaultConclude) into PAssert$0/RunChecks
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.025Z: Unzipping flatten s17-u31 for input
s19.org.apache.beam.sdk.values.PCollection.<init>:405#b13a1d5940730ba6-c29
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.047Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/GroupByKey/Reify, through flatten
PAssert$0/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.081Z: Unzipping flatten s13-u36 for input
s14.org.apache.beam.sdk.values.PCollection.<init>:405#f8b74da6be94df5a-c34
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.114Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/ParDo(ToSingletonIterables), through flatten
Combine.globally(Count)/Flatten.PCollections/Unzipped-1, into producer
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.136Z: Fusing consumer
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) into
Combine.globally(Count)/Values/Values/Map
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.173Z: Fusing consumer
Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into
Combine.globally(Count)/Values/Values/Map
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.205Z: Fusing consumer
Combine.globally(Count)/ProduceDefault into
Combine.globally(Count)/CreateVoid/Read(CreateSource)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.238Z: Fusing consumer
PAssert$0/GroupGlobally/ParDo(ToSingletonIterables) into
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.272Z: Fusing consumer FlatMapElements/FlatMap
into GenerateSequence/Read(BoundedCountingSource)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.298Z: Fusing consumer
JdbcIO.WriteWithResults/ParDo(Anonymous) into FlatMapElements/FlatMap
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.327Z: Fusing consumer
JdbcIO.WriteWithResults/ParDo(Write) into
JdbcIO.WriteWithResults/ParDo(Anonymous)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.359Z: Fusing consumer
Combine.globally(Count)/WithKeys/AddKeys/Map into
JdbcIO.WriteWithResults/ParDo(Write)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.383Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
into Combine.globally(Count)/WithKeys/AddKeys/Map
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.415Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.447Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.474Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.499Z: Fusing consumer
Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.524Z: Fusing consumer
Combine.globally(Count)/Values/Values/Map into
Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.558Z: Fusing consumer
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.591Z: Fusing consumer
PAssert$0/GroupGlobally/GroupByKey/Reify into
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:21.941Z: Executing operation
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:22.023Z: Starting 5 ****s in us-central1-b...
Feb 24, 2023 2:17:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:22.243Z: Finished operation
Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Feb 24, 2023 2:17:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:17:22.360Z: Executing operation
GenerateSequence/Read(BoundedCountingSource)+FlatMapElements/FlatMap+JdbcIO.WriteWithResults/ParDo(Anonymous)+JdbcIO.WriteWithResults/ParDo(Write)+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Feb 24, 2023 2:18:03 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:18:01.428Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Feb 24, 2023 2:18:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:18:33.981Z: Workers have started successfully.
Feb 24, 2023 2:18:57 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-02-24T14:18:56.443Z: All ****s have finished the startup
processes and began to receive work requests.
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-11' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy141.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException: Unexpected termination of the channel
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:75)
Caused by: java.io.EOFException
at
java.base/java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2911)
at
java.base/java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3406)
at
java.base/java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:932)
at
java.base/java.io.ObjectInputStream.<init>(ObjectInputStream.java:375)
at
hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:49)
at hudson.remoting.Command.readFrom(Command.java:142)
at hudson.remoting.Command.readFrom(Command.java:128)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-11 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
