See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/238/display/redirect?page=changes>
Changes: [Carl Yeksigian] Cache bucket matcher regex in GcsPath [benjamin.gonzalez] [BEAM-12672] Retry flaky tests [benjamin.gonzalez] [BEAM-12672] Fix spotlessApply [laraschmidt] Fixing the log line to properly handle a large allowed skew. [n] BEAM-13159 Update embedded-redis dependency [n] address comments [noreply] Minor: Add 2.38.0 section to CHANGES.md (#16804) [noreply] [BEAM-12000] Fix typo in portable Python job definition (#16812) [noreply] [BEAM-12164]: Fixes SpannerChangeStreamIT (#16806) [noreply] [BEAM-12572] Fix failures in python examples tests (#16781) [noreply] [BEAM-13921] filter out debeziumIO test for spark runner (#16815) [noreply] [BEAM-13855] Skip SpannerChangeStreamOrderedWithinKeyIT and [noreply] [BEAM-13679] playground - move quick start category to the top (#16808) [noreply] Update license_script.sh (#16789) [noreply] [BEAM-13908] [Coverage] Better testing coverage for gcpopts (#16816) [noreply] Merge pull request #16809 from [BEAM-12164] Added integration test for [noreply] [BEAM-4032]Support staging binary distributions of dependency packages ------------------------------------------ [...truncated 63.70 KB...] Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.713Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.744Z: Fusing unzipped copy of CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.776Z: Fusing consumer CoGroupByKey/GBK/WriteStream into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.810Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.846Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.881Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.907Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.935Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:40.970Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.005Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.031Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.054Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.084Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.118Z: Fusing consumer Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.138Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.165Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.194Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.228Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets into CoGroupByKey/GBK/ReadStream Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.259Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/MergeBuckets Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.285Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.313Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.340Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Feb 11, 2022 6:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:41.761Z: Starting 5 ****s in us-central1-b... Feb 11, 2022 6:16:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:16:51.294Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 11, 2022 6:17:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:17:28.020Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 11, 2022 6:18:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:18:26.835Z: Workers have started successfully. Feb 11, 2022 6:18:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-11T18:18:26.870Z: Workers have started successfully. Feb 11, 2022 6:19:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-02-11T18:19:56.995Z: generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 Feb 11, 2022 6:19:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-02-11T18:19:57.060Z: generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 Feb 11, 2022 6:19:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-02-11T18:19:57.345Z: generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 Feb 11, 2022 6:19:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-02-11T18:19:58.170Z: generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 generic::internal: The work item requesting state read is no longer valid on the backend. The work has already completed or will be retried. This is expected during autoscaling events. passed through: ==> dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688 ==> dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214 Build timed out (after 240 minutes). Marking the build as aborted. FATAL: command execution failed hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@365b4851:apache-beam-jenkins-15": Remote call on apache-beam-jenkins-15 failed. The channel is closing down or has closed down at hudson.remoting.Channel.call(Channel.java:994) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286) at com.sun.proxy.$Proxy128.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1211) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1203) at hudson.Launcher$ProcStarter.join(Launcher.java:523) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:803) at hudson.model.Build$BuildExecution.build(Build.java:197) at hudson.model.Build$BuildExecution.doRun(Build.java:163) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:513) at hudson.model.Run.execute(Run.java:1906) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) Caused by: java.io.IOException at hudson.remoting.Channel.close(Channel.java:1499) at hudson.remoting.Channel.close(Channel.java:1455) at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:884) at hudson.slaves.SlaveComputer.access$100(SlaveComputer.java:110) at hudson.slaves.SlaveComputer$2.run(SlaveComputer.java:765) at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28) at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-15 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
