See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/56/display/redirect?page=changes>
Changes: [noreply] Remove build status from PR (#16902) ------------------------------------------ [...truncated 2.83 MB...] INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:string_utf8:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:kv:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bool:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:varint:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:double:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:timer:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:interval_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:length_prefix:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:global_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:param_windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:state_backed_iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:custom_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:row:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:sharded_key:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:progress_reporting:v0"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:harness_monitoring_infos:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:worker_status:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:combinefn:packed_python:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.38.0.dev"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:to_string:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:244 No more requests from control plane INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:245 SDK Harness waiting for in-flight requests to complete INFO apache_beam.runners.worker.data_plane:data_plane.py:782 Closing all cached grpc data channels. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:826 Closing all cached gRPC state handlers. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:257 Done consuming work. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.runners.worker.statecache:statecache.py:172 Creating state cache with size 0 INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:164 Creating insecure control channel for localhost:37311. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:172 Control channel established. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:215 Initializing SDKHarness with unbounded number of workers. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 85-1' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 85-2' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:807 Creating insecure state channel for localhost:46329. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:814 State channel established. INFO apache_beam.runners.worker.data_plane:data_plane.py:750 Creating client data channel for localhost:44341 INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:external:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'payload: "\\n\\021\\n\\017localhost:37787"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bytes:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:string_utf8:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:kv:v1"' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:244 No more requests from control plane INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bool:v1"' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:245 SDK Harness waiting for in-flight requests to complete INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:varint:v1"' INFO apache_beam.runners.worker.data_plane:data_plane.py:782 Closing all cached grpc data channels. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:double:v1"' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:826 Closing all cached gRPC state handlers. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:timer:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:interval_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:length_prefix:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:global_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:param_windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:state_backed_iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:custom_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:row:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:sharded_key:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:progress_reporting:v0"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:harness_monitoring_infos:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:worker_status:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:combinefn:packed_python:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.38.0.dev"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:to_string:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:257 Done consuming work. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Error cleaning up servers urn: "beam:env:external:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'payload: "\\n\\021\\n\\017localhost:37787"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bytes:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:string_utf8:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:kv:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bool:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:varint:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:double:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:timer:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:interval_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:length_prefix:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:global_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:param_windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:state_backed_iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:custom_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:row:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:sharded_key:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:progress_reporting:v0"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:harness_monitoring_infos:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:worker_status:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:combinefn:packed_python:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.38.0.dev"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:to_string:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'java.lang.IllegalStateException: call already closed' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.grpc.v1p43p2.com.google.common.base.Preconditions.checkState(Preconditions.java:510)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:214)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:207)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.grpc.v1p43p2.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:395)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:63)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.sdk.fn.server.GrpcFnServer.close(GrpcFnServer.java:156)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:212)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:319)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:212)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:188)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:177)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:208)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.spark.translation.SparkExecutableStageFunction.$closeResource(SparkExecutableStageFunction.java:210)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.spark.translation.SparkExecutableStageFunction.call(SparkExecutableStageFunction.java:210)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.beam.runners.spark.translation.SparkExecutableStageFunction.call(SparkExecutableStageFunction.java:81)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.api.java.JavaRDDLike$$anonfun$fn$4$1.apply(JavaRDDLike.scala:153)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.api.java.JavaRDDLike$$anonfun$fn$4$1.apply(JavaRDDLike.scala:153)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$23.apply(RDD.scala:823)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$23.apply(RDD.scala:823)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:346)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.RDD.iterator(RDD.scala:310)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:346)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.RDD.iterator(RDD.scala:310)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:346)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.rdd.RDD.iterator(RDD.scala:310)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.scheduler.Task.run(Task.scala:123)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:411)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:417)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tat java.lang.Thread.run(Thread.java:748)' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0219061341-c43d8771_9ebd8a92-4ea6-4555-b4a3-866acfc7ed31: Pipeline translated successfully. Computing outputs' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.runners.worker.statecache:statecache.py:172 Creating state cache with size 0 INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:164 Creating insecure control channel for localhost:42887. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:172 Control channel established. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:215 Initializing SDKHarness with unbounded number of workers. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 86-1' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 86-2' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:807 Creating insecure state channel for localhost:40913. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:814 State channel established. INFO apache_beam.runners.worker.data_plane:data_plane.py:750 Creating client data channel for localhost:33201 INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:external:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'payload: "\\n\\021\\n\\017localhost:37787"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bytes:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:string_utf8:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:kv:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bool:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:varint:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:double:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:timer:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:interval_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:length_prefix:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:global_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:param_windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:state_backed_iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:custom_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:row:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:sharded_key:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:progress_reporting:v0"' ERROR apache_beam.runners.worker.data_plane:data_plane.py:641 Failed to read inputs in the data plane. Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 634, in _read_inputs for elements in elements_iterator: File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__ return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next raise self grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.CANCELLED details = "Multiplexer hanging up" debug_error_string = "{"created":"@1645251232.882311236","description":"Error received from peer ipv6:[::1]:33201","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Multiplexer hanging up","grpc_status":1}" > INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:harness_monitoring_infos:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:worker_status:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:combinefn:packed_python:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.38.0.dev"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:to_string:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:244 No more requests from control plane INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:245 SDK Harness waiting for in-flight requests to complete INFO apache_beam.runners.worker.data_plane:data_plane.py:782 Closing all cached grpc data channels. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:826 Closing all cached gRPC state handlers. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:257 Done consuming work. INFO apache_beam.runners.worker.statecache:statecache.py:172 Creating state cache with size 0 INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:164 Creating insecure control channel for localhost:36339. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:172 Control channel established. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:215 Initializing SDKHarness with unbounded number of workers. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 87-1' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 87-2' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:807 Creating insecure state channel for localhost:36577. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:814 State channel established. INFO apache_beam.runners.worker.data_plane:data_plane.py:750 Creating client data channel for localhost:37377 INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/19 06:13:52 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.' INFO root:bigquery_tools.py:625 Job status: RUNNING Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
