See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2715/display/redirect>
Changes: ------------------------------------------ [...truncated 834.53 KB...] [GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupReduce (GroupReduce at CoGBK) (1/1) (ef5640e49ec472b109343847b95bc3dd) [DEPLOYING]. [GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupReduce (GroupReduce at CoGBK) (1/1) (ef5640e49ec472b109343847b95bc3dd) [DEPLOYING]. [GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (ef5640e49ec472b109343847b95bc3dd) switched from DEPLOYING to RUNNING. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (ef5640e49ec472b109343847b95bc3dd) switched from DEPLOYING to RUNNING. [CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (f0c3fdd2cf6b7bbc734b89e2dbc03bf0) switched from RUNNING to FINISHED. [CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (f0c3fdd2cf6b7bbc734b89e2dbc03bf0). [CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (f0c3fdd2cf6b7bbc734b89e2dbc03bf0) [FINISHED] [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) f0c3fdd2cf6b7bbc734b89e2dbc03bf0. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (f0c3fdd2cf6b7bbc734b89e2dbc03bf0) switched from RUNNING to FINISHED. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) switched from CREATED to SCHEDULED. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) switched from SCHEDULED to DEPLOYING. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (attempt #0) to 416cec6e-7caf-4ce8-a472-af50c1806b83 @ localhost (dataPort=-1) [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1). [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) switched from CREATED to DEPLOYING. [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) [DEPLOYING] [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) [DEPLOYING]. [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) [DEPLOYING]. [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) switched from DEPLOYING to RUNNING. [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) exceeded the 80 characters length limit and was truncated. [flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) switched from DEPLOYING to RUNNING. [GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (ef5640e49ec472b109343847b95bc3dd) switched from RUNNING to FINISHED. [GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupReduce (GroupReduce at CoGBK) (1/1) (ef5640e49ec472b109343847b95bc3dd). [GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupReduce (GroupReduce at CoGBK) (1/1) (ef5640e49ec472b109343847b95bc3dd) [FINISHED] [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) ef5640e49ec472b109343847b95bc3dd. [flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (ef5640e49ec472b109343847b95bc3dd) switched from RUNNING to FINISHED. [grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583928332113576442_88e64b20-4b8a-4c82-84a9-28d9a3777f08/MANIFEST [grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583928332113576442_88e64b20-4b8a-4c82-84a9-28d9a3777f08/MANIFEST -> 1 artifacts [grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 18-1 [grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected. [grpc-default-executor-2] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:321 - Connecting via grpc @ localhost:36165 ... [grpc-default-executor-2] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:321 - Connecting via grpc @ localhost:35475 ... [grpc-default-executor-0] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:321 - Connecting via grpc @ localhost:41093 ... [grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected. [grpc-default-executor-0] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:212 - DataSource: 1 elements in 3081233 ns [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1" payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200311-120225" capabilities: "beam:protocol:progress_reporting:v0" capabilities: "beam:protocol:multi_core_bundle_processing:v1" capabilities: "beam:coder:bytes:v1" capabilities: "beam:coder:bool:v1" capabilities: "beam:coder:varint:v1" capabilities: "beam:coder:double:v1" capabilities: "beam:coder:length_prefix:v1" capabilities: "beam:coder:kv:v1" capabilities: "beam:coder:iterable:v1" capabilities: "beam:coder:state_backed_iterable:v1" capabilities: "beam:coder:windowed_value:v1" capabilities: "beam:coder:global_window:v1" capabilities: "beam:coder:interval_window:v1" [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown. [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint. [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container 4af57cb618c0f91cc9926fb8bd6596cbcb2b7b6090000069d6d3d4dfb9d84554. Logs: 2020/03/11 12:05:41 Provision info: pipeline_options:<fields:<key:"beam:option:app_name:v1" value:<string_value:"go-job-7-1583928332113576442" > > fields:<key:"beam:option:experiments:v1" value:<list_value:<values:<string_value:"beam_fn_api" > > > > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[local]" > > fields:<key:"beam:option:go_options:v1" value:<struct_value:<fields:<key:"options" value:<struct_value:<fields:<key:"hooks" value:<string_value:"{}" > > > > > > > > fields:<key:"beam:option:job_name:v1" value:<string_value:"go0job0701583928332113576442-jenkins-0311120532-e505e97f" > > fields:<key:"beam:option:options_id:v1" value:<number_value:7 > > fields:<key:"beam:option:output_executable_path:v1" value:<null_value:NULL_VALUE > > fields:<key:"beam:option:runner:v1" value:<null_value:NULL_VALUE > > > retrieval_token:"/tmp/beam-artifact-staging/go-job-7-1583928332113576442_88e64b20-4b8a-4c82-84a9-28d9a3777f08/MANIFEST" logging_endpoint:<url:"localhost:35475" > artifact_endpoint:<url:"localhost:46807" > control_endpoint:<url:"localhost:36165" > 2020/03/11 12:05:41 Initializing Go harness: /opt/apache/beam/boot --id=18-1 --provision_endpoint=localhost:33483 Worker exited successfully! Failed to send message: EOF severity:WARN timestamp:<seconds:1583928342 nanos:164650315 > message:"forcing DataChannel[localhost:41093] reconnection on port {localhost:41093} due to rpc error: code = Canceled desc = Multiplexer hanging up" instruction_id:"2" log_location:"<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:119" Remote logging failed: EOF. Retrying in 5 sec ... [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error cleaning up servers urn: "beam:env:docker:v1" payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200311-120225" capabilities: "beam:protocol:progress_reporting:v0" capabilities: "beam:protocol:multi_core_bundle_processing:v1" capabilities: "beam:coder:bytes:v1" capabilities: "beam:coder:bool:v1" capabilities: "beam:coder:varint:v1" capabilities: "beam:coder:double:v1" capabilities: "beam:coder:length_prefix:v1" capabilities: "beam:coder:kv:v1" capabilities: "beam:coder:iterable:v1" capabilities: "beam:coder:state_backed_iterable:v1" capabilities: "beam:coder:windowed_value:v1" capabilities: "beam:coder:global_window:v1" capabilities: "beam:coder:interval_window:v1" java.io.IOException: Received exit code 1 for command 'docker rm 4af57cb618c0f91cc9926fb8bd6596cbcb2b7b6090000069d6d3d4dfb9d84554'. stderr: Error: No such container: 4af57cb618c0f91cc9926fb8bd6596cbcb2b7b6090000069d6d3d4dfb9d84554 at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234) at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168) at org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163) at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95) at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:479) at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:479) at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:494) at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1600(DefaultJobBundleFactory.java:432) at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:169) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909) at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:259) at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43) at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208) at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184) at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173) at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132) at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44) at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204) at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204) at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:291) at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43) at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508) at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530) at java.lang.Thread.run(Thread.java:748) [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) switched from RUNNING to FINISHED. [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3). [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) switched from CREATED to SCHEDULED. [MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) [FINISHED] [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) switched from SCHEDULED to DEPLOYING. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) 902ed53aedfb40e24798bb506ba746e3. [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (DiscardingOutput) (1/1) (attempt #0) to 416cec6e-7caf-4ce8-a472-af50c1806b83 @ localhost (dataPort=-1) [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (902ed53aedfb40e24798bb506ba746e3) switched from RUNNING to FINISHED. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (DiscardingOutput) (1/1). [DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) switched from CREATED to DEPLOYING. [DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) [DEPLOYING] [DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) [DEPLOYING]. [DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) [DEPLOYING]. [DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) switched from DEPLOYING to RUNNING. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) switched from DEPLOYING to RUNNING. [DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) switched from RUNNING to FINISHED. [DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f). [DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) [FINISHED] [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) 815659e1b337e42c6bc98a27a4ef513f. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (815659e1b337e42c6bc98a27a4ef513f) switched from RUNNING to FINISHED. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job go0job0701583928332113576442-jenkins-0311120532-e505e97f (1771f1d01229360c2098f2f9e73e269e) switched from state RUNNING to FINISHED. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 1771f1d01229360c2098f2f9e73e269e reached globally terminal state FINISHED. [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job go0job0701583928332113576442-jenkins-0311120532-e505e97f(1771f1d01229360c2098f2f9e73e269e). [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool. [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 88aee5a30d6e1b2079cae9b1ef5373fd: JobManager is shutting down.. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=16274}, allocationId: 30522b6c4ff7fc3c9cbbe2cd784f12ec, jobId: 1771f1d01229360c2098f2f9e73e269e). [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 83ff8083da482f689ca6bcfde5af42b6@akka://flink/user/jobmanager_13 for job 1771f1d01229360c2098f2f9e73e269e from the resource manager. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 1771f1d01229360c2098f2f9e73e269e from job leader monitoring. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1771f1d01229360c2098f2f9e73e269e. [flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster [flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1771f1d01229360c2098f2f9e73e269e. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job 1771f1d01229360c2098f2f9e73e269e because it is not registered. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_12. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection 88aee5a30d6e1b2079cae9b1ef5373fd. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection 416cec6e-7caf-4ce8-a472-af50c1806b83 because: The TaskExecutor is shutting down. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-io-76b6fced-e122-4302-ad07-02fc356de6ac [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-c08edb31-2331-4d77-a804-dccce4ab0b0c [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory /tmp/flink-dist-cache-611821da-4e83-48dd-8f58-9452142265d2 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_12. [ForkJoinPool.commonPool-worker-11] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui [ForkJoinPool.commonPool-worker-11] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed.. [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher. [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager. [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator. [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher. [flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service. [flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. [flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down. [flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service. [flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:44269 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service. [flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 10056 msecs [flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values: [flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers : MetricQueryResults(Counters(n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n1}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n5}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n3}: 1, n9/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n9}: 1)) [flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/go-job-7-1583928332113576442_88e64b20-4b8a-4c82-84a9-28d9a3777f08/MANIFEST has 1 artifact locations [flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/go-job-7-1583928332113576442_88e64b20-4b8a-4c82-84a9-28d9a3777f08/ 2020/03/11 12:05:43 Job state: DONE 2020/03/11 12:05:43 Test flatten:flatten completed 2020/03/11 12:05:43 Result: 1 tests failed if [[ ! -z "$JOB_PORT" ]]; then # Shut down the job server kill %1 || echo "Failed to shut down job server" fi # Delete the container locally and remotely docker rmi $CONTAINER:$TAG || echo "Failed to remove container" Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200311-120225 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fff8aa45e5fb831b00a1cd272f70abfca14201b4499a93eec6f2064c506f9866 Deleted: sha256:35e41b2cfd9eea9fdcd5e89e8b0604c77c91a1643030e4006a95a52ee2461eb8 Deleted: sha256:840d7ce965573b3019d9fc523171778bc0f9b1d5c726343c1c0f4d4eeae5859d Deleted: sha256:858af1a5eec795e1c7744692db075f5589667f7ca5e105576ce16852394e0419 Deleted: sha256:ed32a5190844388f86bbe7cfed46a22ea590c4a7d738fd3022daf7c4cf03ad05 Deleted: sha256:defdd476277af953615323405c0726407a97041322d76a8f2fc40121af724a8e Deleted: sha256:dfb0439cb31cdf06f7ba57ee98ac2fd7b83a494c52dbb7b4d887f82122cc0b6a Deleted: sha256:294d121c7185c602bdd16a957c8f2fb230181819ba14fd3c281226e56e749001 Deleted: sha256:0a25c39328fa883aeea81c50db5effeaa618874fde5accc6c521da62f1fbbba8 Deleted: sha256:84efe69992cdf418e602bfb5f858a33f57f884d1052963ef5a990ca007e27eaf Deleted: sha256:d9c64b8a024a6d8e15556f1e4cfbe2e3ae4426a37d199b11585807616274d1db gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container" Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fff8aa45e5fb831b00a1cd272f70abfca14201b4499a93eec6f2064c506f9866 Associated tags: - 20200311-120225 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200311-120225 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200311-120225]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fff8aa45e5fb831b00a1cd272f70abfca14201b4499a93eec6f2064c506f9866]. # Clean up tempdir rm -rf $TMPDIR if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then echo ">>> SUCCESS" else echo ">>> FAILURE" fi exit $TEST_EXIT_CODE >>> FAILURE > Task :sdks:go:test:flinkValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59 * What went wrong: Execution failed for task ':sdks:go:test:flinkValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 5m 25s 67 actionable tasks: 49 executed, 18 from cache Publishing build scan... https://gradle.com/s/5suafg7v3csc4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
