See
<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/1028/display/redirect?page=changes>
Changes:
[markliu] Fix command format in Release Guide
------------------------------------------
[...truncated 906.51 KB...]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(6666e8c59543f2f0f4f3ff52e106e585).
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{read, split,
pair_with_one} -> ToKeyedWorkItem (1/2) (d18f46b0c636f9f2430237ae2ca87d6e)
switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(6666e8c59543f2f0f4f3ff52e106e585) [CANCELED]
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task
code ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2) (6c02c614b28e46ee4380123f4d1e8a56).
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(6e0618484e15a3b4f3145910619a5da6) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(8684444789467419bec4a589299d91d2).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(6c02c614b28e46ee4380123f4d1e8a56) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(8684444789467419bec4a589299d91d2) switched from RUNNING to CANCELING.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2) (6c02c614b28e46ee4380123f4d1e8a56).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(6c02c614b28e46ee4380123f4d1e8a56) [CANCELED]
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task
code ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2) (8684444789467419bec4a589299d91d2).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(8684444789467419bec4a589299d91d2) switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2) (8684444789467419bec4a589299d91d2).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(8684444789467419bec4a589299d91d2) [CANCELED]
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(0d9867e4e91112b58cec9ade85bf7885).
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(0d9867e4e91112b58cec9ade85bf7885) switched from RUNNING to CANCELING.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task
code ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2) (0d9867e4e91112b58cec9ade85bf7885).
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(43cdd654b9039cdaca7bdb36fcb4298e).
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(43cdd654b9039cdaca7bdb36fcb4298e) switched from RUNNING to CANCELING.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(0d9867e4e91112b58cec9ade85bf7885) switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2) (0d9867e4e91112b58cec9ade85bf7885).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(0d9867e4e91112b58cec9ade85bf7885) [CANCELED]
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task
code ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2) (43cdd654b9039cdaca7bdb36fcb4298e).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(43cdd654b9039cdaca7bdb36fcb4298e) switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2) (43cdd654b9039cdaca7bdb36fcb4298e).
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
225fbdc3b20b8aa68e80235406b8e5fe.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(43cdd654b9039cdaca7bdb36fcb4298e) [CANCELED]
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
01ca8fe8389a8120f430ee2dc7b37f7e.
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(225fbdc3b20b8aa68e80235406b8e5fe) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
8ee3d890bb087f523a246ee7f4d85cd9.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(01ca8fe8389a8120f430ee2dc7b37f7e) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
a5231833f95a7b95d140bb67be55438d.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
e2d1f610b932d36cdb3a8cdcdf456fd2.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(8ee3d890bb087f523a246ee7f4d85cd9) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
6e57427c256a20c64475937747c0bc42.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
ab91c26f829f024f53eaa218ac9f1d28.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(a5231833f95a7b95d140bb67be55438d) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
6666e8c59543f2f0f4f3ff52e106e585.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(e2d1f610b932d36cdb3a8cdcdf456fd2) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
6c02c614b28e46ee4380123f4d1e8a56.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(6e57427c256a20c64475937747c0bc42) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
8684444789467419bec4a589299d91d2.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
0d9867e4e91112b58cec9ade85bf7885.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(ab91c26f829f024f53eaa218ac9f1d28) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(6666e8c59543f2f0f4f3ff52e106e585) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
43cdd654b9039cdaca7bdb36fcb4298e.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(6c02c614b28e46ee4380123f4d1e8a56) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(8684444789467419bec4a589299d91d2) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(0d9867e4e91112b58cec9ade85bf7885) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(43cdd654b9039cdaca7bdb36fcb4298e) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Try to restart or fail
the job BeamApp-root-0815181710-23a78572 (68a1b7575e902fb5d0149f45def6a4ba) if
no longer possible.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0815181710-23a78572 (68a1b7575e902fb5d0149f45def6a4ba) switched
from state FAILING to FAILED.
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.io.IOException: Received exit code 1 for command 'docker inspect -f
{{.State.Running}}
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'. stderr:
Error: No such object:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4966)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:211)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:202)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:191)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'. stderr:
Error: No such object:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.isContainerRunning(DockerCommand.java:112)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:160)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:178)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:162)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
... 10 more
Suppressed: java.io.IOException: Received exit code 1 for command
'docker kill 76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'.
stderr: Error response from daemon: Cannot kill container:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44: No such
container: 76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:134)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:174)
... 20 more
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Could not restart the
job BeamApp-root-0815181710-23a78572 (68a1b7575e902fb5d0149f45def6a4ba) because
the restart strategy prevented it.
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.io.IOException: Received exit code 1 for command 'docker inspect -f
{{.State.Running}}
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'. stderr:
Error: No such object:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4966)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:211)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:202)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:191)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'. stderr:
Error: No such object:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.isContainerRunning(DockerCommand.java:112)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:160)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:178)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:162)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
... 10 more
Suppressed: java.io.IOException: Received exit code 1 for command
'docker kill 76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'.
stderr: Error response from daemon: Cannot kill container:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44: No such
container: 76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:134)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:174)
... 20 more
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job 68a1b7575e902fb5d0149f45def6a4ba.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
68a1b7575e902fb5d0149f45def6a4ba reached globally terminal state FAILED.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0815181710-23a78572(68a1b7575e902fb5d0149f45def6a4ba).
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
31758cc8fbcc22884fe0104e81e99807: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher6d06ae02-4a76-474f-ac62-5c3384662f04.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcher6d06ae02-4a76-474f-ac62-5c3384662f04.
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-6e9d1775-9aa3-497b-923a-fa86c4f61c0a
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager b96b5312d28c8936fb56b17b703c4cd0@akka://flink/user/jobmanager_1 for
job 68a1b7575e902fb5d0149f45def6a4ba from the resource manager.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
68a1b7575e902fb5d0149f45def6a4ba with leader id
b96b5312d28c8936fb56b17b703c4cd0 lost leadership.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-15] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher6d06ae02-4a76-474f-ac62-5c3384662f04.
[ForkJoinPool.commonPool-worker-4] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-4] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-18] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:42455
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] ERROR
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation - Error during
job invocation
BeamApp-root-0815181710-23a78572_27778b48-3a02-442b-9ff7-8f1ab81f5e5a.
org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at
org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)
at
org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:632)
at
org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123)
at
org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator$StreamingTranslationContext.execute(FlinkStreamingPortablePipelineTranslator.java:171)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:92)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:68)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:78)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by:
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.io.IOException: Received exit code 1 for command 'docker inspect -f
{{.State.Running}}
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'. stderr:
Error: No such object:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4966)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:211)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:202)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:191)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
... 1 more
Caused by: java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'. stderr:
Error: No such object:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.isContainerRunning(DockerCommand.java:112)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:160)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:178)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:162)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
... 10 more
Suppressed: java.io.IOException: Received exit code 1 for command
'docker kill 76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'.
stderr: Error response from daemon: Cannot kill container:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44: No such
container: 76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:134)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:174)
... 20 more
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_3b16bd98-0ced-43db-b919-ff226fe2889e/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_3b16bd98-0ced-43db-b919-ff226fe2889e/
ERROR:root:java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'. stderr:
Error: No such object:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
INFO:root:Job state changed to FAILED
Traceback (most recent call last):
File "/usr/lib/python3.5/runpy.py", line 184, in _run_module_as_main
"__main__", mod_spec)
File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
exec(code, run_globals)
File
"<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/apache_beam/examples/wordcount.py";,>
line 135, in <module>
run()
File
"<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/apache_beam/examples/wordcount.py";,>
line 115, in run
result.wait_until_finish()
File
"<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 455, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
BeamApp-root-0815181710-23a78572_27778b48-3a02-442b-9ff7-8f1ab81f5e5a failed in
state FAILED: java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44'. stderr:
Error: No such object:
76b3ca2dbdd98a441e075b702cc8a555423624d0bd326491b265cc9215c61e44
> Task :sdks:python:test-suites:portable:py35:portableWordCountStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:portableWordCountBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:portableWordCountStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 47s
80 actionable tasks: 62 executed, 15 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/4xpgjbhx5nojy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
