See
<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/1033/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-7802] Make SQL example slightly simpler
[iemejia] [BEAM-7802] Inline AvroUtils methods to have only one public AvroUtils
[iemejia] [BEAM-7802] Fix minor issues (access modifiers + static) in
[iemejia] [BEAM-7802] Make Schema.toString method multi OS friendly
[iemejia] [BEAM-7802] Add AvroUtils.schemaCoder method to infer a Beam schema
from
[dcavazos] [BEAM-7389] Add code examples for Partition page
[kyle.winkelman] [BEAM-7989] Remove side inputs from CacheVisitor calculation.
[thw] Move Design Documents index to cwiki
------------------------------------------
[...truncated 898.33 KB...]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(710d336f59edc6ceb80009b050e3a3ea) [CANCELED]
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task
code ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2) (0c2496dfe0ed9ca3789a6c40e5676adc).
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (1/2) (5ab5d405db892ff8c506ef5545efa075) switched from CANCELING to
CANCELED.
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(7854c0c6229715fb28358cfd29927f77).
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(7854c0c6229715fb28358cfd29927f77) switched from RUNNING to CANCELING.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(0c2496dfe0ed9ca3789a6c40e5676adc) switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2) (0c2496dfe0ed9ca3789a6c40e5676adc).
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(5070cb84192a6e6a916585aa37f7a217) switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(0c2496dfe0ed9ca3789a6c40e5676adc) [CANCELED]
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task
code ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2) (7854c0c6229715fb28358cfd29927f77).
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (d9d27938bb13e6149888932cace6916b)
switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(13707c396ca396797de347cdb57fdde3).
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(13707c396ca396797de347cdb57fdde3) switched from RUNNING to CANCELING.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(7854c0c6229715fb28358cfd29927f77) switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2) (7854c0c6229715fb28358cfd29927f77).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(7854c0c6229715fb28358cfd29927f77) [CANCELED]
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task
code ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2) (13707c396ca396797de347cdb57fdde3).
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(3ee383078b92d20ef440e9e61153ba11).
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(3ee383078b92d20ef440e9e61153ba11) switched from RUNNING to CANCELING.
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task
code ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2) (3ee383078b92d20ef440e9e61153ba11).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(13707c396ca396797de347cdb57fdde3) switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2) (13707c396ca396797de347cdb57fdde3).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(13707c396ca396797de347cdb57fdde3) [CANCELED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(3ee383078b92d20ef440e9e61153ba11) switched from CANCELING to CANCELED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2) (3ee383078b92d20ef440e9e61153ba11).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(3ee383078b92d20ef440e9e61153ba11) [CANCELED]
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
b9a56766359cd3a9128975685bd12093.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
1392b477ca5e607338361fc8cccd841f.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(b9a56766359cd3a9128975685bd12093) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
edb3e32ba46e3df5b5a151a44e0f50ca.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
2cbe22e5547e8695f996b3359607307f.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(1392b477ca5e607338361fc8cccd841f) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
47c2fd4391b75f2509c44f4a5a3e6346.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
320797f64b96a9f6a52b71f64ee9e273.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
53083f6490004d65094d0fd6608e18a5.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
710d336f59edc6ceb80009b050e3a3ea.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(edb3e32ba46e3df5b5a151a44e0f50ca) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(2cbe22e5547e8695f996b3359607307f) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
0c2496dfe0ed9ca3789a6c40e5676adc.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(47c2fd4391b75f2509c44f4a5a3e6346) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
7854c0c6229715fb28358cfd29927f77.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
13707c396ca396797de347cdb57fdde3.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state CANCELED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
3ee383078b92d20ef440e9e61153ba11.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(320797f64b96a9f6a52b71f64ee9e273) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(53083f6490004d65094d0fd6608e18a5) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(710d336f59edc6ceb80009b050e3a3ea) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(0c2496dfe0ed9ca3789a6c40e5676adc) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(7854c0c6229715fb28358cfd29927f77) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(13707c396ca396797de347cdb57fdde3) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(3ee383078b92d20ef440e9e61153ba11) switched from CANCELING to CANCELED.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Try to restart or fail
the job BeamApp-root-0817001824-db5fbc89 (f902652caecc1dbfd67c7f1b73b6fb23) if
no longer possible.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0817001824-db5fbc89 (f902652caecc1dbfd67c7f1b73b6fb23) switched
from state FAILING to FAILED.
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.io.IOException: Received exit code 1 for command 'docker inspect -f
{{.State.Running}}
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'. stderr:
Error: No such object:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4966)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:211)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:202)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:191)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'. stderr:
Error: No such object:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.isContainerRunning(DockerCommand.java:112)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:160)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:178)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:162)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
... 10 more
Suppressed: java.io.IOException: Received exit code 1 for command
'docker kill 92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'.
stderr: Error response from daemon: Cannot kill container:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59: No such
container: 92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:134)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:174)
... 20 more
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Could not restart the
job BeamApp-root-0817001824-db5fbc89 (f902652caecc1dbfd67c7f1b73b6fb23) because
the restart strategy prevented it.
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.io.IOException: Received exit code 1 for command 'docker inspect -f
{{.State.Running}}
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'. stderr:
Error: No such object:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4966)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:211)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:202)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:191)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'. stderr:
Error: No such object:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.isContainerRunning(DockerCommand.java:112)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:160)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:178)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:162)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
... 10 more
Suppressed: java.io.IOException: Received exit code 1 for command
'docker kill 92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'.
stderr: Error response from daemon: Cannot kill container:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59: No such
container: 92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:134)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:174)
... 20 more
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job f902652caecc1dbfd67c7f1b73b6fb23.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
f902652caecc1dbfd67c7f1b73b6fb23 reached globally terminal state FAILED.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0817001824-db5fbc89(f902652caecc1dbfd67c7f1b73b6fb23).
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
d93eee873c4a0e43e5e67cbb858340e4: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher91453144-479e-4a80-8f9d-0e6633855e68.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcher91453144-479e-4a80-8f9d-0e6633855e68.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-60c4326f-430d-4b18-ab49-8d4f7c864223
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager b9a1918b484cf528e057696c7dbb4024@akka://flink/user/jobmanager_1 for
job f902652caecc1dbfd67c7f1b73b6fb23 from the resource manager.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
f902652caecc1dbfd67c7f1b73b6fb23 with leader id
b9a1918b484cf528e057696c7dbb4024 lost leadership.
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-13] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher91453144-479e-4a80-8f9d-0e6633855e68.
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-17] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[ForkJoinPool.commonPool-worker-11] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-11] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-16] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:41477
[flink-akka.actor.default-dispatcher-14] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] ERROR
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation - Error during
job invocation
BeamApp-root-0817001824-db5fbc89_cd774595-09dc-4035-86f8-7e48063b4b9f.
org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at
org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)
at
org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:632)
at
org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123)
at
org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator$StreamingTranslationContext.execute(FlinkStreamingPortablePipelineTranslator.java:171)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:92)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:68)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:78)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by:
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.io.IOException: Received exit code 1 for command 'docker inspect -f
{{.State.Running}}
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'. stderr:
Error: No such object:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4966)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:211)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:202)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:191)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
... 1 more
Caused by: java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'. stderr:
Error: No such object:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.isContainerRunning(DockerCommand.java:112)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:160)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:178)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:162)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
... 10 more
Suppressed: java.io.IOException: Received exit code 1 for command
'docker kill 92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'.
stderr: Error response from daemon: Cannot kill container:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59: No such
container: 92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:179)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:134)
at
org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory.createEnvironment(DockerEnvironmentFactory.java:174)
... 20 more
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_539de5c7-1ec1-4c62-887f-f313a61b9418/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_539de5c7-1ec1-4c62-887f-f313a61b9418/
ERROR:root:java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'. stderr:
Error: No such object:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
INFO:root:Job state changed to FAILED
Traceback (most recent call last):
File "/usr/lib/python3.5/runpy.py", line 184, in _run_module_as_main
"__main__", mod_spec)
File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
exec(code, run_globals)
File
"<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/apache_beam/examples/wordcount.py";,>
line 135, in <module>
run()
File
"<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/apache_beam/examples/wordcount.py";,>
line 115, in run
result.wait_until_finish()
File
"<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 455, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
BeamApp-root-0817001824-db5fbc89_cd774595-09dc-4035-86f8-7e48063b4b9f failed in
state FAILED: java.io.IOException: Received exit code 1 for command 'docker
inspect -f {{.State.Running}}
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59'. stderr:
Error: No such object:
92cc91e63bc1236be76f2409bf6801155291b8202a3082d16ee4496f07d86d59
> Task :sdks:python:test-suites:portable:py35:portableWordCountStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:portableWordCountBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:portableWordCountStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 15s
80 actionable tasks: 62 executed, 15 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/dm4ve4uaeskzu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
