See 
<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/695/display/redirect?page=changes>

Changes:

[ehudm] Reduce verbosity of setup.py sdist and futurize

[ehudm] [BEAM-6380] Allow rewinding PipeStream

[daniel.o.programmer] [BEAM-7086] Refactoring repetitive error code.

[33067037+akedin] [BEAM-6284] Improve error message on waitUntilFinish. (#8629)

------------------------------------------
[...truncated 519.65 KB...]
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2254>), 
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map -> 
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) 
8587d3ec2cf25a4e17d122899349956c.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2) 
(0d56c22e48c4c8d2226621ef304325ba) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2) 
(b28d155d9745e78836c7a41cead431bb) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources 
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
(1/2) (b28d155d9745e78836c7a41cead431bb).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2) 
(b28d155d9745e78836c7a41cead431bb) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2) 
(b36f1e6aef0c9716c9535026f6dc8db0) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources 
for ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
(1/2) (b36f1e6aef0c9716c9535026f6dc8db0).
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2) 
(b36f1e6aef0c9716c9535026f6dc8db0) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map 
0d56c22e48c4c8d2226621ef304325ba.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
b28d155d9745e78836c7a41cead431bb.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
b36f1e6aef0c9716c9535026f6dc8db0.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2254>), 
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map -> 
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2) 
(8587d3ec2cf25a4e17d122899349956c) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2) 
(0d56c22e48c4c8d2226621ef304325ba) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2) 
(b28d155d9745e78836c7a41cead431bb) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2) 
(b36f1e6aef0c9716c9535026f6dc8db0) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2) 
(4576e1f8c7d0be497059f06f7daede2f) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources 
for ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
(2/2) (4576e1f8c7d0be497059f06f7daede2f).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2) 
(ced587f5b4ce03ab5312cb146eee373e) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2) 
(4576e1f8c7d0be497059f06f7daede2f) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map 
4576e1f8c7d0be497059f06f7daede2f.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources 
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
(2/2) (ced587f5b4ce03ab5312cb146eee373e).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2) 
(ced587f5b4ce03ab5312cb146eee373e) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map 
ced587f5b4ce03ab5312cb146eee373e.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2) 
(4576e1f8c7d0be497059f06f7daede2f) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2) 
(16eb4a87aeba83f66ed18a8752982d61) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2) 
(16eb4a87aeba83f66ed18a8752982d61).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2) 
(16eb4a87aeba83f66ed18a8752982d61) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map 
16eb4a87aeba83f66ed18a8752982d61.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2) 
(ced587f5b4ce03ab5312cb146eee373e) switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/write/ref_PCollection_PCollection_24:0 
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2) 
(16eb4a87aeba83f66ed18a8752982d61) switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/write/ref_PCollection_PCollection_24:0 
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/write/ref_PCollection_PCollection_17:0 
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/write/ref_PCollection_PCollection_17:0 
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/read/ref_PCollection_PCollection_17:0 
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/read/ref_PCollection_PCollection_17:0 
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:element_count:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:element_count:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/PreFinalize, 0]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/read/ref_PCollection_PCollection_15:0 
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/read/ref_PCollection_PCollection_15:0 
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:element_count:v1'. Metric will not be reported.[localhost, 
taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, 
taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 0]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:element_count:v1'. Metric will not be reported.[localhost, 
taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup - 
Name collision: Group already contains a Metric with the name 
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, 
taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [2]{count, format}, 1]
[group -> [2]{count, format} (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (1/2) 
(be9c67659c113e85228eb04b253d19ca) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group -> 
[2]{count, format} (1/2) (be9c67659c113e85228eb04b253d19ca).
[group -> [2]{count, format} (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are 
closed for task group -> [2]{count, format} (1/2) 
(be9c67659c113e85228eb04b253d19ca) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task group -> 
[2]{count, format} be9c67659c113e85228eb04b253d19ca.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count, 
format} (1/2) (be9c67659c113e85228eb04b253d19ca) switched from RUNNING to 
FINISHED.
[group -> [2]{count, format} (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (2/2) 
(7c650e92db8a366ec0c3e7ab298921ea) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group -> 
[2]{count, format} (2/2) (7c650e92db8a366ec0c3e7ab298921ea).
[group -> [2]{count, format} (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are 
closed for task group -> [2]{count, format} (2/2) 
(7c650e92db8a366ec0c3e7ab298921ea) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task group -> 
[2]{count, format} 7c650e92db8a366ec0c3e7ab298921ea.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count, 
format} (2/2) (7c650e92db8a366ec0c3e7ab298921ea) switched from RUNNING to 
FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:element_count:v1'. Metric will not be reported.[localhost, 
taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, 
taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:element_count:v1'. Metric will not be reported.[localhost, 
taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name 
collision: Group already contains a Metric with the name 
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, 
taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2) (7c3a58f3e045f5b184c059f7388fcd18) switched from RUNNING 
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing 
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (2/2) 
(7c3a58f3e045f5b184c059f7388fcd18).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
Ensuring all FileSystem streams are closed for task 
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2) (7c3a58f3e045f5b184c059f7388fcd18) [FINISHED]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2) (726a9865bda34bb63c243b1c46504100) switched from RUNNING 
to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem 7c3a58f3e045f5b184c059f7388fcd18.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing 
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair, 
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/2) 
(726a9865bda34bb63c243b1c46504100).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
Ensuring all FileSystem streams are closed for task 
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2) (726a9865bda34bb63c243b1c46504100) [FINISHED]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/write/ref_PCollection_PCollection_28:0 
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem 726a9865bda34bb63c243b1c46504100.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (2/2) (7c3a58f3e045f5b184c059f7388fcd18) switched from RUNNING 
to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} -> 
ToKeyedWorkItem (1/2) (726a9865bda34bb63c243b1c46504100) switched from RUNNING 
to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/write/ref_PCollection_PCollection_28:0 
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/read/ref_PCollection_PCollection_27:0 
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique 
name set for transform fn/read/ref_PCollection_PCollection_27:0 
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:element_count:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey -> 
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map -> 
ToKeyedWorkItem) (2/2) (927f85fff180729741c65dc674cf39cc) switched from RUNNING 
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map -> 
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2) 
(927f85fff180729741c65dc674cf39cc).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are 
closed for task write/Write/WriteImpl/GroupByKey -> 
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map -> 
ToKeyedWorkItem) (2/2) (927f85fff180729741c65dc674cf39cc) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map -> 
ToKeyedWorkItem, Map -> ToKeyedWorkItem) 927f85fff180729741c65dc674cf39cc.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map -> 
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2) 
(927f85fff180729741c65dc674cf39cc) switched from RUNNING to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:element_count:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. 
Metric will not be reported.[localhost, taskmanager, 
7c31d723-347c-47b8-9b06-5902c2d3368c, BeamApp-root-0524060813-1d06af98, 
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN 
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a 
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be 
reported.[localhost, taskmanager, 7c31d723-347c-47b8-9b06-5902c2d3368c, 
BeamApp-root-0524060813-1d06af98, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey -> 
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map -> 
ToKeyedWorkItem) (1/2) (7ada22be13e3f3005f4965776cdd21f6) switched from RUNNING 
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map -> 
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2) 
(7ada22be13e3f3005f4965776cdd21f6).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map 
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are 
closed for task write/Write/WriteImpl/GroupByKey -> 
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map -> 
ToKeyedWorkItem) (1/2) (7ada22be13e3f3005f4965776cdd21f6) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2) 
(c5d51481fd4bf2ab47b90078f6170fa8) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2) 
(c5d51481fd4bf2ab47b90078f6170fa8).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2) 
(682e46710af54642f1944b9e1a6e97c3) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2) 
(682e46710af54642f1944b9e1a6e97c3).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2) 
(c5d51481fd4bf2ab47b90078f6170fa8) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)] 
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2) 
(682e46710af54642f1944b9e1a6e97c3) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map -> 
ToKeyedWorkItem, Map -> ToKeyedWorkItem) 7ada22be13e3f3005f4965776cdd21f6.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2) 
(78b26245f1098f1b30c81da37bbc4e80) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources 
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
(2/2) (78b26245f1098f1b30c81da37bbc4e80).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2) 
(22fbae27f4aa1ce718e7d5d4dcaa510a) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources 
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
(1/2) (22fbae27f4aa1ce718e7d5d4dcaa510a).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2) 
(22fbae27f4aa1ce718e7d5d4dcaa510a) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2) 
(78b26245f1098f1b30c81da37bbc4e80) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map 
c5d51481fd4bf2ab47b90078f6170fa8.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map 
682e46710af54642f1944b9e1a6e97c3.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map -> 
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2) 
(7ada22be13e3f3005f4965776cdd21f6) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
22fbae27f4aa1ce718e7d5d4dcaa510a.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map 
78b26245f1098f1b30c81da37bbc4e80.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2) 
(c5d51481fd4bf2ab47b90078f6170fa8) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2) 
(682e46710af54642f1944b9e1a6e97c3) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2) 
(22fbae27f4aa1ce718e7d5d4dcaa510a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2) 
(78b26245f1098f1b30c81da37bbc4e80) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - 
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2) 
(e83579bde11752e37aa76098a3f70bb4) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2) 
(e83579bde11752e37aa76098a3f70bb4).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are 
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem 
(1/2) (e83579bde11752e37aa76098a3f70bb4) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem 
e83579bde11752e37aa76098a3f70bb4.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2) 
(e83579bde11752e37aa76098a3f70bb4) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - 
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2) 
(a48ac47fc144bae9feaf573a66989503) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2) 
(a48ac47fc144bae9feaf573a66989503).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are 
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem 
(2/2) (a48ac47fc144bae9feaf573a66989503) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem 
a48ac47fc144bae9feaf573a66989503.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2) 
(8f979a403fb11ece36a9a3e1d1dafa35) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources 
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
(1/2) (8f979a403fb11ece36a9a3e1d1dafa35).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2) 
(8f979a403fb11ece36a9a3e1d1dafa35) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2) 
(185279b74fba79498dcf66ee38d14743) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources 
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
(2/2) (185279b74fba79498dcf66ee38d14743).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem 
streams are closed for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2) 
(185279b74fba79498dcf66ee38d14743) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
8f979a403fb11ece36a9a3e1d1dafa35.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map 
185279b74fba79498dcf66ee38d14743.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2) 
(a48ac47fc144bae9feaf573a66989503) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2) 
(8f979a403fb11ece36a9a3e1d1dafa35) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2) 
(185279b74fba79498dcf66ee38d14743) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - 
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (c4999900c5f20f460c2ecfda3c3d0c01) 
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (c4999900c5f20f460c2ecfda3c3d0c01).
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are 
closed for task [1]write/Write/WriteImpl/FinalizeWrite (2/2) 
(c4999900c5f20f460c2ecfda3c3d0c01) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
[1]write/Write/WriteImpl/FinalizeWrite c4999900c5f20f460c2ecfda3c3d0c01.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (c4999900c5f20f460c2ecfda3c3d0c01) 
switched from RUNNING to FINISHED.
[grpc-default-executor-1] INFO filebasedsink.finalize_write - Starting 
finalize_write threads with num_shards: 2 (skipped: 0), batches: 2, 
num_threads: 2
[grpc-default-executor-1] INFO filebasedsink.finalize_write - Renamed 2 shards 
in 0.12 seconds.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO 
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing 
environment urn: "beam:env:docker:v1"
payload: "\n3jenkins-docker-apache.bintray.io/beam/python:latest"

[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control 
plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for 
in-flight requests to complete
[grpc-default-executor-1] WARN 
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown 
endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data 
channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state 
handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness 
exiting.
[grpc-default-executor-1] INFO 
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client 
hanged up.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN 
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown 
endpoint.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - 
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (1474550173199cb8a8935af1397026a9) 
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for 
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (1474550173199cb8a8935af1397026a9).
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO 
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are 
closed for task [1]write/Write/WriteImpl/FinalizeWrite (1/2) 
(1474550173199cb8a8935af1397026a9) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and 
sending final execution state FINISHED to JobManager for task 
[1]write/Write/WriteImpl/FinalizeWrite 1474550173199cb8a8935af1397026a9.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - 
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (1474550173199cb8a8935af1397026a9) 
switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job 
BeamApp-root-0524060813-1d06af98 (60370f3c58edd66d394aec233f130ef4) switched 
from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint 
coordinator for job 60370f3c58edd66d394aec233f130ef4.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - 
Shutting down
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 
60370f3c58edd66d394aec233f130ef4 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job 
BeamApp-root-0524060813-1d06af98(60370f3c58edd66d394aec233f130ef4).
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager 
connection for job 60370f3c58edd66d394aec233f130ef4.
[flink-runner-job-invoker] INFO 
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini 
Cluster
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 
f2c1c71f8fe34f4faf86e7ca0f336cd2: JobManager is shutting down..
[flink-runner-job-invoker] INFO 
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest 
endpoint.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher 
akka://flink/user/dispatcher45d9e5ac-5b68-4701-ab39-be01628d034c.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all 
currently running jobs of dispatcher 
akka://flink/user/dispatcher45d9e5ac-5b68-4701-ab39-be01628d034c.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor 
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting 
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect 
job manager a84acfec16f873792381358912c4496b@akka://flink/user/jobmanager_1 for 
job 60370f3c58edd66d394aec233f130ef4 from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job 
60370f3c58edd66d394aec233f130ef4 with leader id 
a84acfec16f873792381358912c4496b lost leadership.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed 
spill file directory /tmp/flink-io-74d2f7ac-2d01-4a6c-92db-6c369908f0a7
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the 
network environment and its components.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
 - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher 
akka://flink/user/dispatcher45d9e5ac-5b68-4701-ab39-be01628d034c.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the 
SlotManager.
[flink-akka.actor.default-dispatcher-6] INFO 
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending 
the SlotManager.
[ForkJoinPool.commonPool-worker-9] INFO 
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache 
directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO 
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader 
service.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor 
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-4] INFO 
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:46543
[flink-akka.actor.default-dispatcher-5] INFO 
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - 
Execution finished in 4743 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - 
Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - 
__metricscontainers : 
MetricQueryResults(Counters(17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_21}: 1, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
 {NAMESPACE=__main__.WordExtractingDoFn, 
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=empty_lines}: 3, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_20}: 1, 
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
 239, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_format_24}: 4, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_20}: 1, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}: 
0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 13, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}: 
6, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
 {NAMESPACE=__main__.WordExtractingDoFn, 
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=word_lengths}: 418, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_19}: 1, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_18}: 1, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 7, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}: 
11, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 23, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_28}: 2, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 20, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_27}: 1, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda 
at core.py:2254>)_30}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda 
at core.py:2254>)_30}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda 
at core.py:2254>)_30}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 904, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_20}: 1, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}: 
123, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}: 
0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
 239, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_20}: 1, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_29}: 0, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}: 
0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}: 
2, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_30}: 2, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}: 
990, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_10}: 34, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_24}: 2, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_11}: 131, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_split_17}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_count_23}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_12}: 131, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_split_17}: 6, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 10, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_count_23}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_split_17}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 911, 
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_17}: 50, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 20, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_count_23}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_16}: 50, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_15}: 50, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_count_23}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_17}: 50, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_format_24}: 4, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_split_17}: 6, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}: 
8, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
 {PCOLLECTION=ref_PCollection_PCollection_9}: 1, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_format_24}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}: 
1113, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda 
at core.py:2254>)_30}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_format_24}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}: 
11, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_23}: 2, 
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_22}: 2, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_2}: 1, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
 {NAMESPACE=__main__.WordExtractingDoFn, 
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=words}: 131, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1 
{PCOLLECTION=ref_PCollection_PCollection_1}: 1, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
 {PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 
0)Distributions(46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult{sum=271, 
count=1, min=271, max=271}, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_30}: DistributionResult{sum=106, 
count=2, min=53, max=53}, 
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_28}: DistributionResult{sum=276, 
count=2, min=138, max=138}, 
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 
{PCOLLECTION=ref_PCollection_PCollection_24}: DistributionResult{sum=278, 
count=2, min=139, max=139}, 
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 
{PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=276, 
count=2, min=138, max=138}, 
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 
{PCOLLECTION=ref_PCollection_PCollection_23}: DistributionResult{sum=278, 
count=2, min=139, max=139}, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=14, 
count=1, min=14, max=14}, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user_distribution
 {NAMESPACE=__main__.WordExtractingDoFn, 
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=word_len_dist}: 
DistributionResult{sum=418, count=131, min=0, max=10}, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=755, 
count=37, min=18, max=24}, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15, 
count=1, min=15, max=15}, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=731, 
count=37, min=17, max=26}, 
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=854, 
count=35, min=20, max=29}, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_18}: DistributionResult{sum=13, 
count=1, min=13, max=13}, 
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=15, 
count=1, min=15, max=15}, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 
{PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=685, 
count=1, min=685, max=685}, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_29}: DistributionResult{sum=0, 
count=0, min=9223372036854775807, max=-9223372036854775808}, 
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 
{PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13, 
count=1, min=13, max=13}, 
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 
{PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=784, 
count=37, min=19, max=25}, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15, 
count=1, min=15, max=15}, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=913, 
count=23, min=14, max=84}, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=81, 
count=1, min=81, max=81}, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=651, 
count=39, min=14, max=23}, 
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15, 
count=1, min=15, max=15}, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=739, 
count=40, min=16, max=22}, 
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
 {PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=685, 
count=1, min=685, max=685}))
[flink-runner-job-invoker] INFO 
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
 - Manifest at 
/tmp/beam-artifact-staging/job_ffda0908-1b36-48e2-9335-424f4d262ee7/MANIFEST 
has 1 artifact locations
[flink-runner-job-invoker] INFO 
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
 - Removed dir 
/tmp/beam-artifact-staging/job_ffda0908-1b36-48e2-9335-424f4d262ee7/
INFO:root:Job state changed to DONE

FAILURE: Build failed with an exception.

* Where:
Build file 
'<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/build.gradle'>
 line: 193

* What went wrong:
Execution failed for task ':sdks:python:portableWordCountBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug 
option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See 
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 14s
71 actionable tasks: 54 executed, 15 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rhihtnmozgjja

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to