See
<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/533/display/redirect>
------------------------------------------
[...truncated 608.78 KB...]
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task [3]{read, split,
pair_with_one} -> ToKeyedWorkItem 889e7919ffb5e32199f98b2698a96fae.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{read, split,
pair_with_one} -> ToKeyedWorkItem (1/2) (889e7919ffb5e32199f98b2698a96fae)
switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_17:0
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/InitializeWrite, 0]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/InitializeWrite, 0]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/InitializeWrite, 0]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/InitializeWrite, 0]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/InitializeWrite, 0]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(83838fca87a49884ae6c985bfdd22206) switched from RUNNING to FINISHED.
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(83838fca87a49884ae6c985bfdd22206).
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at
core.py:2172>), Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite ->
(Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(83838fca87a49884ae6c985bfdd22206) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem)
83838fca87a49884ae6c985bfdd22206.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(921ebf9598e369f1b86b2454bb836525) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2) (921ebf9598e369f1b86b2454bb836525).
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(921ebf9598e369f1b86b2454bb836525) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(e569f20e53ddca0266ba81d98054e940) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2) (e569f20e53ddca0266ba81d98054e940).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(8949a5817543ffcc04e0b4dc7282a0fd) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(8949a5817543ffcc04e0b4dc7282a0fd).
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(e569f20e53ddca0266ba81d98054e940) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(8949a5817543ffcc04e0b4dc7282a0fd) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(32c5a9e009638cb0af3a44893c1e6c6e) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(32c5a9e009638cb0af3a44893c1e6c6e).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(6ef5b1b258ab31490462b4229ba37d96) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(f9b5f8ba9d29c526bb667b39cbea1dc6) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2) (6ef5b1b258ab31490462b4229ba37d96).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
921ebf9598e369f1b86b2454bb836525.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(32c5a9e009638cb0af3a44893c1e6c6e) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(6ef5b1b258ab31490462b4229ba37d96) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2) (f9b5f8ba9d29c526bb667b39cbea1dc6).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(f9b5f8ba9d29c526bb667b39cbea1dc6) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
e569f20e53ddca0266ba81d98054e940.
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 0]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 1]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 0]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 1]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 0]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 1]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 0]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 1]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [2]{count, format}, 0]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2172>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(83838fca87a49884ae6c985bfdd22206) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
8949a5817543ffcc04e0b4dc7282a0fd.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(921ebf9598e369f1b86b2454bb836525) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(e569f20e53ddca0266ba81d98054e940) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
32c5a9e009638cb0af3a44893c1e6c6e.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(8949a5817543ffcc04e0b4dc7282a0fd) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
6ef5b1b258ab31490462b4229ba37d96.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(32c5a9e009638cb0af3a44893c1e6c6e) switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
f9b5f8ba9d29c526bb667b39cbea1dc6.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(6ef5b1b258ab31490462b4229ba37d96) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(f9b5f8ba9d29c526bb667b39cbea1dc6) switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (2/2)
(c14495340cc599f2cb1dc9eb27f95d7c) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group ->
[2]{count, format} (2/2) (c14495340cc599f2cb1dc9eb27f95d7c).
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task group -> [2]{count, format} (2/2)
(c14495340cc599f2cb1dc9eb27f95d7c) [FINISHED]
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task group ->
[2]{count, format} c14495340cc599f2cb1dc9eb27f95d7c.
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (1/2)
(655a4545caf4bea9e50fc321872e16a0) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group ->
[2]{count, format} (1/2) (655a4545caf4bea9e50fc321872e16a0).
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task group -> [2]{count, format} (1/2)
(655a4545caf4bea9e50fc321872e16a0) [FINISHED]
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task group ->
[2]{count, format} 655a4545caf4bea9e50fc321872e16a0.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (2/2) (c14495340cc599f2cb1dc9eb27f95d7c) switched from RUNNING to
FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (1/2) (655a4545caf4bea9e50fc321872e16a0) switched from RUNNING to
FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (1338f1745968483931073cf59473670c) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (2/2)
(1338f1745968483931073cf59473670c).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (1338f1745968483931073cf59473670c) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem 1338f1745968483931073cf59473670c.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (1338f1745968483931073cf59473670c) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (3fa7d5c76f65d99ff14c71af71f6c7ef) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/2)
(3fa7d5c76f65d99ff14c71af71f6c7ef).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (3fa7d5c76f65d99ff14c71af71f6c7ef) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem 3fa7d5c76f65d99ff14c71af71f6c7ef.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (3fa7d5c76f65d99ff14c71af71f6c7ef) switched from RUNNING
to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2) (9324ea16bcd65819dceff2fcd4078710) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)
(9324ea16bcd65819dceff2fcd4078710).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2) (9324ea16bcd65819dceff2fcd4078710) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) 9324ea16bcd65819dceff2fcd4078710.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)
(9324ea16bcd65819dceff2fcd4078710) switched from RUNNING to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, bc79e332-4eff-41c0-880b-e18157093438,
BeamApp-root-0413181842-59154d84, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
bc79e332-4eff-41c0-880b-e18157093438, BeamApp-root-0413181842-59154d84,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2) (5619e427a925beb0215f72e24565f221) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(5619e427a925beb0215f72e24565f221).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2) (5619e427a925beb0215f72e24565f221) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(360fe7ed082f722b15339f2726aaa601) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(360fe7ed082f722b15339f2726aaa601).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(360fe7ed082f722b15339f2726aaa601) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) 5619e427a925beb0215f72e24565f221.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(a01d6917e8d2531f3a53d7a2ab550b31) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(a01d6917e8d2531f3a53d7a2ab550b31).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(3d62da22d851975fb2639b2be560fe34) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2) (3d62da22d851975fb2639b2be560fe34).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(a01d6917e8d2531f3a53d7a2ab550b31) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(3d62da22d851975fb2639b2be560fe34) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(032ee0ffc75d22e83dac5a7f3f76ea4f) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2) (032ee0ffc75d22e83dac5a7f3f76ea4f).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(032ee0ffc75d22e83dac5a7f3f76ea4f) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
360fe7ed082f722b15339f2726aaa601.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
3d62da22d851975fb2639b2be560fe34.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(5619e427a925beb0215f72e24565f221) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
a01d6917e8d2531f3a53d7a2ab550b31.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(360fe7ed082f722b15339f2726aaa601) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
032ee0ffc75d22e83dac5a7f3f76ea4f.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(3d62da22d851975fb2639b2be560fe34) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(a01d6917e8d2531f3a53d7a2ab550b31) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(032ee0ffc75d22e83dac5a7f3f76ea4f) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(60c84208b4321ef459d68efb1e22e4d3) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(60c84208b4321ef459d68efb1e22e4d3).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(2/2) (60c84208b4321ef459d68efb1e22e4d3) [FINISHED]
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
60c84208b4321ef459d68efb1e22e4d3.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(60c84208b4321ef459d68efb1e22e4d3) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(f1e3333820ddfb4eccd47b4e8f5df203) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(f1e3333820ddfb4eccd47b4e8f5df203).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(1/2) (f1e3333820ddfb4eccd47b4e8f5df203) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
f1e3333820ddfb4eccd47b4e8f5df203.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(9f0f1ab8518e8b045f3e75ddf465882a) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(a26d5e0c29fa0172be5ef34de21b0204) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2) (9f0f1ab8518e8b045f3e75ddf465882a).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2) (a26d5e0c29fa0172be5ef34de21b0204).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(9f0f1ab8518e8b045f3e75ddf465882a) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(a26d5e0c29fa0172be5ef34de21b0204) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
9f0f1ab8518e8b045f3e75ddf465882a.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(f1e3333820ddfb4eccd47b4e8f5df203) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
a26d5e0c29fa0172be5ef34de21b0204.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(9f0f1ab8518e8b045f3e75ddf465882a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(a26d5e0c29fa0172be5ef34de21b0204) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (4eb41c197a12c1bb0efc5df5cea0bfae)
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (4eb41c197a12c1bb0efc5df5cea0bfae).
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/FinalizeWrite (2/2)
(4eb41c197a12c1bb0efc5df5cea0bfae) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite 4eb41c197a12c1bb0efc5df5cea0bfae.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (4eb41c197a12c1bb0efc5df5cea0bfae)
switched from RUNNING to FINISHED.
[grpc-default-executor-0] INFO filebasedsink.finalize_write - Starting
finalize_write threads with num_shards: 2 (skipped: 0), batches: 2,
num_threads: 2
[grpc-default-executor-0] INFO filebasedsink.finalize_write - Renamed 2 shards
in 0.12 seconds.
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control
plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for
in-flight requests to complete
[grpc-default-executor-0] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data
channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state
handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness
exiting.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
hanged up.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (050fd36534bf5cd0a9cd039945935756)
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (050fd36534bf5cd0a9cd039945935756).
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/FinalizeWrite (1/2)
(050fd36534bf5cd0a9cd039945935756) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite 050fd36534bf5cd0a9cd039945935756.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (050fd36534bf5cd0a9cd039945935756)
switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0413181842-59154d84 (9e9ff1cc3103e369fe7efb29881b158c) switched
from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job 9e9ff1cc3103e369fe7efb29881b158c.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
9e9ff1cc3103e369fe7efb29881b158c reached globally terminal state FINISHED.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0413181842-59154d84(9e9ff1cc3103e369fe7efb29881b158c).
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-7] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
088f1de855870a058c0cddcc58586662: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcherbc5c6ea7-d96f-42a9-b31f-f69625c63ac3.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcherbc5c6ea7-d96f-42a9-b31f-f69625c63ac3.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager bb9f3f171afb666c54bcdde0de664001@akka://flink/user/jobmanager_1 for
job 9e9ff1cc3103e369fe7efb29881b158c from the resource manager.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
9e9ff1cc3103e369fe7efb29881b158c with leader id
bb9f3f171afb666c54bcdde0de664001 lost leadership.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-7a873f97-81ce-4c43-81dd-18f169042d2b
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcherbc5c6ea7-d96f-42a9-b31f-f69625c63ac3.
[ForkJoinPool.commonPool-worker-9] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:42691
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 4866 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
MetricQueryResults(Counters(17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
15,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0, 17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
98,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
15,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
830, 6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1: 56,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
10,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
66,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
735,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
26,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:__main__.WordExtractingDoFn:empty_lines:
3,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
150,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
297,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
8,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
4,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
3,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
148,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
3,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1:
3,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
978,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
4,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
24,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
66,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
6,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
4,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
2,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:__main__.WordExtractingDoFn:word_lengths:
418,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1:
750,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
2,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
4,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1:
1,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:__main__.WordExtractingDoFn:words:
131,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1:
2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1:
108,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
7)Distributions(36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user_distribution:__main__.WordExtractingDoFn:word_len_dist:
DistributionResult{sum=418, count=131, min=0, max=10}))
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_35b19caa-6600-449c-938c-dbf1813377d0/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_35b19caa-6600-449c-938c-dbf1813377d0/
INFO:root:Job state changed to DONE
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/build.gradle'>
line: 185
* What went wrong:
Execution failed for task ':beam-sdks-python:portableWordCountBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 44s
71 actionable tasks: 54 executed, 15 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rb6efl5mieqtm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]