See
<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/498/display/redirect?page=changes>
Changes:
[ryan.yuan] [BEAM-6909] Add location support for
[ryan.yuan] [BEAM-6909] Add location support for
BigQueryWrapper._get_query_resul…
[ryan.yuan] [BEAM-6909] Add location support for
BigQueryWrapper._get_query_resul…
[25622840+adude3141] [BEAM-6981] use beam module plugin global configuration
for javadoc
[25622840+adude3141] [BEAM-6973] disable doclint missing
[apilloud] Fix release guide numbering to be unordered
[apilloud] Add check for open pull requests to checklist
[melissapa] Update HourlyTeamScore write destinations
------------------------------------------
[...truncated 612.65 KB...]
[Time Trigger for [1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
1b41a00e-a4e5-4021-981a-756f1523acae, BeamApp-root-0405012925-d3063cba,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[Time Trigger for [1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[Time Trigger for [1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
1b41a00e-a4e5-4021-981a-756f1523acae, BeamApp-root-0405012925-d3063cba,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[Time Trigger for [1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[Time Trigger for [1]write/Write/WriteImpl/PreFinalize -> Map ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/PreFinalize, 0]
[Time Trigger for [1]write/Write/WriteImpl/PreFinalize -> Map ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/PreFinalize, 0]
[Time Trigger for [1]write/Write/WriteImpl/PreFinalize -> Map ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/PreFinalize, 0]
[Time Trigger for [1]write/Write/WriteImpl/PreFinalize -> Map ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/PreFinalize, 0]
[Time Trigger for [1]write/Write/WriteImpl/PreFinalize -> Map ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/PreFinalize, 0]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task [3]{read, split,
pair_with_one} -> ToKeyedWorkItem f72095c068cf416e7260fb3cf926f0a7.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{read, split,
pair_with_one} -> ToKeyedWorkItem (1/2) (f72095c068cf416e7260fb3cf926f0a7)
switched from RUNNING to FINISHED.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 1]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [2]{count, format}, 0]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (2/2)
(7fdf86ebc747a492466a7f06ffaf1b1e) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group ->
[2]{count, format} (2/2) (7fdf86ebc747a492466a7f06ffaf1b1e).
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task group -> [2]{count, format} (2/2)
(7fdf86ebc747a492466a7f06ffaf1b1e) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task group ->
[2]{count, format} 7fdf86ebc747a492466a7f06ffaf1b1e.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (2/2) (7fdf86ebc747a492466a7f06ffaf1b1e) switched from RUNNING to
FINISHED.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (1/2)
(8a649ec487647230d6753da71e458c42) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group ->
[2]{count, format} (1/2) (8a649ec487647230d6753da71e458c42).
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task group -> [2]{count, format} (1/2)
(8a649ec487647230d6753da71e458c42) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task group ->
[2]{count, format} 8a649ec487647230d6753da71e458c42.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (1/2) (8a649ec487647230d6753da71e458c42) switched from RUNNING to
FINISHED.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/InitializeWrite, 0]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
1b41a00e-a4e5-4021-981a-756f1523acae, BeamApp-root-0405012925-d3063cba,
[1]write/Write/WriteImpl/InitializeWrite, 0]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/InitializeWrite, 0]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
1b41a00e-a4e5-4021-981a-756f1523acae, BeamApp-root-0405012925-d3063cba,
[1]write/Write/WriteImpl/InitializeWrite, 0]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
1b41a00e-a4e5-4021-981a-756f1523acae, BeamApp-root-0405012925-d3063cba,
[1]write/Write/WriteImpl/InitializeWrite, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(d1babe8a25c9ccc9a5526d3982c0c8f9) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2) (d1babe8a25c9ccc9a5526d3982c0c8f9).
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(d1babe8a25c9ccc9a5526d3982c0c8f9) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
d1babe8a25c9ccc9a5526d3982c0c8f9.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(d1babe8a25c9ccc9a5526d3982c0c8f9) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(da24ae8934b93089efb755383de3411c) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2) (da24ae8934b93089efb755383de3411c).
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(da24ae8934b93089efb755383de3411c) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
da24ae8934b93089efb755383de3411c.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(da24ae8934b93089efb755383de3411c) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(f76187fa541f68d0bd26091a3baf835a) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(f76187fa541f68d0bd26091a3baf835a).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(f76187fa541f68d0bd26091a3baf835a) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
f76187fa541f68d0bd26091a3baf835a.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(f76187fa541f68d0bd26091a3baf835a) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(77b8099bea58f6adbe255f69a405250d) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2) (77b8099bea58f6adbe255f69a405250d).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(77b8099bea58f6adbe255f69a405250d) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
77b8099bea58f6adbe255f69a405250d.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(77b8099bea58f6adbe255f69a405250d) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(65b9bf14a9956e43517fe66a9e507a60) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2) (65b9bf14a9956e43517fe66a9e507a60).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(65b9bf14a9956e43517fe66a9e507a60) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(f20dae6a6956188e25f146f0cc6532ca) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(f20dae6a6956188e25f146f0cc6532ca).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(f20dae6a6956188e25f146f0cc6532ca) [FINISHED]
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(56c65f79e931bdb7759395c11b815be3) switched from RUNNING to FINISHED.
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(56c65f79e931bdb7759395c11b815be3).
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at
core.py:2167>), Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite ->
(Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(56c65f79e931bdb7759395c11b815be3) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
65b9bf14a9956e43517fe66a9e507a60.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
f20dae6a6956188e25f146f0cc6532ca.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem)
56c65f79e931bdb7759395c11b815be3.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(65b9bf14a9956e43517fe66a9e507a60) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(f20dae6a6956188e25f146f0cc6532ca) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2167>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(56c65f79e931bdb7759395c11b815be3) switched from RUNNING to FINISHED.
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 1]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 1]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 1]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 1]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 1]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 0]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 0]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 0]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 0]
[Time Trigger for write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 1b41a00e-a4e5-4021-981a-756f1523acae,
BeamApp-root-0405012925-d3063cba, [1]write/Write/WriteImpl/Extract, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (b31f794c0fde7fc9e011b7e0103d8956) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (2/2)
(b31f794c0fde7fc9e011b7e0103d8956).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (b31f794c0fde7fc9e011b7e0103d8956) [FINISHED]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (4ff8a2b072ff176869d25f8ac4102457) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/2)
(4ff8a2b072ff176869d25f8ac4102457).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (4ff8a2b072ff176869d25f8ac4102457) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem b31f794c0fde7fc9e011b7e0103d8956.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem 4ff8a2b072ff176869d25f8ac4102457.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (b31f794c0fde7fc9e011b7e0103d8956) switched from RUNNING
to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (4ff8a2b072ff176869d25f8ac4102457) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2) (f3665822b4e5b309194a85e58f75cc73) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)
(f3665822b4e5b309194a85e58f75cc73).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2) (f3665822b4e5b309194a85e58f75cc73) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) f3665822b4e5b309194a85e58f75cc73.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)
(f3665822b4e5b309194a85e58f75cc73) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(fe75581e82d7de7cfaec161ea759711b) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(fe75581e82d7de7cfaec161ea759711b).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(fe75581e82d7de7cfaec161ea759711b) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
fe75581e82d7de7cfaec161ea759711b.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(fe75581e82d7de7cfaec161ea759711b) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(3082a259b1a0bbacf0b975e98b74bea5) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(3082a259b1a0bbacf0b975e98b74bea5).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(3082a259b1a0bbacf0b975e98b74bea5) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
3082a259b1a0bbacf0b975e98b74bea5.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(3082a259b1a0bbacf0b975e98b74bea5) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(35375859556437d2d09c92ee51543256) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2) (35375859556437d2d09c92ee51543256).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(35375859556437d2d09c92ee51543256) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
35375859556437d2d09c92ee51543256.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(35375859556437d2d09c92ee51543256) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(70bd4b957c166308afa70de40bbf80f9) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2) (70bd4b957c166308afa70de40bbf80f9).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(70bd4b957c166308afa70de40bbf80f9) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
70bd4b957c166308afa70de40bbf80f9.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(70bd4b957c166308afa70de40bbf80f9) switched from RUNNING to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2) (e68a1061776b3deb42b7c638593b29ef) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(e68a1061776b3deb42b7c638593b29ef).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2) (e68a1061776b3deb42b7c638593b29ef) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) e68a1061776b3deb42b7c638593b29ef.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(e68a1061776b3deb42b7c638593b29ef) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(4a7af4ae105e09ee980a9b6e3fcf7bb0) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(4a7af4ae105e09ee980a9b6e3fcf7bb0).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(2/2) (4a7af4ae105e09ee980a9b6e3fcf7bb0) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
4a7af4ae105e09ee980a9b6e3fcf7bb0.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(4a7af4ae105e09ee980a9b6e3fcf7bb0) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(85a21f385692fe096e0f985ed7b3b59e) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(85a21f385692fe096e0f985ed7b3b59e).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(1/2) (85a21f385692fe096e0f985ed7b3b59e) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
85a21f385692fe096e0f985ed7b3b59e.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(85a21f385692fe096e0f985ed7b3b59e) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(00a9cd873b78ca4d428bc9bac4346adc) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2) (00a9cd873b78ca4d428bc9bac4346adc).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(00a9cd873b78ca4d428bc9bac4346adc) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
00a9cd873b78ca4d428bc9bac4346adc.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(74ae6774d847331a9e1cd6f797751b84) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2) (74ae6774d847331a9e1cd6f797751b84).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(74ae6774d847331a9e1cd6f797751b84) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
74ae6774d847331a9e1cd6f797751b84.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(00a9cd873b78ca4d428bc9bac4346adc) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(74ae6774d847331a9e1cd6f797751b84) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (f2db616c38cc127b404024e8bab1d66a)
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (f2db616c38cc127b404024e8bab1d66a).
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/FinalizeWrite (2/2)
(f2db616c38cc127b404024e8bab1d66a) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite f2db616c38cc127b404024e8bab1d66a.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (f2db616c38cc127b404024e8bab1d66a)
switched from RUNNING to FINISHED.
[grpc-default-executor-1] INFO filebasedsink.finalize_write - Starting
finalize_write threads with num_shards: 2 (skipped: 0), batches: 2,
num_threads: 2
[grpc-default-executor-1] INFO filebasedsink.finalize_write - Renamed 2 shards
in 0.15 seconds.
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control
plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for
in-flight requests to complete
[grpc-default-executor-0] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data
channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state
handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness
exiting.
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
hanged up.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (2542f8ada10f9407579ec44a71835f44)
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (2542f8ada10f9407579ec44a71835f44).
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/FinalizeWrite (1/2)
(2542f8ada10f9407579ec44a71835f44) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite 2542f8ada10f9407579ec44a71835f44.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (2542f8ada10f9407579ec44a71835f44)
switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0405012925-d3063cba (9d20be9134577c4c93d3125ddf03a2c5) switched
from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job 9d20be9134577c4c93d3125ddf03a2c5.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
9d20be9134577c4c93d3125ddf03a2c5 reached globally terminal state FINISHED.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher7d4984c4-c907-4bd0-a9cd-10ab7b8ecd1a.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcher7d4984c4-c907-4bd0-a9cd-10ab7b8ecd1a.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0405012925-d3063cba(9d20be9134577c4c93d3125ddf03a2c5).
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-c0ee0159-0c15-4256-881d-1bf119bf1956
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
cecd65cb3180f7a14320a7f0c2a79a3f: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 85602aea52c37ff6f645541010bf472f@akka://flink/user/jobmanager_1 for
job 9d20be9134577c4c93d3125ddf03a2c5 from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint
org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet.
Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation
until processing is started.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
9d20be9134577c4c93d3125ddf03a2c5 with leader id
85602aea52c37ff6f645541010bf472f lost leadership.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher7d4984c4-c907-4bd0-a9cd-10ab7b8ecd1a.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[ForkJoinPool.commonPool-worker-2] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[ForkJoinPool.commonPool-worker-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:44363
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 10487 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
MetricQueryResults(Counters(17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
194,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0, 17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
145,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
1268, 6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1: 56,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
207,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
685,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
1803,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
37,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:__main__.WordExtractingDoFn:empty_lines:
3,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
150,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
297,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
117,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
97,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
3,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
22,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1:
3,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
680,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1:
1,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1:
1290,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
6,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
240,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
194,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
97,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
680,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:__main__.WordExtractingDoFn:word_lengths:
418,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1:
1948,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
31,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
117,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1:
3,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:__main__.WordExtractingDoFn:words:
131,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1:
2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1:
207,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1:
445,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1:
0)Distributions(36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user_distribution:__main__.WordExtractingDoFn:word_len_dist:
DistributionResult{sum=418, count=131, min=0, max=10}))
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
INFO:root:Job state changed to DONE
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_507e04a7-3418-4663-8743-ed4a33e97c69/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_507e04a7-3418-4663-8743-ed4a33e97c69/
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/sdks/python/build.gradle'>
line: 185
* What went wrong:
Execution failed for task ':beam-sdks-python:portableWordCountBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 51s
69 actionable tasks: 53 executed, 14 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/d4ilggvgaarui
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
