See
<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/800/display/redirect?page=changes>
Changes:
[david.moravek] [BEAM-7561] HdfsFileSystems.match can match a directory.
[relax] [BEAM-6674] Add schema support to JdbcIO read (#8725)
[david.moravek] [BEAM-7561] Validate correct directory matching in
LocalFileSystemsTest
------------------------------------------
[...truncated 1.00 MB...]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(a01e1a4ae7c8559cedc0ab272a442d46) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(7ad590dd7c431c70cb83aa6ce6826321).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(7ad590dd7c431c70cb83aa6ce6826321) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(0bb28799aa1af03db7e09a44526efeb9) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2) (0bb28799aa1af03db7e09a44526efeb9).
[[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2254>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at
core.py:2254>), Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite ->
(Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(b386d46afc84cf61644e5133277ea889) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(0bb28799aa1af03db7e09a44526efeb9) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(a6eb8ccc38af5e9ba318543f4edda51b) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
7ad590dd7c431c70cb83aa6ce6826321.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2254>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem)
b386d46afc84cf61644e5133277ea889.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
0bb28799aa1af03db7e09a44526efeb9.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(7ad590dd7c431c70cb83aa6ce6826321) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2) (a6eb8ccc38af5e9ba318543f4edda51b).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(a6eb8ccc38af5e9ba318543f4edda51b) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
a6eb8ccc38af5e9ba318543f4edda51b.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(c0058eac476f16ba38e3e7650f0e2ed3) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(f5c96a1a102d62b88540af6862345d80) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2) (f5c96a1a102d62b88540af6862345d80).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(a01e1a4ae7c8559cedc0ab272a442d46).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(f5c96a1a102d62b88540af6862345d80) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(a01e1a4ae7c8559cedc0ab272a442d46) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
c0058eac476f16ba38e3e7650f0e2ed3.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2254>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(b386d46afc84cf61644e5133277ea889) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
f5c96a1a102d62b88540af6862345d80.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map
a01e1a4ae7c8559cedc0ab272a442d46.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(0bb28799aa1af03db7e09a44526efeb9) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(a6eb8ccc38af5e9ba318543f4edda51b) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(c0058eac476f16ba38e3e7650f0e2ed3) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(f5c96a1a102d62b88540af6862345d80) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(a01e1a4ae7c8559cedc0ab272a442d46) switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost,
taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/PreFinalize, 0]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost,
taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [2]{count, format}, 1]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (1/2)
(697be280c967a5464b65f3132ae5028b) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group ->
[2]{count, format} (1/2) (697be280c967a5464b65f3132ae5028b).
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task group -> [2]{count, format} (1/2)
(697be280c967a5464b65f3132ae5028b) [FINISHED]
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (2/2)
(a85f74bf555057e31e5b0906692fe8d7) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task group ->
[2]{count, format} 697be280c967a5464b65f3132ae5028b.
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group ->
[2]{count, format} (2/2) (a85f74bf555057e31e5b0906692fe8d7).
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task group -> [2]{count, format} (2/2)
(a85f74bf555057e31e5b0906692fe8d7) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task group ->
[2]{count, format} a85f74bf555057e31e5b0906692fe8d7.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (1/2) (697be280c967a5464b65f3132ae5028b) switched from RUNNING to
FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (2/2) (a85f74bf555057e31e5b0906692fe8d7) switched from RUNNING to
FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost,
taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost,
taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (9495bb8ff8d56dbfd7b53b7079f73aaf) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (2/2)
(9495bb8ff8d56dbfd7b53b7079f73aaf).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (9495bb8ff8d56dbfd7b53b7079f73aaf) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem 9495bb8ff8d56dbfd7b53b7079f73aaf.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (9495bb8ff8d56dbfd7b53b7079f73aaf) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (3042090f747f45fd4aaf841e71d20ff3) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/2)
(3042090f747f45fd4aaf841e71d20ff3).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (3042090f747f45fd4aaf841e71d20ff3) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem 3042090f747f45fd4aaf841e71d20ff3.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (3042090f747f45fd4aaf841e71d20ff3) switched from RUNNING
to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2) (d9e3b6edc3058966e71586da0bdb21f5) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)
(d9e3b6edc3058966e71586da0bdb21f5).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2) (d9e3b6edc3058966e71586da0bdb21f5) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) d9e3b6edc3058966e71586da0bdb21f5.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)
(d9e3b6edc3058966e71586da0bdb21f5) switched from RUNNING to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
2af99fb4-e7d0-488d-bcc7-524b79d0f2b7, BeamApp-root-0619121140-411ee7bb,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, 2af99fb4-e7d0-488d-bcc7-524b79d0f2b7,
BeamApp-root-0619121140-411ee7bb, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2) (5df274a4bf589554c4a638821272fbbe) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(5df274a4bf589554c4a638821272fbbe).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2) (5df274a4bf589554c4a638821272fbbe) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) 5df274a4bf589554c4a638821272fbbe.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(80c3ff8d8506aebd45857e96cde797dc) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(80c3ff8d8506aebd45857e96cde797dc).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(45945e61f464d652e43b7ad51b25c8d0) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(45945e61f464d652e43b7ad51b25c8d0).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(486522f4ccbb48a34ddc160b77ca415d) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(bfad28ef956ede3704c5d20d51e77f7f) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2) (486522f4ccbb48a34ddc160b77ca415d).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(80c3ff8d8506aebd45857e96cde797dc) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(45945e61f464d652e43b7ad51b25c8d0) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2) (bfad28ef956ede3704c5d20d51e77f7f).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(486522f4ccbb48a34ddc160b77ca415d) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(bfad28ef956ede3704c5d20d51e77f7f) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
80c3ff8d8506aebd45857e96cde797dc.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
45945e61f464d652e43b7ad51b25c8d0.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
486522f4ccbb48a34ddc160b77ca415d.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(5df274a4bf589554c4a638821272fbbe) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
bfad28ef956ede3704c5d20d51e77f7f.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(80c3ff8d8506aebd45857e96cde797dc) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(45945e61f464d652e43b7ad51b25c8d0) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(486522f4ccbb48a34ddc160b77ca415d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(bfad28ef956ede3704c5d20d51e77f7f) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(bb7c0d4ad18744bce9109216f1ceea73) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(bb7c0d4ad18744bce9109216f1ceea73).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(2/2) (bb7c0d4ad18744bce9109216f1ceea73) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
bb7c0d4ad18744bce9109216f1ceea73.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(bb7c0d4ad18744bce9109216f1ceea73) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(0a527c968869e5c80d0d2300c17d108b) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(0a527c968869e5c80d0d2300c17d108b).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(1/2) (0a527c968869e5c80d0d2300c17d108b) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
0a527c968869e5c80d0d2300c17d108b.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(39590ca64b5590e1eb51c457b27f59c6) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2) (39590ca64b5590e1eb51c457b27f59c6).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(39590ca64b5590e1eb51c457b27f59c6) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(19c3c818d1c83fc5b4dcf808c0cd230e) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2) (19c3c818d1c83fc5b4dcf808c0cd230e).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(19c3c818d1c83fc5b4dcf808c0cd230e) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
39590ca64b5590e1eb51c457b27f59c6.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(0a527c968869e5c80d0d2300c17d108b) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
19c3c818d1c83fc5b4dcf808c0cd230e.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(39590ca64b5590e1eb51c457b27f59c6) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(19c3c818d1c83fc5b4dcf808c0cd230e) switched from RUNNING to FINISHED.
[grpc-default-executor-1] INFO filebasedsink.finalize_write - Starting
finalize_write threads with num_shards: 2 (skipped: 0), batches: 2,
num_threads: 2
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (ec7ac40fc6e68a17b148a5c2e2e67d13)
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (ec7ac40fc6e68a17b148a5c2e2e67d13).
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/FinalizeWrite (2/2)
(ec7ac40fc6e68a17b148a5c2e2e67d13) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite ec7ac40fc6e68a17b148a5c2e2e67d13.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (ec7ac40fc6e68a17b148a5c2e2e67d13)
switched from RUNNING to FINISHED.
[grpc-default-executor-1] INFO filebasedsink.finalize_write - Renamed 2 shards
in 0.17 seconds.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing
environment urn: "beam:env:docker:v1"
payload: "\n4jenkins-docker-apache.bintray.io/beam/python3:latest"
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control
plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for
in-flight requests to complete
[grpc-default-executor-0] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data
channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state
handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness
exiting.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
hanged up.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (31a37ba99a590bb2d3e9a62e985f2332)
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (31a37ba99a590bb2d3e9a62e985f2332).
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/FinalizeWrite (1/2)
(31a37ba99a590bb2d3e9a62e985f2332) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite 31a37ba99a590bb2d3e9a62e985f2332.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (31a37ba99a590bb2d3e9a62e985f2332)
switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0619121140-411ee7bb (c9add836cdd2497cfe6d2083ad8b02e1) switched
from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job c9add836cdd2497cfe6d2083ad8b02e1.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
c9add836cdd2497cfe6d2083ad8b02e1 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0619121140-411ee7bb(c9add836cdd2497cfe6d2083ad8b02e1).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job c9add836cdd2497cfe6d2083ad8b02e1.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
de714dd73d4a4d2d7b5a6202e8b05205: JobManager is shutting down..
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher537999a4-f00a-4d34-930c-33d50fd8b825.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcher537999a4-f00a-4d34-930c-33d50fd8b825.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 955172caf3be80d64d68b561fb4f428c@akka://flink/user/jobmanager_1 for
job c9add836cdd2497cfe6d2083ad8b02e1 from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
c9add836cdd2497cfe6d2083ad8b02e1 with leader id
955172caf3be80d64d68b561fb4f428c lost leadership.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{937a889ec4b01d13f2f257356858d400}, jobId:
c9add836cdd2497cfe6d2083ad8b02e1).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{76b300ad5b54787291cddd31b852b598}, jobId:
c9add836cdd2497cfe6d2083ad8b02e1).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
c9add836cdd2497cfe6d2083ad8b02e1 from job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher537999a4-f00a-4d34-930c-33d50fd8b825.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job c9add836cdd2497cfe6d2083ad8b02e1.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-865afba0-11b4-41e1-9fc2-b801f73b9c46
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[ForkJoinPool.commonPool-worker-9] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:36311
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 5319 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
MetricQueryResults(Counters(17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=empty_lines}: 3,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 1,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
78,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_24}: 43,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 7,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}:
30,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}:
52,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_30}: 2,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}:
594,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=word_lengths}: 418,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}:
0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_18}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}:
179,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 4,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}:
0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 27,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_28}: 2,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 19,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_27}: 1,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2254>)_30}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2254>)_30}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2254>)_30}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 539,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 1,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}:
0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
78,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 1,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_29}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 43,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 34,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}:
773,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_24}: 2,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_17}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: 131,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_23}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: 131,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_17}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 20,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_23}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_17}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 543,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 43,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: 50,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 19,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_23}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: 50,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: 50,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_23}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: 50,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_24}: 40,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_17}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}:
52,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 35,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 35,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}:
30,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 4,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: 1,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_24}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2254>)_30}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_24}: 3,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_23}: 2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: 2,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=words}: 131,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 4,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: 1,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}:
0)Distributions(46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult{sum=271,
count=1, min=271, max=271},
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_28}: DistributionResult{sum=276,
count=2, min=138, max=138},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_24}: DistributionResult{sum=278,
count=2, min=139, max=139},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=276,
count=2, min=138, max=138},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_23}: DistributionResult{sum=278,
count=2, min=139, max=139},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_30}: DistributionResult{sum=106,
count=2, min=53, max=53},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=14,
count=1, min=14, max=14},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user_distribution
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=word_len_dist}:
DistributionResult{sum=418, count=131, min=0, max=10},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=81,
count=1, min=81, max=81},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=780,
count=38, min=18, max=24},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15,
count=1, min=15, max=15},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=719,
count=37, min=17, max=26},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=849,
count=35, min=20, max=29},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_18}: DistributionResult{sum=13,
count=1, min=13, max=13},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=15,
count=1, min=15, max=15},
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=684,
count=1, min=684, max=684},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_29}: DistributionResult{sum=0,
count=0, min=9223372036854775807, max=-9223372036854775808},
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13,
count=1, min=13, max=13},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=866,
count=40, min=19, max=28},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15,
count=1, min=15, max=15},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=827,
count=22, min=14, max=84},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=709,
count=43, min=14, max=20},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15,
count=1, min=15, max=15},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=589,
count=31, min=16, max=25},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=686,
count=1, min=686, max=686}))
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_44a8ad98-7ab1-44d3-b6c2-abc13cd77e81/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_44a8ad98-7ab1-44d3-b6c2-abc13cd77e81/
INFO:root:Job state changed to DONE
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:portableWordCountBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 25s
79 actionable tasks: 61 executed, 15 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/jhsqawl2xfhhe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]