See
<https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/888/display/redirect?page=changes>
Changes:
[hsuryawirawan] Update Beam Katas (Java) course on Stepik
[hsuryawirawan] Update Beam Katas (Python) course on Stepik
[hsuryawirawan] Update the ParDo OneToMany task description to follow latest
convention
[hsuryawirawan] Add Windowing Adding Timestamp using ParDo Java Kata
[hsuryawirawan] Add Windowing Adding Timestamp using WithTimestamps Java Kata
[hsuryawirawan] Add Fixed Time Window Java Kata
[hsuryawirawan] Add kata description for the Adding Timestamp katas
[hsuryawirawan] Rename 'util' package to 'org.apache.beam.learning.katas.util'
[hsuryawirawan] Add Triggers "Event Time Triggers" Java kata
[hsuryawirawan] Add "DoFn Additional Parameters" Java kata
[hsuryawirawan] Move Built-in IOs Task into a package
[hsuryawirawan] Add WithKeys Java kata
[hsuryawirawan] Change logging library to use log4j2 and add log4j2.xml in the
util
[hsuryawirawan] Add "Early Triggers" Java kata
[hsuryawirawan] Update WithKeys task description javadoc link to use 'current'
[hsuryawirawan] Add "Window Accumulation Mode" Java kata
[hsuryawirawan] Add package for "Early Triggers" and "Window Accumulation Mode"
[hsuryawirawan] Update study_project.xml
[hsuryawirawan] Fix course syllabus on Stepik
[hsuryawirawan] Fix the wrong file path for TextIO Read kata
[hsuryawirawan] Update the allowed lateness and discarding accumulation mode
kata
[hsuryawirawan] Update course to Stepik
[hsuryawirawan] Reupload Python Katas lessons
[github] Remove unused NEWLINE in TextSink.TextWriter
[kamil.wasilewski] [BEAM-7503] Added iteration parameter to CoGBK test in Python
[kamil.wasilewski] [BEAM-7503] Created CoGBK Python Load Test Jenkins job
[kamil.wasilewski] [BEAM-3959] Added a flake F821 test
[katarzyna.kucharczyk] [BEAM-5994] Fix condition which allows to publish
metrics.
------------------------------------------
[...truncated 1.09 MB...]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[2]write/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:2257>),
Map(decode)} -> [1]write/Write/WriteImpl/InitializeWrite -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(3dda4013f4a9a8d112287ae3b3c2ffee) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
712b42f315b8ccb3afa033801151a74f.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (1/2)
(8e3fb73620b50583285c3a70be64957e) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (1/2)
(2d50d2fe1092608eb902e01a760f6f4d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side0 -> Map (2/2)
(0b5bb94c4ddae28513fd96c7c88f23ad) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (1/2)
(712b42f315b8ccb3afa033801151a74f) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(8eef1cfd487dbd4da50cd3a1064dee1d) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2) (8eef1cfd487dbd4da50cd3a1064dee1d).
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0
[ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(8eef1cfd487dbd4da50cd3a1064dee1d) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map
8eef1cfd487dbd4da50cd3a1064dee1d.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(08c2459b6d875f2f2a564d6358168b0b) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2) (08c2459b6d875f2f2a564d6358168b0b).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(08c2459b6d875f2f2a564d6358168b0b) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map
08c2459b6d875f2f2a564d6358168b0b.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34-side0 -> Map (2/2)
(8eef1cfd487dbd4da50cd3a1064dee1d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side0 -> Map (2/2)
(08c2459b6d875f2f2a564d6358168b0b) switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/PreFinalize, 0]
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/PreFinalize, 0]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/FinalizeWrite, 0]
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/FinalizeWrite, 0]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 1]
[group -> [2]{count, format} (2/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost,
taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 1]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 0]
[group -> [2]{count, format} (1/2)] WARN org.apache.flink.metrics.MetricGroup -
Name collision: Group already contains a Metric with the name
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost,
taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [2]{count, format}, 0]
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (2/2)
(82aa833dd560ac22b1762ecbe191fdfe) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group ->
[2]{count, format} (2/2) (82aa833dd560ac22b1762ecbe191fdfe).
[group -> [2]{count, format} (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task group -> [2]{count, format} (2/2)
(82aa833dd560ac22b1762ecbe191fdfe) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task group ->
[2]{count, format} 82aa833dd560ac22b1762ecbe191fdfe.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (2/2) (82aa833dd560ac22b1762ecbe191fdfe) switched from RUNNING to
FINISHED.
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - group -> [2]{count, format} (1/2)
(efe8242c2a8f816fe20b6ffb03236106) switched from RUNNING to FINISHED.
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for group ->
[2]{count, format} (1/2) (efe8242c2a8f816fe20b6ffb03236106).
[group -> [2]{count, format} (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task group -> [2]{count, format} (1/2)
(efe8242c2a8f816fe20b6ffb03236106) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task group ->
[2]{count, format} efe8242c2a8f816fe20b6ffb03236106.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - group -> [2]{count,
format} (1/2) (efe8242c2a8f816fe20b6ffb03236106) switched from RUNNING to
FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost,
taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 1]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:element_count:v1'. Metric will not be reported.[localhost,
taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] WARN org.apache.flink.metrics.MetricGroup - Name
collision: Group already contains a Metric with the name
'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost,
taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)}, 0]
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (6dcdd1be0bc5c2aa6e3abf502a5d91dc) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (2/2)
(6dcdd1be0bc5c2aa6e3abf502a5d91dc).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (6dcdd1be0bc5c2aa6e3abf502a5d91dc) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem 6dcdd1be0bc5c2aa6e3abf502a5d91dc.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (2/2) (6dcdd1be0bc5c2aa6e3abf502a5d91dc) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (fab8f63f9a3fb02b35a8fb3c280b2aca) switched from RUNNING
to FINISHED.
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for [3]write/Write/WriteImpl/{WriteBundles, Pair,
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/2)
(fab8f63f9a3fb02b35a8fb3c280b2aca).
[[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (fab8f63f9a3fb02b35a8fb3c280b2aca) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem fab8f63f9a3fb02b35a8fb3c280b2aca.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[3]write/Write/WriteImpl/{WriteBundles, Pair, WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/2) (fab8f63f9a3fb02b35a8fb3c280b2aca) switched from RUNNING
to FINISHED.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_28:0
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/Extract, 1]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/Extract, 1]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2) (e76c1a78b53f65a768ec9d990e7a0ee0) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)
(e76c1a78b53f65a768ec9d990e7a0ee0).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (2/2) (e76c1a78b53f65a768ec9d990e7a0ee0) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) e76c1a78b53f65a768ec9d990e7a0ee0.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (2/2)
(e76c1a78b53f65a768ec9d990e7a0ee0) switched from RUNNING to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
cb18d9ea-bbb3-44df-8e3a-785ef4f41a87, BeamApp-root-0711181156-eb239c4e,
[1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, cb18d9ea-bbb3-44df-8e3a-785ef4f41a87,
BeamApp-root-0711181156-eb239c4e, [1]write/Write/WriteImpl/Extract, 0]
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2) (6f3ab984e9df7dddba7b66bd8a621c2c) switched from RUNNING
to FINISHED.
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(6f3ab984e9df7dddba7b66bd8a621c2c).
[write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map
-> ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task write/Write/WriteImpl/GroupByKey ->
[1]write/Write/WriteImpl/Extract -> (Map -> ToKeyedWorkItem, Map ->
ToKeyedWorkItem) (1/2) (6f3ab984e9df7dddba7b66bd8a621c2c) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(4fa14fb64fdf5f45cf2a25def52af87a) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(ab2a66bfc448feb6820a3f8e5b590b83) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2) (ab2a66bfc448feb6820a3f8e5b590b83).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(4fa14fb64fdf5f45cf2a25def52af87a).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(ab2a66bfc448feb6820a3f8e5b590b83) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(4fa14fb64fdf5f45cf2a25def52af87a) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) 6f3ab984e9df7dddba7b66bd8a621c2c.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(63ad9d4a4aea1a753eeb7a9c53a8d935) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(63ad9d4a4aea1a753eeb7a9c53a8d935).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(f0e308cf775025bd3298d872a8cb5e22) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2) (f0e308cf775025bd3298d872a8cb5e22).
[ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(63ad9d4a4aea1a753eeb7a9c53a8d935) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(f0e308cf775025bd3298d872a8cb5e22) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
ab2a66bfc448feb6820a3f8e5b590b83.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
4fa14fb64fdf5f45cf2a25def52af87a.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
write/Write/WriteImpl/GroupByKey -> [1]write/Write/WriteImpl/Extract -> (Map ->
ToKeyedWorkItem, Map -> ToKeyedWorkItem) (1/2)
(6f3ab984e9df7dddba7b66bd8a621c2c) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map
63ad9d4a4aea1a753eeb7a9c53a8d935.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map
f0e308cf775025bd3298d872a8cb5e22.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (2/2)
(ab2a66bfc448feb6820a3f8e5b590b83) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (1/2)
(4fa14fb64fdf5f45cf2a25def52af87a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42-side1 -> Map (2/2)
(63ad9d4a4aea1a753eeb7a9c53a8d935) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side1 -> Map (1/2)
(f0e308cf775025bd3298d872a8cb5e22) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(1b256dd2b271e673965c794d97d5a180) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(1b256dd2b271e673965c794d97d5a180).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(1/2) (1b256dd2b271e673965c794d97d5a180) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
1b256dd2b271e673965c794d97d5a180.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (1/2)
(1b256dd2b271e673965c794d97d5a180) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(9dc4559f5e96d7413d4d72e3f42ee2d9) switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(9dc4559f5e96d7413d4d72e3f42ee2d9).
[[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
(2/2) (9dc4559f5e96d7413d4d72e3f42ee2d9) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem
9dc4559f5e96d7413d4d72e3f42ee2d9.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(027e9f1f6c01b76baaf5f0c7ddc8d57f) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2) (027e9f1f6c01b76baaf5f0c7ddc8d57f).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(1/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(027e9f1f6c01b76baaf5f0c7ddc8d57f) [FINISHED]
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(924c8aa8d77eff85c5b79eb99c529d6c) switched from RUNNING to FINISHED.
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2) (924c8aa8d77eff85c5b79eb99c529d6c).
[ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
(2/2)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(924c8aa8d77eff85c5b79eb99c529d6c) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
924c8aa8d77eff85c5b79eb99c529d6c.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map
027e9f1f6c01b76baaf5f0c7ddc8d57f.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/PreFinalize -> Map -> ToKeyedWorkItem (2/2)
(9dc4559f5e96d7413d4d72e3f42ee2d9) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (2/2)
(924c8aa8d77eff85c5b79eb99c529d6c) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43-side2 -> Map (1/2)
(027e9f1f6c01b76baaf5f0c7ddc8d57f) switched from RUNNING to FINISHED.
[grpc-default-executor-2] INFO filebasedsink.finalize_write - Starting
finalize_write threads with num_shards: 2 (skipped: 0), batches: 2,
num_threads: 2
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (1e1d5ba16362e8c6f4155eb0b97bbe36)
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (1e1d5ba16362e8c6f4155eb0b97bbe36).
[[1]write/Write/WriteImpl/FinalizeWrite (2/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/FinalizeWrite (2/2)
(1e1d5ba16362e8c6f4155eb0b97bbe36) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite 1e1d5ba16362e8c6f4155eb0b97bbe36.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (2/2) (1e1d5ba16362e8c6f4155eb0b97bbe36)
switched from RUNNING to FINISHED.
[grpc-default-executor-2] INFO filebasedsink.finalize_write - Renamed 2 shards
in 0.15 seconds.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing
environment urn: "beam:env:docker:v1"
payload: "\n4jenkins-docker-apache.bintray.io/beam/python3:latest"
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control
plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for
in-flight requests to complete
[grpc-default-executor-1] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data
channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state
handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness
exiting.
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
hanged up.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (22fc8a30fbdb13410e028463c0074c8a)
switched from RUNNING to FINISHED.
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (22fc8a30fbdb13410e028463c0074c8a).
[[1]write/Write/WriteImpl/FinalizeWrite (1/2)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [1]write/Write/WriteImpl/FinalizeWrite (1/2)
(22fc8a30fbdb13410e028463c0074c8a) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
[1]write/Write/WriteImpl/FinalizeWrite 22fc8a30fbdb13410e028463c0074c8a.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
[1]write/Write/WriteImpl/FinalizeWrite (1/2) (22fc8a30fbdb13410e028463c0074c8a)
switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0711181156-eb239c4e (933e980a356b08f271b678230e149f12) switched
from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job 933e980a356b08f271b678230e149f12.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
933e980a356b08f271b678230e149f12 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0711181156-eb239c4e(933e980a356b08f271b678230e149f12).
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 933e980a356b08f271b678230e149f12.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
99ba6feb925a8ef79872ecf961360a8e: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatchereec49268-2906-48e4-8cb8-3e6dc076712a.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatchereec49268-2906-48e4-8cb8-3e6dc076712a.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{a293b5922631e5859ff5b2931d1e0ff5}, jobId:
933e980a356b08f271b678230e149f12).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager af889067207cea85e7580e46814c41dc@akka://flink/user/jobmanager_1 for
job 933e980a356b08f271b678230e149f12 from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
933e980a356b08f271b678230e149f12 with leader id
af889067207cea85e7580e46814c41dc lost leadership.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{8cfd4aedcd55125e8df26fa02589f05e}, jobId:
933e980a356b08f271b678230e149f12).
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
933e980a356b08f271b678230e149f12 from job leader monitoring.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 933e980a356b08f271b678230e149f12.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatchereec49268-2906-48e4-8cb8-3e6dc076712a.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-838d016e-fe08-428e-9ff5-a6ce23f4ba89
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[ForkJoinPool.commonPool-worker-2] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:34901
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 5708 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
MetricQueryResults(Counters(17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}: 2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: 1,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=empty_lines}: 3,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 1,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
178,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_24}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}:
7,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 14,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}:
7,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=word_lengths}: 418,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: 1,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_18}: 1,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 7,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}:
37,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 47,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_28}: 2,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_27}: 1,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 693,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 1,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}:
143,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}:
0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
178,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 1,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WindowInto(WindowIntoFn)_36}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_29}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 38,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}:
0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}:
0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_30}: 2,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}:
837,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 34,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_24}: 2,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_17}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: 131,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_23}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: 131,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_17}: 5,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 33,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_28:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/Split_5}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_23}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_17}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/PreFinalize_42}: 700,
6format.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/WriteBundles_34}: 38,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: 50,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_read/Read/ReadSplits_16}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_23}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2257>)_30}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: 50,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: 50,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_count_23}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: 50,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_24}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_split_17}: 5,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2257>)_30}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 2,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_18:0}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 2,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2257>)_30}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at core.py:2257>)_30}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_20:0}: 0,
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/DoOnce/Map(decode)_32}:
7,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: 1,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_pair_with_one_18}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_24}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/FinalizeWrite_43}:
982,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_format_24}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/InitializeWrite_33}:
44,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_21:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_23}: 2,
6format.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: 2,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: 1,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_20:0}: 0,
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=words}: 131,
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Extract_41}: 0,
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_29:0}: 0,
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: 1,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
6format.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_write/Write/WriteImpl/Pair_35}: 0,
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}:
0)Distributions(46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult{sum=271,
count=1, min=271, max=271},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_30}: DistributionResult{sum=106,
count=2, min=53, max=53},
46write/Write/WriteImpl/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_28}: DistributionResult{sum=276,
count=2, min=138, max=138},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_24}: DistributionResult{sum=278,
count=2, min=139, max=139},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=276,
count=2, min=138, max=138},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_23}: DistributionResult{sum=278,
count=2, min=139, max=139},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=14,
count=1, min=14, max=14},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:user_distribution
{NAMESPACE=__main__.WordExtractingDoFn,
PTRANSFORM=ref_AppliedPTransform_split_17, NAME=word_len_dist}:
DistributionResult{sum=418, count=131, min=0, max=10},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=650,
count=32, min=18, max=24},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15,
count=1, min=15, max=15},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=764,
count=39, min=17, max=23},
19group/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=897,
count=37, min=20, max=29},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_18}: DistributionResult{sum=13,
count=1, min=13, max=13},
36write/Write/WriteImpl/DoOnce/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=15,
count=1, min=15, max=15},
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=684,
count=1, min=684, max=684},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_29}: DistributionResult{sum=0,
count=0, min=9223372036854775807, max=-9223372036854775808},
17read/Read/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13,
count=1, min=13, max=13},
6format.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=794,
count=37, min=19, max=25},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:1:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15,
count=1, min=15, max=15},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=820,
count=20, min=14, max=84},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=81,
count=1, min=81, max=81},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=669,
count=41, min=14, max=20},
40write/Write/WriteImpl/DoOnce/Map(decode).None/beam:env:docker:v1:2:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=15,
count=1, min=15, max=15},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=706,
count=38, min=16, max=22},
36read/Read/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=686,
count=1, min=686, max=686}))
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/beam-artifact-staging/job_e4bef6b0-0fea-456a-81e1-2581cd3114c7/MANIFEST
has 1 artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir
/tmp/beam-artifact-staging/job_e4bef6b0-0fea-456a-81e1-2581cd3114c7/
INFO:root:Job state changed to DONE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:portableWordCountBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:portableWordCountBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 4s
79 actionable tasks: 61 executed, 15 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/d3gjxnyxvg56g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]