See
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/1371/display/redirect?page=changes>
Changes:
[mikhail] Blogpost stub
[mikhail] Add blogpost file
[mikhail] Add blogpost highlights
[github] Update _posts_2019-12-16-beam-2.17.0.md
[github] Cleanup formatting.
------------------------------------------
[...truncated 4.42 MB...]
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (14/16)
(7f728dae31163189722d2cd6f654aea2) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (14/16)
(7f728dae31163189722d2cd6f654aea2).
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (12/16)
(a664a6c15cf71ac01a8d2c7e8a2219e5) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (12/16) (a664a6c15cf71ac01a8d2c7e8a2219e5).
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (14/16) (506dda100de0ce1c00685f0ff902a129) switched from
CREATED to SCHEDULED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (14/16)
(7f728dae31163189722d2cd6f654aea2) [FINISHED]
[DataSink (DiscardingOutput) (12/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (12/16)
(a664a6c15cf71ac01a8d2c7e8a2219e5) [FINISHED]
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match})
7f728dae31163189722d2cd6f654aea2.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (14/16) (506dda100de0ce1c00685f0ff902a129) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (14/16) (attempt #0) to 8ca2983e-0f69-40d5-b47d-1f45c8062aba
@ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) a664a6c15cf71ac01a8d2c7e8a2219e5.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (14/16).
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match}) (14/16)
(7f728dae31163189722d2cd6f654aea2) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (14/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (14/16)
(506dda100de0ce1c00685f0ff902a129) switched from CREATED to DEPLOYING.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (12/16) (a664a6c15cf71ac01a8d2c7e8a2219e5) switched from
RUNNING to FINISHED.
[DataSink (DiscardingOutput) (14/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (14/16)
(506dda100de0ce1c00685f0ff902a129) [DEPLOYING]
[DataSink (DiscardingOutput) (14/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (14/16) (506dda100de0ce1c00685f0ff902a129) [DEPLOYING].
[DataSink (DiscardingOutput) (14/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (14/16) (506dda100de0ce1c00685f0ff902a129)
[DEPLOYING].
[DataSink (DiscardingOutput) (14/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (14/16)
(506dda100de0ce1c00685f0ff902a129) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (14/16) (506dda100de0ce1c00685f0ff902a129) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (14/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (14/16)
(506dda100de0ce1c00685f0ff902a129) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (14/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (14/16) (506dda100de0ce1c00685f0ff902a129).
[DataSink (DiscardingOutput) (14/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (14/16)
(506dda100de0ce1c00685f0ff902a129) [FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) 506dda100de0ce1c00685f0ff902a129.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (14/16) (506dda100de0ce1c00685f0ff902a129) switched from
RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (2/16) (015d169c8911afb5a8cc388bfb83c6d0)
switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (2/16)
(015d169c8911afb5a8cc388bfb83c6d0).
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (2/16) (9e7a77b619911f66aeac4c43d70f3028) switched from
CREATED to SCHEDULED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (2/16) (015d169c8911afb5a8cc388bfb83c6d0)
[FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match})
015d169c8911afb5a8cc388bfb83c6d0.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (2/16) (9e7a77b619911f66aeac4c43d70f3028) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (2/16) (attempt #0) to 8ca2983e-0f69-40d5-b47d-1f45c8062aba
@ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (2/16).
[DataSink (DiscardingOutput) (2/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (2/16)
(9e7a77b619911f66aeac4c43d70f3028) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (2/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (2/16)
(9e7a77b619911f66aeac4c43d70f3028) [DEPLOYING]
[DataSink (DiscardingOutput) (2/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (2/16) (9e7a77b619911f66aeac4c43d70f3028) [DEPLOYING].
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (9/16) (025859a376b77c623b0b3fef3862920a)
switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match}) (2/16)
(015d169c8911afb5a8cc388bfb83c6d0) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (9/16)
(025859a376b77c623b0b3fef3862920a).
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (9/16) (025859a376b77c623b0b3fef3862920a)
[FINISHED]
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (9/16) (321368c1f83c60287669dc73e9675d39) switched from
CREATED to SCHEDULED.
[DataSink (DiscardingOutput) (2/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (2/16) (9e7a77b619911f66aeac4c43d70f3028)
[DEPLOYING].
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match})
025859a376b77c623b0b3fef3862920a.
[DataSink (DiscardingOutput) (2/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (2/16)
(9e7a77b619911f66aeac4c43d70f3028) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (9/16) (321368c1f83c60287669dc73e9675d39) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (9/16) (attempt #0) to 8ca2983e-0f69-40d5-b47d-1f45c8062aba
@ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (2/16) (9e7a77b619911f66aeac4c43d70f3028) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (2/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (2/16)
(9e7a77b619911f66aeac4c43d70f3028) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (2/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (2/16) (9e7a77b619911f66aeac4c43d70f3028).
[DataSink (DiscardingOutput) (2/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (2/16)
(9e7a77b619911f66aeac4c43d70f3028) [FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (9/16).
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match}) (9/16)
(025859a376b77c623b0b3fef3862920a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) 9e7a77b619911f66aeac4c43d70f3028.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (9/16)
(321368c1f83c60287669dc73e9675d39) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (9/16)
(321368c1f83c60287669dc73e9675d39) [DEPLOYING]
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (9/16) (321368c1f83c60287669dc73e9675d39) [DEPLOYING].
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (2/16) (9e7a77b619911f66aeac4c43d70f3028) switched from
RUNNING to FINISHED.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (9/16) (321368c1f83c60287669dc73e9675d39)
[DEPLOYING].
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (9/16)
(321368c1f83c60287669dc73e9675d39) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (9/16) (321368c1f83c60287669dc73e9675d39) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (9/16)
(321368c1f83c60287669dc73e9675d39) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (9/16) (321368c1f83c60287669dc73e9675d39).
[DataSink (DiscardingOutput) (9/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (9/16)
(321368c1f83c60287669dc73e9675d39) [FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) 321368c1f83c60287669dc73e9675d39.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (9/16) (321368c1f83c60287669dc73e9675d39) switched from
RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (13/16)
(5033278300ad089dd93868d89b8da8d8) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (13/16)
(5033278300ad089dd93868d89b8da8d8).
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (13/16) (97d24ff1b60422681c97e651aded9470) switched from
CREATED to SCHEDULED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (13/16)
(5033278300ad089dd93868d89b8da8d8) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match})
5033278300ad089dd93868d89b8da8d8.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (13/16) (97d24ff1b60422681c97e651aded9470) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (13/16) (attempt #0) to 8ca2983e-0f69-40d5-b47d-1f45c8062aba
@ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (13/16).
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match}) (13/16)
(5033278300ad089dd93868d89b8da8d8) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (13/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (13/16)
(97d24ff1b60422681c97e651aded9470) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (13/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (13/16)
(97d24ff1b60422681c97e651aded9470) [DEPLOYING]
[DataSink (DiscardingOutput) (13/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (13/16) (97d24ff1b60422681c97e651aded9470) [DEPLOYING].
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (11/16)
(45770ca2a8ff92b6118ce731f41d655d) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (11/16)
(45770ca2a8ff92b6118ce731f41d655d).
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (11/16) (a4202f49e5072d9efdc0d58eb6c91686) switched from
CREATED to SCHEDULED.
[DataSink (DiscardingOutput) (13/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (13/16) (97d24ff1b60422681c97e651aded9470)
[DEPLOYING].
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (11/16)
(45770ca2a8ff92b6118ce731f41d655d) [FINISHED]
[DataSink (DiscardingOutput) (13/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (13/16)
(97d24ff1b60422681c97e651aded9470) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match})
45770ca2a8ff92b6118ce731f41d655d.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (11/16) (a4202f49e5072d9efdc0d58eb6c91686) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (11/16) (attempt #0) to 8ca2983e-0f69-40d5-b47d-1f45c8062aba
@ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (13/16) (97d24ff1b60422681c97e651aded9470) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (13/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (13/16)
(97d24ff1b60422681c97e651aded9470) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (13/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (13/16) (97d24ff1b60422681c97e651aded9470).
[DataSink (DiscardingOutput) (13/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (13/16)
(97d24ff1b60422681c97e651aded9470) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (11/16).
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match}) (11/16)
(45770ca2a8ff92b6118ce731f41d655d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) 97d24ff1b60422681c97e651aded9470.
[DataSink (DiscardingOutput) (11/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (11/16)
(a4202f49e5072d9efdc0d58eb6c91686) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (11/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (11/16)
(a4202f49e5072d9efdc0d58eb6c91686) [DEPLOYING]
[DataSink (DiscardingOutput) (11/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (11/16) (a4202f49e5072d9efdc0d58eb6c91686) [DEPLOYING].
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (13/16) (97d24ff1b60422681c97e651aded9470) switched from
RUNNING to FINISHED.
[DataSink (DiscardingOutput) (11/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (11/16) (a4202f49e5072d9efdc0d58eb6c91686)
[DEPLOYING].
[DataSink (DiscardingOutput) (11/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (11/16)
(a4202f49e5072d9efdc0d58eb6c91686) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (11/16) (a4202f49e5072d9efdc0d58eb6c91686) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (11/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (11/16)
(a4202f49e5072d9efdc0d58eb6c91686) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (11/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (11/16) (a4202f49e5072d9efdc0d58eb6c91686).
[DataSink (DiscardingOutput) (11/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (11/16)
(a4202f49e5072d9efdc0d58eb6c91686) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) a4202f49e5072d9efdc0d58eb6c91686.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (11/16) (a4202f49e5072d9efdc0d58eb6c91686) switched from
RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (8/16) (f3c13252da3df7353d1b3127f52a0790)
switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (8/16)
(f3c13252da3df7353d1b3127f52a0790).
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (8/16) (7441abf2f6c80decd048c9ba1db8e93a) switched from
CREATED to SCHEDULED.
[MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task MapPartition (MapPartition at
[3]assert_that/{Group, Unkey, Match}) (8/16) (f3c13252da3df7353d1b3127f52a0790)
[FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (8/16) (7441abf2f6c80decd048c9ba1db8e93a) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match})
f3c13252da3df7353d1b3127f52a0790.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink
(DiscardingOutput) (8/16) (attempt #0) to 8ca2983e-0f69-40d5-b47d-1f45c8062aba
@ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition
(MapPartition at [3]assert_that/{Group, Unkey, Match}) (8/16)
(f3c13252da3df7353d1b3127f52a0790) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink
(DiscardingOutput) (8/16).
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (8/16)
(7441abf2f6c80decd048c9ba1db8e93a) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task DataSink (DiscardingOutput) (8/16)
(7441abf2f6c80decd048c9ba1db8e93a) [DEPLOYING]
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink
(DiscardingOutput) (8/16) (7441abf2f6c80decd048c9ba1db8e93a) [DEPLOYING].
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
DataSink (DiscardingOutput) (8/16) (7441abf2f6c80decd048c9ba1db8e93a)
[DEPLOYING].
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (8/16)
(7441abf2f6c80decd048c9ba1db8e93a) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (8/16) (7441abf2f6c80decd048c9ba1db8e93a) switched from
DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (8/16)
(7441abf2f6c80decd048c9ba1db8e93a) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink
(DiscardingOutput) (8/16) (7441abf2f6c80decd048c9ba1db8e93a).
[DataSink (DiscardingOutput) (8/16)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task DataSink (DiscardingOutput) (8/16)
(7441abf2f6c80decd048c9ba1db8e93a) [FINISHED]
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSink
(DiscardingOutput) 7441abf2f6c80decd048c9ba1db8e93a.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink
(DiscardingOutput) (8/16) (7441abf2f6c80decd048c9ba1db8e93a) switched from
RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-root-0107003726-12604538 (b9b8acc1c5c87cbbb5a4f6bc8d0d0485) switched
from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
b9b8acc1c5c87cbbb5a4f6bc8d0d0485 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
BeamApp-root-0107003726-12604538(b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
872b10de4b3ee5a0a8676b2616f57dcc: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 8948687b79848a59ce7d552381354897@akka://flink/user/jobmanager_1 for
job b9b8acc1c5c87cbbb5a4f6bc8d0d0485 from the resource manager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:15, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
db05d3f0df1f1e99ff785cf9e4997751, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[mini-cluster-io-thread-13] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
b9b8acc1c5c87cbbb5a4f6bc8d0d0485 with leader id
8948687b79848a59ce7d552381354897 lost leadership.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:14, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
e4b97d56ade4c0a6a229bc22e3971e7c, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:10, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
6b6e630f4f1595c4e9cc091d009bf1db, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:11, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
0f2fde51117149f45ce1649c73d2a481, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:6, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
9afb16069ed86df17c9987750240136e, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
4ad9869c0e2aa8c65daba5810a777446, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:1, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
dd057667265604d21efb6e38b3b1a95c, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:4, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
33b3d5a310cf6c612b80af7c3b6fb9d3, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:7, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
6a0e4d412fc2189bb990c59c33d347ef, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:2, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
cfbaed0b0d2f9f9b158cbe6c66794cbd, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:3, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
3acb393bfc6078eedcdf586e1beadc91, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:13, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
746b8fd617323a4d337175b1d49a1136, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:9, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
d63b0c42f8dc05c674147fe9580bda0b, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:5, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
c9f0e91520e07f732d64850e91429d10, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:8, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
df7e97d214e9ba07a0480c30c50f9cf7, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:12, state:ACTIVE, resource profile:
ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647,
directMemoryInMB=2147483647, nativeMemoryInMB=2147483647,
networkMemoryInMB=2147483647, managedMemoryInMB=1017}, allocationId:
c52e78bef62a7e2c30efedbbca84820b, jobId: b9b8acc1c5c87cbbb5a4f6bc8d0d0485).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
b9b8acc1c5c87cbbb5a4f6bc8d0d0485 from job leader monitoring.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job b9b8acc1c5c87cbbb5a4f6bc8d0d0485.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager
connection 872b10de4b3ee5a0a8676b2616f57dcc.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing
TaskExecutor connection 8ca2983e-0f69-40d5-b47d-1f45c8062aba because: The
TaskExecutor is shutting down.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager
removed spill file directory /tmp/flink-io-abda3b7f-70f6-4f50-88f4-6f10ee3ac46b
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the
network environment and its components.
[ForkJoinPool.commonPool-worker-2] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down
cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing
the SlotManager.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl -
Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager
removed spill file directory
/tmp/flink-netty-shuffle-25297895-fa6c-4b5a-8c83-82a121d39f71
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the
kvState service and its components.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.filecache.FileCache - removed file cache directory
/tmp/flink-dist-cache-919bdd26-3bc0-4738-b809-5b46afd2ab85
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_0.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator -
Shutting down remote daemon.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator -
Remote daemon shut down; proceeding with flushing remote transports.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator -
Remoting shut down.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService -
Stopping Akka RPC service.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService -
Stopped Akka RPC service.
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:44539
[flink-akka.actor.default-dispatcher-9] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 35069
msecs
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers :
MetricQueryResults(Counters(ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/ExtractOutputs}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_30}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=external_3_AppliedPTransform_ExternalTransform(beam:transforms:xlang:filter_less_than_eq)/Filter(<lambda
at expansion_service_test.py:64>)_3}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_34}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: 12,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Match_41}: 38,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_34}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_32}: 103,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2591>)_26}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2591>)_26}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_39}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_30}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2591>)_26}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:396>)_18}:
0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Match_41}: 0,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=external_4_PCollection_PCollection_1}: 6,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_30}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_34}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_29}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_34}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(unicode)_17}: 0,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(unicode)_17}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: 1,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/ExtractOutputs}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_4_AppliedPTransform_ExternalTransform(beam:transforms:xlang:count)/PerElement/PerElement:PairWithVoid_4}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_4_AppliedPTransform_ExternalTransform(beam:transforms:xlang:count)/PerElement/PerElement:PairWithVoid_4}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:401>)_22}:
0,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2591>)_4}:
502,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 12,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Precombine}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: 12,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: 12,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/pcollection:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_29}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_40}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_40}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_29}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Precombine}:
0,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_4_AppliedPTransform_ExternalTransform(beam:transforms:xlang:count)/PerElement/PerElement:PairWithVoid_4}:
97,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_39}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/pcollection:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/pcollection_1:0}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_24:0}: 1,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_13}: 6,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/pcollection:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/pcollection:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:400>)_21}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_30}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/ExtractOutputs}:
0,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_33}: 172,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_18}: 1,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_28}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: 1,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_39}:
0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2591>)_26}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: 1,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Merge}:
0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_28}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_40}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/pcollection_1:0}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_28}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_28}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Precombine}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/pcollection_1:0}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_27}: 1,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:396>)_18}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:396>)_18}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Merge}:
0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_29}: 1,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_28}: 1,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:401>)_22}:
0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_40}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=external_3_AppliedPTransform_ExternalTransform(beam:transforms:xlang:filter_less_than_eq)/Filter(<lambda
at expansion_service_test.py:64>)_3}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Merge}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_24:1}: 3,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/pcollection_1:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=external_3_AppliedPTransform_ExternalTransform(beam:transforms:xlang:filter_less_than_eq)/Filter(<lambda
at expansion_service_test.py:64>)_3}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=external_3_AppliedPTransform_ExternalTransform(beam:transforms:xlang:filter_less_than_eq)/Filter(<lambda
at expansion_service_test.py:64>)_3}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_14}: 3,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: 12,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: 1,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_39}:
0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_32}: 103,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: 3,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: 3,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Match_41}: 38,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2591>)_4}:
400,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_34}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Precombine}:
0,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2591>)_4}:
102,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_33}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_30}: 1,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=external_4_AppliedPTransform_ExternalTransform(beam:transforms:xlang:count)/PerElement/PerElement:PairWithVoid_4}:
97,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_34}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0,
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2591>)_4}:
0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Match_41}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_33}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_33}: 172,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:400>)_21}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:400>)_21}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:400>)_21}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/ExtractOutputs}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=pcollection}: 6,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:401>)_22}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=pcollection_1}: 3,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(unicode)_17}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_29}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=pcollection_2}: 3,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_34}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_34}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 3,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Merge}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_23}: 3,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(unicode)_17}: 0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:401>)_22}:
0,
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: 3,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_32}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at external_test.py:396>)_18}:
0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_32}: 0,
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}:
0)Distributions(48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=pcollection}: DistributionResult{sum=96, count=6, min=16,
max=16},
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=17,
count=1, min=17, max=17},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_23}: DistributionResult{sum=63,
count=3, min=21, max=21},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=54,
count=3, min=18, max=18},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=57,
count=3, min=19, max=19},
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_28}: DistributionResult{sum=41,
count=1, min=41, max=41},
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_29}: DistributionResult{sum=33,
count=1, min=33, max=33},
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult{sum=58,
count=1, min=58, max=58},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=external_4_PCollection_PCollection_1}: DistributionResult{sum=90,
count=6, min=15, max=15},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=pcollection_2}: DistributionResult{sum=48, count=3, min=16,
max=16},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_13}: DistributionResult{sum=84,
count=6, min=14, max=14},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=pcollection_1}: DistributionResult{sum=72, count=3, min=21,
max=27},
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_30}: DistributionResult{sum=14,
count=1, min=14, max=14},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=51,
count=3, min=17, max=17},
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=15,
count=1, min=15, max=15},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=54,
count=3, min=18, max=18},
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=13,
count=1, min=13, max=13},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_14}: DistributionResult{sum=45,
count=3, min=15, max=15},
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_18}: DistributionResult{sum=15,
count=1, min=15, max=15},
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=168,
count=12, min=14, max=14},
14Create/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13,
count=1, min=13, max=13},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=168,
count=12, min=14, max=14},
ExternalTransform(beam:transforms:xlang:count)/PerElement/CombinePerKey(CountCombineFn)/Group.out/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_24:1}: DistributionResult{sum=72,
count=3, min=24, max=24},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=168,
count=12, min=14, max=14},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=168,
count=12, min=14, max=14},
26assert_that/Create/Impulse.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_24:0}: DistributionResult{sum=19,
count=1, min=19, max=19},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=168,
count=12, min=14, max=14}))
[flink-runner-job-invoker] WARN
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService - Failed
to remove job staging directory for token
{"sessionId":"job_81356ea8-af63-4d4e-8025-271d6774daf9","basePath":"/tmp/beam-artifact-staging"}:
{}
java.io.FileNotFoundException:
/tmp/beam-artifact-staging/job_81356ea8-af63-4d4e-8025-271d6774daf9/MANIFEST
(No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:118)
at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:82)
at org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:252)
at
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService.loadManifest(BeamFileSystemArtifactRetrievalService.java:88)
at
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:92)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:63)
at
org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:201)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.setState(JobInvocation.java:241)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.access$200(JobInvocation.java:48)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:110)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:96)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
ok
test_multi (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_nested (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_payload (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_pipeline_generation
(apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_simple (apache_beam.transforms.external_test.ExternalTransformTest) ... ok
test_unique_name (apache_beam.transforms.external_test.ExternalTransformTest)
... ok
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 10 tests in 108.582s
OK (SKIP=1)
> Task :runners:flink:1.9:job-server:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:flink:1.9:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 14m 45s
113 actionable tasks: 85 executed, 25 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/ciu3xp3lkjjnk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
