See
<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/901/display/redirect?page=changes>
Changes:
[mxm] [BEAM-7420]: Allow including the flink runner without flink on the
------------------------------------------
[...truncated 21.15 MB...]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that} (1/1)
(a61a3ef5f332b35bbfdaeee79ec8261e) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupByKey
-> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that} (1/1) (attempt
#0) to localhost
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(e9dfdd45b72c92b540393b79c359cfe5) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying
ToKeyedWorkItem (1/1) (attempt #0) to localhost
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Source:
Impulse -> [4]assert_that/{Create, Group} (1/1).
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(attempt #0) to localhost
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Impulse ->
[4]assert_that/{Create, Group} (1/1) (2acfd9fc074931ce97c35ae5722914ad)
switched from CREATED to DEPLOYING.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1)
(2acfd9fc074931ce97c35ae5722914ad) [DEPLOYING]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source:
Impulse -> [4]assert_that/{Create, Group} (1/1)
(2acfd9fc074931ce97c35ae5722914ad) [DEPLOYING].
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Source:
Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
Source: Impulse -> [4]assert_that/{Create, Group} (1/1)
(2acfd9fc074931ce97c35ae5722914ad) [DEPLOYING].
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Impulse ->
[1]Create/FlatMap(<lambda at core.py:2421>) (1/1)
(1aab0c81bd9c8f70db0b2588b85ceac6) switched from CREATED to DEPLOYING.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task Source: Impulse -> [1]Create/FlatMap(<lambda at
core.py:2421>) (1/1) (1aab0c81bd9c8f70db0b2588b85ceac6) [DEPLOYING]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source:
Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)
(1aab0c81bd9c8f70db0b2588b85ceac6) [DEPLOYING].
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task [3]{Create,
Map(<lambda at fn_api_runner_test.py:601>), WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/1).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)
(1aab0c81bd9c8f70db0b2588b85ceac6) [DEPLOYING].
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at
fn_api_runner_test.py:601>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(4dfa89c59cfc22b83b9ddd947bd2d369) switched from CREATED to DEPLOYING.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task [3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(4dfa89c59cfc22b83b9ddd947bd2d369) [DEPLOYING]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task
[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(4dfa89c59cfc22b83b9ddd947bd2d369) [DEPLOYING].
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(4dfa89c59cfc22b83b9ddd947bd2d369) [DEPLOYING].
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupByKey
-> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that} (1/1).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that} (1/1)
(a61a3ef5f332b35bbfdaeee79ec8261e) switched from CREATED to DEPLOYING.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem
stream leak safety net for task GroupByKey -> [5]{Map(<lambda at
fn_api_runner_test.py:604>), assert_that} (1/1)
(a61a3ef5f332b35bbfdaeee79ec8261e) [DEPLOYING]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for
task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1) (a61a3ef5f332b35bbfdaeee79ec8261e) [DEPLOYING].
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at
network: GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>),
assert_that} (1/1) (a61a3ef5f332b35bbfdaeee79ec8261e) [DEPLOYING].
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task
ToKeyedWorkItem (1/1).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (e9dfdd45b72c92b540393b79c359cfe5) switched from CREATED
to DEPLOYING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Creating FileSystem stream leak safety net for task ToKeyedWorkItem (1/1)
(e9dfdd45b72c92b540393b79c359cfe5) [DEPLOYING]
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Loading JAR files for task ToKeyedWorkItem (1/1)
(e9dfdd45b72c92b540393b79c359cfe5) [DEPLOYING].
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Impulse ->
[1]Create/FlatMap(<lambda at core.py:2421>) (1/1)
(1aab0c81bd9c8f70db0b2588b85ceac6) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse ->
[1]Create/FlatMap(<lambda at core.py:2421>) (1/1)
(1aab0c81bd9c8f70db0b2588b85ceac6) switched from DEPLOYING to RUNNING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Registering task at network: ToKeyedWorkItem (1/1)
(e9dfdd45b72c92b540393b79c359cfe5) [DEPLOYING].
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d) switched from CREATED to DEPLOYING.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at
fn_api_runner_test.py:601>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(4dfa89c59cfc22b83b9ddd947bd2d369) switched from DEPLOYING to RUNNING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream
leak safety net for task assert_that/Group/GroupByKey -> [3]assert_that/{Group,
Unkey, Match} (1/1) (d7a8a86c7b88eb1509aaf1249f6e808d) [DEPLOYING]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d) [DEPLOYING].
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create,
Map(<lambda at fn_api_runner_test.py:601>), WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/1) (4dfa89c59cfc22b83b9ddd947bd2d369) switched from
DEPLOYING to RUNNING.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Impulse ->
[4]assert_that/{Create, Group} (1/1) (2acfd9fc074931ce97c35ae5722914ad)
switched from DEPLOYING to RUNNING.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse ->
[4]assert_that/{Create, Group} (1/1) (2acfd9fc074931ce97c35ae5722914ad)
switched from DEPLOYING to RUNNING.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network:
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d) [DEPLOYING].
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d) switched from DEPLOYING to RUNNING.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that} (1/1)
(a61a3ef5f332b35bbfdaeee79ec8261e) switched from DEPLOYING to RUNNING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has
been configured, using default (Memory / JobManager) MemoryStateBackend (data
in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d) switched from DEPLOYING to RUNNING.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state
backend has been configured, using default (Memory / JobManager)
MemoryStateBackend (data in heap memory / checkpoints to JobManager)
(checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize:
5242880)
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that} (1/1)
(a61a3ef5f332b35bbfdaeee79ec8261e) switched from DEPLOYING to RUNNING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (e9dfdd45b72c92b540393b79c359cfe5) switched from
DEPLOYING to RUNNING.
[ToKeyedWorkItem (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(e9dfdd45b72c92b540393b79c359cfe5) switched from DEPLOYING to RUNNING.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - The operator name [3]{Create,
Map(<lambda at fn_api_runner_test.py:601>), WindowInto(WindowIntoFn)} exceeded
the 80 characters length limit and was truncated.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing
heap keyed state backend with stream factory.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend -
Initializing heap keyed state backend with stream factory.
Aug 14, 2019 12:19:43 PM
org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference
cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=785, target=localhost:35303}
was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until
awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at
org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:94)
at
org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:52)
at
org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:43)
at
org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:514)
at
org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at
org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:178)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:162)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.get(LocalCache.java:3952)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:211)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.<init>(DefaultJobBundleFactory.java:202)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:191)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:33225.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:46765.
INFO:root:State channel established.
WARNING:root:No unique name set for transform
fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform
fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating client data channel for localhost:36347
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client
connected.
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18,
[1]Create/FlatMap(<lambda at core.py:2421>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18,
[1]Create/FlatMap(<lambda at core.py:2421>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [1]Create/FlatMap(<lambda at core.py:2421>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18,
[1]Create/FlatMap(<lambda at core.py:2421>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [1]Create/FlatMap(<lambda at core.py:2421>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [1]Create/FlatMap(<lambda at core.py:2421>), 0]
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Impulse ->
[1]Create/FlatMap(<lambda at core.py:2421>) (1/1)
(1aab0c81bd9c8f70db0b2588b85ceac6) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source:
Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)
(1aab0c81bd9c8f70db0b2588b85ceac6).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2421>)
(1/1) (1aab0c81bd9c8f70db0b2588b85ceac6) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Source: Impulse
-> [1]Create/FlatMap(<lambda at core.py:2421>) 1aab0c81bd9c8f70db0b2588b85ceac6.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse ->
[1]Create/FlatMap(<lambda at core.py:2421>) (1/1)
(1aab0c81bd9c8f70db0b2588b85ceac6) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform
fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18,
[4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18,
[4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18,
[4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Impulse ->
[4]assert_that/{Create, Group} (1/1) (2acfd9fc074931ce97c35ae5722914ad)
switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source:
Impulse -> [4]assert_that/{Create, Group} (1/1)
(2acfd9fc074931ce97c35ae5722914ad).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1)
(2acfd9fc074931ce97c35ae5722914ad) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Source: Impulse
-> [4]assert_that/{Create, Group} 2acfd9fc074931ce97c35ae5722914ad.
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_9:0
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse ->
[4]assert_that/{Create, Group} (1/1) (2acfd9fc074931ce97c35ae5722914ad)
switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18, [3]{Create,
Map(<lambda at fn_api_runner_test.py:601>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]{Create, Map(<lambda at
fn_api_runner_test.py:601>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18, [3]{Create,
Map(<lambda at fn_api_runner_test.py:601>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]{Create, Map(<lambda at
fn_api_runner_test.py:601>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18, [3]{Create,
Map(<lambda at fn_api_runner_test.py:601>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]{Create, Map(<lambda at
fn_api_runner_test.py:601>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at
fn_api_runner_test.py:601>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(4dfa89c59cfc22b83b9ddd947bd2d369) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(4dfa89c59cfc22b83b9ddd947bd2d369).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:601>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(4dfa89c59cfc22b83b9ddd947bd2d369) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task [3]{Create,
Map(<lambda at fn_api_runner_test.py:601>), WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem 4dfa89c59cfc22b83b9ddd947bd2d369.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create,
Map(<lambda at fn_api_runner_test.py:601>), WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/1) (4dfa89c59cfc22b83b9ddd947bd2d369) switched from RUNNING
to FINISHED.
WARNING:root:No unique name set for transform
fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [5]{Map(<lambda at fn_api_runner_test.py:604>),
assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [5]{Map(<lambda at fn_api_runner_test.py:604>),
assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [5]{Map(<lambda at fn_api_runner_test.py:604>),
assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [5]{Map(<lambda at fn_api_runner_test.py:604>),
assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name 'beam.metric:element_count:v1'. Metric
will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18,
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'.
Metric will not be reported.[localhost, taskmanager,
9f89c3d6-bd48-47ff-82d0-072fe9d9fc60, test_windowing_1565785182.18,
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that} (1/1)
(a61a3ef5f332b35bbfdaeee79ec8261e) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1) (a61a3ef5f332b35bbfdaeee79ec8261e).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task GroupByKey -> [5]{Map(<lambda at
fn_api_runner_test.py:604>), assert_that} (1/1)
(a61a3ef5f332b35bbfdaeee79ec8261e) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that}
a61a3ef5f332b35bbfdaeee79ec8261e.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (e9dfdd45b72c92b540393b79c359cfe5) switched from RUNNING
to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (1/1)
(e9dfdd45b72c92b540393b79c359cfe5).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1)
(e9dfdd45b72c92b540393b79c359cfe5) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
e9dfdd45b72c92b540393b79c359cfe5.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:604>), assert_that} (1/1)
(a61a3ef5f332b35bbfdaeee79ec8261e) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(e9dfdd45b72c92b540393b79c359cfe5) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not
be reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will
not be reported.[localhost, taskmanager, 9f89c3d6-bd48-47ff-82d0-072fe9d9fc60,
test_windowing_1565785182.18, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory -
Closing environment urn: "beam:env:external:v1"
payload: "\n\021\022\017localhost:34321"
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for
unknown endpoint.
INFO:root:Closing all cached grpc data channels.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
[3]assert_that/{Group, Unkey, Match} (1/1) (d7a8a86c7b88eb1509aaf1249f6e808d)
[FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match}
d7a8a86c7b88eb1509aaf1249f6e808d.INFO:root:Closing all cached gRPC state
handlers.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(d7a8a86c7b88eb1509aaf1249f6e808d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
test_windowing_1565785182.18 (51a0537983b7b16859ea05acd771d097) switched from
state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job 51a0537983b7b16859ea05acd771d097.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
51a0537983b7b16859ea05acd771d097 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
test_windowing_1565785182.18(51a0537983b7b16859ea05acd771d097).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 51a0537983b7b16859ea05acd771d097.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
b7129c55d1128fd016e54acf992c9da6: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{ca45322beab04029def67d68406b047f}, jobId:
51a0537983b7b16859ea05acd771d097).
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint
org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet.
Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation
until processing is started.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
51a0537983b7b16859ea05acd771d097 from job leader monitoring.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager be896f3533e0555a88cab294c5cd4b17@akka://flink/user/jobmanager_61
for job 51a0537983b7b16859ea05acd771d097 from the resource manager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 51a0537983b7b16859ea05acd771d097.
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini
Cluster
[flink-runner-job-invoker] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_60.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcherbd27c9f7-e86d-4c50-bcc6-46e478b80855.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcherbd27c9f7-e86d-4c50-bcc6-46e478b80855.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-5adfa8fd-0337-4507-9267-279d731e40b3
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcherbd27c9f7-e86d-4c50-bcc6-46e478b80855.
[ForkJoinPool.commonPool-worker-9] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[ForkJoinPool.commonPool-worker-9] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_60.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to
/tmp/flinktest-confS5H1Xs/test-metrics.txt
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:43067
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 241
msecs
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO
org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers :
MetricQueryResults(Counters(26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at
fn_api_runner_test.py:604>)_23}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}:
0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at
fn_api_runner_test.py:604>)_23}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: 5,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: 5,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: 5,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: 1,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_30}: 1,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2421>)_4}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}:
0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at
fn_api_runner_test.py:601>)_17}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: 5,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2421>)_4}:
0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2421>)_27}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_18}: 1,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: 1,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: 1,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2421>)_27}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_24:0}: 1,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2421>)_27}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_29}: 1,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_27}: 1,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2421>)_4}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2421>)_4}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_28}: 1,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at
fn_api_runner_test.py:604>)_23}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at
fn_api_runner_test.py:604>)_23}: 0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: 1,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: 2,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: 5,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: 2,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}:
0,
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2421>)_27}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}:
0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at
fn_api_runner_test.py:601>)_17}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_24:1}: 2,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at
fn_api_runner_test.py:601>)_17}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: 2,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_23}: 2,
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: 2,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0,
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_Map(<lambda at
fn_api_runner_test.py:601>)_17}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1
{PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0,
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0,
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1
{PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}:
0)Distributions(14Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13,
count=1, min=13, max=13},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=70,
count=5, min=14, max=14},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=100,
count=5, min=20, max=20},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=140,
count=5, min=28, max=28},
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_24:1}: DistributionResult{sum=60,
count=2, min=29, max=31},
48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=80,
count=5, min=16, max=16},
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_24:0}: DistributionResult{sum=19,
count=1, min=19, max=19},
14Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=75,
count=5, min=15, max=15},
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=15,
count=1, min=15, max=15},
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=75,
count=2, min=36, max=39},
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_18}: DistributionResult{sum=16,
count=1, min=16, max=16},
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=66,
count=2, min=32, max=34},
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=13,
count=1, min=13, max=13},
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_30}: DistributionResult{sum=14,
count=1, min=14, max=14},
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_28}: DistributionResult{sum=47,
count=1, min=47, max=47},
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_29}: DistributionResult{sum=39,
count=1, min=39, max=39},
26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=17,
count=1, min=17, max=17},
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=46,
count=2, min=22, max=24},
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=48,
count=2, min=23, max=25},
24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_23}: DistributionResult{sum=52,
count=2, min=25, max=27},
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
{PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult{sum=59,
count=1, min=59, max=59}))
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/flinktestO1Metq/job_b38a6df1-af1a-4064-9860-5d7c211f4bb0/MANIFEST has 0
artifact locations
[flink-runner-job-invoker] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
- Removed dir /tmp/flinktestO1Metq/job_b38a6df1-af1a-4064-9860-5d7c211f4bb0/
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confS5H1Xs
----------------------------------------------------------------------
Ran 76 tests in 104.073s
OK (skipped=16)
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py2/build.gradle'>
line: 209
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py2:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 0s
65 actionable tasks: 49 executed, 15 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/65nly3gdm6z66
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
