See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/39/display/redirect>
------------------------------------------
[...truncated 4.03 MB...]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task
ToKeyedWorkItem (1/1).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) switched from CREATED
to DEPLOYING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Creating FileSystem stream leak safety net for task ToKeyedWorkItem (1/1)
(20fe71c08cf703995f5ebf8aec662211) [DEPLOYING]
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Loading JAR files for task ToKeyedWorkItem (1/1)
(20fe71c08cf703995f5ebf8aec662211) [DEPLOYING].
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - The operator name [3]{Create,
Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} exceeded
the 80 characters length limit and was truncated.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Registering task at network: ToKeyedWorkItem (1/1)
(20fe71c08cf703995f5ebf8aec662211) [DEPLOYING].
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)
(006aa08460b3b13bcf216c958760ca71) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)
(006aa08460b3b13bcf216c958760ca71) switched from DEPLOYING to RUNNING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) switched from
DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(20fe71c08cf703995f5ebf8aec662211) switched from DEPLOYING to RUNNING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> [3]assert_that/{Group, Unkey, Match} (1/1)
(4cb462184bcbb5ade3368e21d707e243) switched from CREATED to DEPLOYING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream
leak safety net for task assert_that/Group/GroupByKey -> [3]assert_that/{Group,
Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) [DEPLOYING]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state
backend has been configured, using default (Memory / JobManager)
MemoryStateBackend (data in heap memory / checkpoints to JobManager)
(checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize:
5242880)
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(4cb462184bcbb5ade3368e21d707e243) [DEPLOYING].
[ToKeyedWorkItem (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network:
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(4cb462184bcbb5ade3368e21d707e243) [DEPLOYING].
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> [3]assert_that/{Group, Unkey, Match} (1/1)
(4cb462184bcbb5ade3368e21d707e243) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(4cb462184bcbb5ade3368e21d707e243) switched from DEPLOYING to RUNNING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has
been configured, using default (Memory / JobManager) MemoryStateBackend (data
in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
INFO:root:Creating insecure control channel for localhost:34885.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing
heap keyed state backend with stream factory.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend -
Initializing heap keyed state backend with stream factory.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:41219.
INFO:root:State channel established.
WARNING:root:No unique name set for transform
fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform
fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:41075
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client
connected.
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24,
[1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24,
[1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24,
[1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24,
[4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24,
[4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24,
[4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform
fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Impulse ->
[1]Create/FlatMap(<lambda at core.py:2049>) (1/1)
(fa079aa815ec448bf90941d3a02ee13f) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source:
Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)
(fa079aa815ec448bf90941d3a02ee13f).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>)
(1/1) (fa079aa815ec448bf90941d3a02ee13f) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Source: Impulse
-> [1]Create/FlatMap(<lambda at core.py:2049>) fa079aa815ec448bf90941d3a02ee13f.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse ->
[1]Create/FlatMap(<lambda at core.py:2049>) (1/1)
(fa079aa815ec448bf90941d3a02ee13f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]{Create,
Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:element_count:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [3]{Create, Map(<lambda at
fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]{Create,
Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'.
Metric will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]{Create,
Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN
org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a
Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [3]{Create, Map(<lambda at
fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Impulse ->
[4]assert_that/{Create, Group} (1/1) (bb7104545f6de0aeea5a53c3e3088eaa)
switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source:
Impulse -> [4]assert_that/{Create, Group} (1/1)
(bb7104545f6de0aeea5a53c3e3088eaa).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1)
(bb7104545f6de0aeea5a53c3e3088eaa) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Source: Impulse
-> [4]assert_that/{Create, Group} bb7104545f6de0aeea5a53c3e3088eaa.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse ->
[4]assert_that/{Create, Group} (1/1) (bb7104545f6de0aeea5a53c3e3088eaa)
switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at
fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(a5773c59aed557a37f68eda356b716ed) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(a5773c59aed557a37f68eda356b716ed).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>),
WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)
(a5773c59aed557a37f68eda356b716ed) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task [3]{Create,
Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem a5773c59aed557a37f68eda356b716ed.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create,
Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} ->
ToKeyedWorkItem (1/1) (a5773c59aed557a37f68eda356b716ed) switched from RUNNING
to FINISHED.
WARNING:root:No unique name set for transform
fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>),
assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>),
assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name 'beam.metric:element_count:v1'. Metric
will not be reported.[localhost, taskmanager,
40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24,
[5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>),
assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group
already contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>),
assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)
(006aa08460b3b13bcf216c958760ca71) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources
for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1) (006aa08460b3b13bcf216c958760ca71).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
(1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task GroupByKey -> [5]{Map(<lambda at
fn_api_runner_test.py:405>), assert_that} (1/1)
(006aa08460b3b13bcf216c958760ca71) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}
006aa08460b3b13bcf216c958760ca71.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) switched from RUNNING
to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (1/1)
(20fe71c08cf703995f5ebf8aec662211).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1)
(20fe71c08cf703995f5ebf8aec662211) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
20fe71c08cf703995f5ebf8aec662211.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
[5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)
(006aa08460b3b13bcf216c958760ca71) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(20fe71c08cf703995f5ebf8aec662211) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform
fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name
'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name
'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name
'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not
be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already
contains a Metric with the name
'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be
reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d,
test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for
unknown endpoint.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> [3]assert_that/{Group, Unkey, Match} (1/1)
(4cb462184bcbb5ade3368e21d707e243) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(4cb462184bcbb5ade3368e21d707e243).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
[3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243)
[FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 367, in next
return self._next()
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1547921190.441273251","description":"Error received from
peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 367, in next
return self._next()
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py";,>
line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string =
"{"created":"@1547921190.441273251","description":"Error received from
peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer
hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match}
4cb462184bcbb5ade3368e21d707e243.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)
(4cb462184bcbb5ade3368e21d707e243) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
test_windowing_1547921189.24 (1d73f29a157ed63792549044848493e6) switched from
state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job 1d73f29a157ed63792549044848493e6.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
1d73f29a157ed63792549044848493e6 reached globally terminal state FINISHED.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
test_windowing_1547921189.24(1d73f29a157ed63792549044848493e6).INFO:root:Done
consuming work.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 1d73f29a157ed63792549044848493e6.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
b1c697ea173a2e238ac3cef6602ab090: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{8815e97cb15d8529578de5358d85b58e}, jobId:
1d73f29a157ed63792549044848493e6).
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster
- Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 9968acb355a45dbdffbcc398b0ef4b85@akka://flink/user/jobmanager_45
for job 1d73f29a157ed63792549044848493e6 from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
1d73f29a157ed63792549044848493e6 from job leader monitoring.
[flink-runner-job-server] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 1d73f29a157ed63792549044848493e6.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcherb6ff28ec-1f01-484d-8b37-fcb436362343.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcherb6ff28ec-1f01-484d-8b37-fcb436362343.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint
org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet.
Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation
until processing is started.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-59cbcf7d-e4c5-4fee-b9ef-6ac016e49c95
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[ForkJoinPool.commonPool-worker-2] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcherb6ff28ec-1f01-484d-8b37-fcb436362343.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to
/tmp/flinktest-conf45Pr96/test-metrics.txt
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:40555
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 426 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
org.apache.beam.runners.core.metrics.MetricsContainerStepMap@d96ae896
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-conf45Pr96
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in
test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_flattened_side_input_1547921155.06_707080ba-f43a-419b-8d2c-223dc2c39d75
failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes
[PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name:
"17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 51.161s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'>
line: 347
* What went wrong:
Execution failed for task
':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'>
line: 347
* What went wrong:
Execution failed for task
':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 20s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/5l6l4mjrytoc2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
