See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/160/display/redirect?page=changes>
Changes:
[shaun] added avroio package
[shaun] updated read emits to support both string and custom type reflects
[shaun] added avro write support
[shaun] updated to be in-line with beam project specifications
[shaun] update package log prints
[shaun] added readavro example
[shaun] updated example package header
[shaun] removed output.avro file
------------------------------------------
[...truncated 51.25 MB...]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
c633cf15e30ed2275224a3354e8fd86c.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)
(1f2b260c3b409534308db2a8f5d2eee8) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
a3e4eef03690e31a45011788d2431e82.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (2/16)
(bf05d0b948b39e429170155db38e9a17) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(16/16) (2e74ffba7924f8876449d1eee7b17c06) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
c40b18006bfb098619ce15fe99192466.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (8/16)
(69ce17ab65312a85eddff6bf1bf7ad2b) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
c054ed4eea544cba2619c670f29fa532.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
72cf525daf848ff48de315f4b05ab4e1.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
cb6c713edcaf5b5643db1407910d999a.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(13/16) (3cb9a4fed799c743790b7a4f36893aac) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
0674be15c7e70082bf893d8569a3c10b.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
b5d075cdc08a5f6b8026ac65fc2a8fd4.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
d061bb6995f1769d399fd3235ffa17ac.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
e0b371c06cfd05de68338186776a6dc3.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
f19bf3c54f91e1d3e00ea4dae6fc80d4.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)
(831b4b7cc163e734c69eea42a5b8aff0) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
17e36560b2b3c027ddcc18a2efa7f69f.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
fd99e417b175cf5431b209842f953dba.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
fb165bba995a3b2ff270ae7f2d380920.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
252cc3fd126a94935a757878b64db838.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
ce019c4b81ef879df38ecbd196d5dcc5.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)
(3927e26609876202d077a61b0a125109) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
82ce8adf5165c869f30bf152a0a1920e.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)
(c633cf15e30ed2275224a3354e8fd86c) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)
(a3e4eef03690e31a45011788d2431e82) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)
(c40b18006bfb098619ce15fe99192466) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(15/16) (c054ed4eea544cba2619c670f29fa532) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(12/16) (72cf525daf848ff48de315f4b05ab4e1) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)
(cb6c713edcaf5b5643db1407910d999a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(14/16) (0674be15c7e70082bf893d8569a3c10b) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (6/16)
(b5d075cdc08a5f6b8026ac65fc2a8fd4) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(11/16) (d061bb6995f1769d399fd3235ffa17ac) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(10/16) (e0b371c06cfd05de68338186776a6dc3) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)
(f19bf3c54f91e1d3e00ea4dae6fc80d4) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (5/16)
(17e36560b2b3c027ddcc18a2efa7f69f) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (4/16)
(fd99e417b175cf5431b209842f953dba) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)
(fb165bba995a3b2ff270ae7f2d380920) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/16)
(252cc3fd126a94935a757878b64db838) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (3/16)
(ce019c4b81ef879df38ecbd196d5dcc5) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (9/16)
(82ce8adf5165c869f30bf152a0a1920e) switched from RUNNING to FINISHED.
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(55f857df97a5aa4c9d1281bf4f0438a2) switched from RUNNING to FINISHED.
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(55f857df97a5aa4c9d1281bf4f0438a2).
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(55f857df97a5aa4c9d1281bf4f0438a2) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
55f857df97a5aa4c9d1281bf4f0438a2.
[ToKeyedWorkItem (7/16)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (7/16) (defe2bec280bab8c561d7d86518a82eb) switched from RUNNING
to FINISHED.
[ToKeyedWorkItem (7/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (7/16)
(defe2bec280bab8c561d7d86518a82eb).
[ToKeyedWorkItem (7/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (7/16)
(defe2bec280bab8c561d7d86518a82eb) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(8/16) (4f9aef45a77df129d65799730599ddc0) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(5/16) (24294bed902f7342eb89761be8dbaaab) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(55f857df97a5aa4c9d1281bf4f0438a2) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(16/16) (9423548abf8b9abf8ed6df4ae5c66938) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)
(9423548abf8b9abf8ed6df4ae5c66938).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)
(24294bed902f7342eb89761be8dbaaab).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)
(9423548abf8b9abf8ed6df4ae5c66938) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(1/16) (fa60eea410ed02a0141d20bddcdbf34e) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)
(fa60eea410ed02a0141d20bddcdbf34e).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(15/16) (8d9f4cd2a49afff73be7af446aed3127) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)
(8d9f4cd2a49afff73be7af446aed3127).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)
(4f9aef45a77df129d65799730599ddc0).
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
9423548abf8b9abf8ed6df4ae5c66938.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)
(24294bed902f7342eb89761be8dbaaab) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(4/16) (1b3db8591a4d5240fbc68d2b2f01cad6) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)
(1b3db8591a4d5240fbc68d2b2f01cad6).
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
defe2bec280bab8c561d7d86518a82eb.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
24294bed902f7342eb89761be8dbaaab.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)
(9423548abf8b9abf8ed6df4ae5c66938) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)
(fa60eea410ed02a0141d20bddcdbf34e) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(3/16) (e56e9efd451c0689b26dd7b2b8c15188) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)
(e56e9efd451c0689b26dd7b2b8c15188).
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
fa60eea410ed02a0141d20bddcdbf34e.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (7/16)
(defe2bec280bab8c561d7d86518a82eb) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(14/16) (38ea366c23610db54ae10140315bd728) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)
(38ea366c23610db54ae10140315bd728).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(12/16) (4a1d221154b891ff8c8821407c6f804a) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)
(4a1d221154b891ff8c8821407c6f804a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)
(24294bed902f7342eb89761be8dbaaab) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(7/16) (62e78156452fe71f72320754fdbf3345) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(62e78156452fe71f72320754fdbf3345).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(11/16) (ab2b1db21002aa34482629785df87c53) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)
(ab2b1db21002aa34482629785df87c53).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)
(fa60eea410ed02a0141d20bddcdbf34e) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(9/16) (c6aadcb54505db4613843afc96dd28d7) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)
(c6aadcb54505db4613843afc96dd28d7).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(6/16) (d5ec48222f2fa5ca0337d5380b4e69a3) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)
(d5ec48222f2fa5ca0337d5380b4e69a3).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(13/16) (e402c6969413e638ddda286c0b954ca5) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)
(e402c6969413e638ddda286c0b954ca5).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(10/16) (8615ed47d5cd745e4073104ef6b77818) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)
(8615ed47d5cd745e4073104ef6b77818).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)
(1b3db8591a4d5240fbc68d2b2f01cad6) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
1b3db8591a4d5240fbc68d2b2f01cad6.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)
(4f9aef45a77df129d65799730599ddc0) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)
(8d9f4cd2a49afff73be7af446aed3127) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
4f9aef45a77df129d65799730599ddc0.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)
(8615ed47d5cd745e4073104ef6b77818) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)
(e402c6969413e638ddda286c0b954ca5) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)
(d5ec48222f2fa5ca0337d5380b4e69a3) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
8d9f4cd2a49afff73be7af446aed3127.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)
(1b3db8591a4d5240fbc68d2b2f01cad6) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)
(c6aadcb54505db4613843afc96dd28d7) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
8615ed47d5cd745e4073104ef6b77818.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)
(4f9aef45a77df129d65799730599ddc0) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
e402c6969413e638ddda286c0b954ca5.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)
(ab2b1db21002aa34482629785df87c53) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(62e78156452fe71f72320754fdbf3345) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)
(4a1d221154b891ff8c8821407c6f804a) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
d5ec48222f2fa5ca0337d5380b4e69a3.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)
(8d9f4cd2a49afff73be7af446aed3127) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
c6aadcb54505db4613843afc96dd28d7.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)
(8615ed47d5cd745e4073104ef6b77818) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
ab2b1db21002aa34482629785df87c53.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)
(38ea366c23610db54ae10140315bd728) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)
(e56e9efd451c0689b26dd7b2b8c15188) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)
(e402c6969413e638ddda286c0b954ca5) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
62e78156452fe71f72320754fdbf3345.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)
(d5ec48222f2fa5ca0337d5380b4e69a3) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
4a1d221154b891ff8c8821407c6f804a.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
38ea366c23610db54ae10140315bd728.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)
(c6aadcb54505db4613843afc96dd28d7) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
e56e9efd451c0689b26dd7b2b8c15188.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)
(ab2b1db21002aa34482629785df87c53) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(62e78156452fe71f72320754fdbf3345) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)
(4a1d221154b891ff8c8821407c6f804a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)
(38ea366c23610db54ae10140315bd728) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)
(e56e9efd451c0689b26dd7b2b8c15188) switched from RUNNING to FINISHED.
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control
plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for
in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data
channels.
[grpc-default-executor-1] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state
handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness
exiting.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
hanged up.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)]
ERROR
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory
- Unable to close FlinkExecutableStageContext.
java.lang.IllegalStateException: call already closed
at
org.apache.beam.vendor.guava.v20.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at
org.apache.beam.vendor.grpc.v1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at
org.apache.beam.vendor.grpc.v1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at
org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:54)
at
org.apache.beam.runners.fnexecution.GrpcFnServer.close(GrpcFnServer.java:83)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:179)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.close(FlinkDefaultExecutableStageContext.java:62)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingFlinkExecutableStageContextFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingFlinkExecutableStageContextFactory.java:161)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.release(ReferenceCountingFlinkExecutableStageContextFactory.java:149)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.scheduleRelease(ReferenceCountingFlinkExecutableStageContextFactory.java:109)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.access$300(ReferenceCountingFlinkExecutableStageContextFactory.java:40)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.close(ReferenceCountingFlinkExecutableStageContextFactory.java:181)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.$closeResource(ExecutableStageDoFnOperator.java:187)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.close(ExecutableStageDoFnOperator.java:202)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:438)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:323)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(2/16) (e4db0849bcc3ea9d2f60af5f90d0d4a2) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)
(e4db0849bcc3ea9d2f60af5f90d0d4a2).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)
(e4db0849bcc3ea9d2f60af5f90d0d4a2) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
e4db0849bcc3ea9d2f60af5f90d0d4a2.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)
(e4db0849bcc3ea9d2f60af5f90d0d4a2) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
test_windowing_1538070289.6 (c63eaf26b1425ba24b17d6fcce55527a) switched from
state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job c63eaf26b1425ba24b17d6fcce55527a.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
c63eaf26b1425ba24b17d6fcce55527a reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
test_windowing_1538070289.6(c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job c63eaf26b1425ba24b17d6fcce55527a.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
cd6905f530d313b36fceb87c36e74f1f: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 922b828bae69b5109211416e115d421c@akka://flink/user/jobmanager_39
for job c63eaf26b1425ba24b17d6fcce55527a from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster
- Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcher45671cb7-0e54-41df-8127-abe46397c719.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcher45671cb7-0e54-41df-8127-abe46397c719.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Unregister
TaskManager b1ddde091a9083b8a27ebadb60a887c4 from the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
c63eaf26b1425ba24b17d6fcce55527a with leader id
922b828bae69b5109211416e115d421c lost leadership.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{da398ff8b8726fc32b6ffbd2ed375107}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:3, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{242098469289108a6bf2a9103317c576}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:6, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{6fa594a6c4087d075b66ca8b7bc6b7da}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{4629a5a79bc9f73d3467a3bad6bc857f}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcher45671cb7-0e54-41df-8127-abe46397c719.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:12, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{6ff95217598bf8a1249a690c6f3cc775}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:10, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{376e1affad77b43adebf04708e5c07ed}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:8, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{5e9afb9762af6ea0d15f886bf88cadfb}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:7, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{94036f3475fd9e7712429b712c6e47a2}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:4, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{ba05cb1d12c78ff8dea6fb1ea2bfe13b}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:15, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{6ef9f7cec8d1dc10c86038247cdc1e5d}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:14, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{3b3824b7694ed8752f8d4ff5681b664c}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:11, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{1b373b508f568f0463887ac4bdab060e}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:2, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{9ee0778b4cea6ccf6be6a0bc7a67b8bf}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:9, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{8c0c74cf7e6d96831f39488ce26fd6ba}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:5, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{8409246c25297b8e418e2bf12a22640e}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:13, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{0486ab33684eefe09c023c9e9d7b6b0e}, jobId:
c63eaf26b1425ba24b17d6fcce55527a).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
c63eaf26b1425ba24b17d6fcce55527a from job leader monitoring.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job c63eaf26b1425ba24b17d6fcce55527a.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_38.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-0baee4bc-9ddf-4d22-833b-f7c607195384
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[ForkJoinPool.commonPool-worker-11] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_38.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:44015
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 1837 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
org.apache.beam.runners.core.metrics.MetricsContainerStepMap@e140c12c
.
----------------------------------------------------------------------
Ran 24 tests in 72.562s
OK (skipped=6)
Segmentation fault (core dumped)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreaming FAILED
:beam-sdks-python:flinkCompatibilityMatrixStreaming (Thread[Task worker for ':'
Thread 10,5,main]) completed. Took 1 mins 14.691 secs.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 45s
59 actionable tasks: 54 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bu43dpqd4bd26
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
