See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/149/display/redirect?page=changes>
Changes:
[ankurgoenka] Add PortablePipelineOption for environment
[ankurgoenka] Lazy initializing JobBundleFactory supporting multiple type of
[ankurgoenka] Adding environment to python portable options
[ankurgoenka] Go Changes for using configurable environment. Only docker is
supported
------------------------------------------
[...truncated 51.27 MB...]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)
(213d8d9c83f5621ed2e3e95c82f2ad0f) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (14/16)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (14/16) (fd12199645f2ffb647bcf0acc0437a3d) switched from
RUNNING to FINISHED.
[ToKeyedWorkItem (14/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (14/16)
(fd12199645f2ffb647bcf0acc0437a3d).
[ToKeyedWorkItem (14/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (14/16)
(fd12199645f2ffb647bcf0acc0437a3d) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
8414d706bce1be495ecec59763a1de63.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
443ea166004922ce339da3ecafb296d1.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)
(ec3068de54369b7f5c3d3e11f3e5ccf9) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
cf559d6a7ef7205a2914b6434dbe1c8b.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
b3d90dca169a7c5dad2c0e0c67c29f1e.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
3862c8e6314cae71e0d73d4417231868.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
4f084dd856be32e427f85df7207bcdf2.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
6381b1e2034c899df1f10e83c6dd457a.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
030c4348aba77dfff343cbda305abb08.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)
(8d12aa55e620b2d454226cf459c58726) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
67fe891f8779a5c5a070717d750280d7.
[ToKeyedWorkItem (12/16)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (12/16) (b40200523bbb206372bd00f6fa1e471d) switched from
RUNNING to FINISHED.
[ToKeyedWorkItem (12/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (12/16)
(b40200523bbb206372bd00f6fa1e471d).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
fd12199645f2ffb647bcf0acc0437a3d.
[ToKeyedWorkItem (12/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (12/16)
(b40200523bbb206372bd00f6fa1e471d) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
b40200523bbb206372bd00f6fa1e471d.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)
(e2a4d59d16bc21cf19276cb2090bf338) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (10/16)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (10/16) (eb5e12b21874c9760b06d5ebcbff919a) switched from
RUNNING to FINISHED.
[ToKeyedWorkItem (10/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (10/16)
(eb5e12b21874c9760b06d5ebcbff919a).
[ToKeyedWorkItem (10/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (10/16)
(eb5e12b21874c9760b06d5ebcbff919a) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
eb5e12b21874c9760b06d5ebcbff919a.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)
(9b16b11e1294b36aab83c842bdbc603d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)
(a908eafedba128f4c108f453fb890c6f) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)
(69bd2135ed67c9bc5bfca8c016f35054) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)
(6db411c7699f3fd250dd55a6db68d0c1) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (8/16)
(8414d706bce1be495ecec59763a1de63) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (5/16)
(443ea166004922ce339da3ecafb296d1) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(16/16) (cf559d6a7ef7205a2914b6434dbe1c8b) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (2/16)
(b3d90dca169a7c5dad2c0e0c67c29f1e) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (6/16)
(3862c8e6314cae71e0d73d4417231868) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(11/16) (4f084dd856be32e427f85df7207bcdf2) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (3/16)
(6381b1e2034c899df1f10e83c6dd457a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)
(030c4348aba77dfff343cbda305abb08) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (4/16)
(67fe891f8779a5c5a070717d750280d7) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(14/16) (fd12199645f2ffb647bcf0acc0437a3d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(12/16) (b40200523bbb206372bd00f6fa1e471d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem
(10/16) (eb5e12b21874c9760b06d5ebcbff919a) switched from RUNNING to FINISHED.
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(d3bcb09832456abb7cfa340cc86761b5) switched from RUNNING to FINISHED.
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(d3bcb09832456abb7cfa340cc86761b5).
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(d3bcb09832456abb7cfa340cc86761b5) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
d3bcb09832456abb7cfa340cc86761b5.
[ToKeyedWorkItem (7/16)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (7/16) (c68dc4a8201e86aea36e59dfa02f6a81) switched from RUNNING
to FINISHED.
[ToKeyedWorkItem (7/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (7/16)
(c68dc4a8201e86aea36e59dfa02f6a81).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(13/16) (6f471af90e7462a89304c40b54f42e10) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (7/16)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (7/16)
(c68dc4a8201e86aea36e59dfa02f6a81) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)
(6f471af90e7462a89304c40b54f42e10).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(5/16) (6731dd712e841dfb730718451e255416) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)
(6731dd712e841dfb730718451e255416).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)
(6f471af90e7462a89304c40b54f42e10) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(7/16) (136306feb7050a541604e406a2e7239a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
c68dc4a8201e86aea36e59dfa02f6a81.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)
(6731dd712e841dfb730718451e255416) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
6f471af90e7462a89304c40b54f42e10.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(d3bcb09832456abb7cfa340cc86761b5) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(10/16) (43cd1ff3e927778797a88df7451d47b5) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)
(43cd1ff3e927778797a88df7451d47b5).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(136306feb7050a541604e406a2e7239a).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)
(43cd1ff3e927778797a88df7451d47b5) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(136306feb7050a541604e406a2e7239a) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
6731dd712e841dfb730718451e255416.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (7/16)
(c68dc4a8201e86aea36e59dfa02f6a81) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
43cd1ff3e927778797a88df7451d47b5.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (13/16)
(6f471af90e7462a89304c40b54f42e10) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(14/16) (11c195f73b0da72cfc3fbb2ab67f5817) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)
(11c195f73b0da72cfc3fbb2ab67f5817).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)
(11c195f73b0da72cfc3fbb2ab67f5817) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
136306feb7050a541604e406a2e7239a.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(4/16) (57455ffb04564778417d1a2e1930a5d8) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)
(57455ffb04564778417d1a2e1930a5d8).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (5/16)
(6731dd712e841dfb730718451e255416) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
11c195f73b0da72cfc3fbb2ab67f5817.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (10/16)
(43cd1ff3e927778797a88df7451d47b5) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(1/16) (0efd113dc32982cb3b1c8ef9a9d8186f) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)
(0efd113dc32982cb3b1c8ef9a9d8186f).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (7/16)
(136306feb7050a541604e406a2e7239a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (14/16)
(11c195f73b0da72cfc3fbb2ab67f5817) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(11/16) (4945ab7efa075c1fa1fb6fecacaa9847) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(15/16) (aec49f6af044e8df35483aece57045cc) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(6/16) (e2fce5169dcea9db7b649af3a95d9635) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(8/16) (d59b9ab52b6ed6789075ec24317f2436) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)
(d59b9ab52b6ed6789075ec24317f2436).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(16/16) (6716389d93151f0441911d41f99887a5) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)
(4945ab7efa075c1fa1fb6fecacaa9847).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)
(6716389d93151f0441911d41f99887a5).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)
(e2fce5169dcea9db7b649af3a95d9635).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)
(aec49f6af044e8df35483aece57045cc).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)
(57455ffb04564778417d1a2e1930a5d8) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)
(aec49f6af044e8df35483aece57045cc) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
57455ffb04564778417d1a2e1930a5d8.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(9/16) (b553b1db77065e32474ba988f881032b) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)
(b553b1db77065e32474ba988f881032b).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(3/16) (f653f2cbc354862352b7125419c29444) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)
(f653f2cbc354862352b7125419c29444).
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
aec49f6af044e8df35483aece57045cc.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)
(e2fce5169dcea9db7b649af3a95d9635) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(12/16) (1377bc47e18e5b04f3165318e6614bf4) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)
(1377bc47e18e5b04f3165318e6614bf4).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)
(1377bc47e18e5b04f3165318e6614bf4) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)
(4945ab7efa075c1fa1fb6fecacaa9847) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
e2fce5169dcea9db7b649af3a95d9635.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)
(6716389d93151f0441911d41f99887a5) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)
(0efd113dc32982cb3b1c8ef9a9d8186f) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)
(f653f2cbc354862352b7125419c29444) [FINISHED]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)
(d59b9ab52b6ed6789075ec24317f2436) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
4945ab7efa075c1fa1fb6fecacaa9847.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (4/16)
(57455ffb04564778417d1a2e1930a5d8) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)
(b553b1db77065e32474ba988f881032b) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
6716389d93151f0441911d41f99887a5.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
f653f2cbc354862352b7125419c29444.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (15/16)
(aec49f6af044e8df35483aece57045cc) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
d59b9ab52b6ed6789075ec24317f2436.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
1377bc47e18e5b04f3165318e6614bf4.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (6/16)
(e2fce5169dcea9db7b649af3a95d9635) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
0efd113dc32982cb3b1c8ef9a9d8186f.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
b553b1db77065e32474ba988f881032b.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (11/16)
(4945ab7efa075c1fa1fb6fecacaa9847) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (16/16)
(6716389d93151f0441911d41f99887a5) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (3/16)
(f653f2cbc354862352b7125419c29444) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (8/16)
(d59b9ab52b6ed6789075ec24317f2436) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (12/16)
(1377bc47e18e5b04f3165318e6614bf4) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/16)
(0efd113dc32982cb3b1c8ef9a9d8186f) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (9/16)
(b553b1db77065e32474ba988f881032b) switched from RUNNING to FINISHED.
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control
plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for
in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data
channels.
[grpc-default-executor-1] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state
handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness
exiting.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
hanged up.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)]
ERROR
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory
- Unable to close FlinkExecutableStageContext.
java.lang.IllegalStateException: call already closed
at
org.apache.beam.vendor.guava.v20.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at
org.apache.beam.vendor.grpc.v1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at
org.apache.beam.vendor.grpc.v1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at
org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:54)
at
org.apache.beam.runners.fnexecution.GrpcFnServer.close(GrpcFnServer.java:83)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:179)
at
org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.close(FlinkDefaultExecutableStageContext.java:62)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingFlinkExecutableStageContextFactory.java:185)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingFlinkExecutableStageContextFactory.java:161)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.release(ReferenceCountingFlinkExecutableStageContextFactory.java:149)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.scheduleRelease(ReferenceCountingFlinkExecutableStageContextFactory.java:109)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory.access$300(ReferenceCountingFlinkExecutableStageContextFactory.java:40)
at
org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.close(ReferenceCountingFlinkExecutableStageContextFactory.java:181)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.$closeResource(ExecutableStageDoFnOperator.java:187)
at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.close(ExecutableStageDoFnOperator.java:202)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:438)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:323)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
(2/16) (0a852e13269b045df9dcb18e24deb626) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)
(0a852e13269b045df9dcb18e24deb626).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)
(0a852e13269b045df9dcb18e24deb626) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
0a852e13269b045df9dcb18e24deb626.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (2/16)
(0a852e13269b045df9dcb18e24deb626) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
test_windowing_1538000138.27 (15b243288c3da8ddd9b0d3e690b2bb58) switched from
state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job 15b243288c3da8ddd9b0d3e690b2bb58.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
15b243288c3da8ddd9b0d3e690b2bb58 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
test_windowing_1538000138.27(15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 15b243288c3da8ddd9b0d3e690b2bb58.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
7e280ee28d68d242060d8975cab5545b: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager a2c9dba765965684dd476e38cd9a4d52@akka://flink/user/jobmanager_39
for job 15b243288c3da8ddd9b0d3e690b2bb58 from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster
- Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatcherf7522cac-583e-4f06-a55c-724234291914.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatcherf7522cac-583e-4f06-a55c-724234291914.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
15b243288c3da8ddd9b0d3e690b2bb58 with leader id
a2c9dba765965684dd476e38cd9a4d52 lost leadership.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:4, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{82f9e7bb4b0495436835f971c56fec4e}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Unregister
TaskManager 5053b04001d8d0139c41164bd1b9b918 from the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatcherf7522cac-583e-4f06-a55c-724234291914.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:8, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{d48df1fb04a90233c6e83f4eae8977ec}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{671e1c260673c18661a793ee58c5c1c8}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:15, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{3070345879e20ad6d5cdd743f2a308c8}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{ae344f131ab4fbb190ef1234885e2173}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:7, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{7aa0ffa3b59e6c3ed09e59d7f8c8648a}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:14, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{84e6472eb2fcdbcfa5c99c248640c9c9}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:9, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{4fa3570651e9667f252e256d3fda25f4}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:6, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{3a58f7784a98971c7bd8a1d63eb7bb1b}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:5, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{21b8d40a29ef903dd3622f968c59e39b}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:2, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{6af879a3864223951bb2f716c838583d}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:10, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{2dc246fc0d67149dcd5cbb98ebf06caa}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:3, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{13a2fe9d29258d79a1cef595e605359f}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:11, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{208c2b9df9a0f5453d69555fc2da7247}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:12, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{574f4b442ca88df1ba45bda8cb002a63}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:13, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{66c87131c042249d1e61892bb937a951}, jobId:
15b243288c3da8ddd9b0d3e690b2bb58).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
15b243288c3da8ddd9b0d3e690b2bb58 from job leader monitoring.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 15b243288c3da8ddd9b0d3e690b2bb58.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_38.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-70a6cbe9-1aad-40e5-9fdd-dfe4c0b7d32f
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[ForkJoinPool.commonPool-worker-11] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_38.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:45267
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 1796 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
org.apache.beam.runners.core.metrics.MetricsContainerStepMap@8fc09b7e
.
----------------------------------------------------------------------
Ran 24 tests in 73.989s
OK (skipped=6)
Segmentation fault (core dumped)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreaming FAILED
:beam-sdks-python:flinkCompatibilityMatrixStreaming (Thread[Task worker for ':'
Thread 11,5,main]) completed. Took 1 mins 16.068 secs.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 7s
59 actionable tasks: 58 executed, 1 up-to-date
Publishing build scan...
https://gradle.com/s/advskqskcw3lw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
