See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/523/display/redirect>
------------------------------------------
[...truncated 4.49 MB...]
[flink-runner-job-server] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
- Starting RPC endpoint for
org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
akka://flink/user/dispatchera134ff9b-cfe7-46c1-bf4d-d510e38e5338 .
[flink-runner-job-server] INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Proposing leadership to contender
org.apache.flink.runtime.dispatcher.StandaloneDispatcher@f011864 @
akka://flink/user/dispatchera134ff9b-cfe7-46c1-bf4d-d510e38e5338
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster
- Flink Mini Cluster started successfully
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Dispatcher
akka://flink/user/dispatchera134ff9b-cfe7-46c1-bf4d-d510e38e5338 was granted
leadership with fencing token 50c084be-33aa-40b2-baa9-f8c4e61eae60
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Recovering all
persisted jobs.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Received confirmation of leadership for leader
akka://flink/user/dispatchera134ff9b-cfe7-46c1-bf4d-d510e38e5338 ,
session=50c084be-33aa-40b2-baa9-f8c4e61eae60
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Submitting job
9af5e245bbf18ae17c6bbf586d2cfe59 (test_windowing_1540577439.87).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for
org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/jobmanager_41
.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Initializing job
test_windowing_1540577439.87 (9af5e245bbf18ae17c6bbf586d2cfe59).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Using restart strategy
NoRestartStrategy for test_windowing_1540577439.87
(9af5e245bbf18ae17c6bbf586d2cfe59).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for
org.apache.flink.runtime.jobmaster.slotpool.SlotPool at
akka://flink/user/d17c04ab-8d94-4426-8511-eceacec49431 .
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job recovers via
failover strategy: full graph restart
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Running initialization on master
for job test_windowing_1540577439.87 (9af5e245bbf18ae17c6bbf586d2cfe59).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Successfully ran initialization
on master in 0 ms.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Proposing leadership to contender
org.apache.flink.runtime.jobmaster.JobManagerRunner@54e82c8 @
akka://flink/user/jobmanager_41
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobManagerRunner - JobManager runner for job
test_windowing_1540577439.87 (9af5e245bbf18ae17c6bbf586d2cfe59) was granted
leadership with session id 5b209810-29a3-4966-90ea-75baf5a15f0b at
akka://flink/user/jobmanager_41.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Starting execution of job
test_windowing_1540577439.87 (9af5e245bbf18ae17c6bbf586d2cfe59)
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
test_windowing_1540577439.87 (9af5e245bbf18ae17c6bbf586d2cfe59) switched from
state CREATED to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source
-> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source
-> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) switched from
CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Cannot serve slot
request, no ResourceManager connected. Adding as pending request
[SlotRequestId{05153887198e4785283798fcf9782857}]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) switched from CREATED to SCHEDULED.
[jobmanager-future-thread-1] INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Received confirmation of leadership for leader
akka://flink/user/jobmanager_41 , session=5b209810-29a3-4966-90ea-75baf5a15f0b
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Connecting to ResourceManager
akka://flink/user/resourcemanager_33326dd5-04d7-4487-a651-2d0bae861c60(a592c4540e2fa56b672b67c39a4a4b5e)
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Resolved ResourceManager
address, beginning registration
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Registration at ResourceManager
attempt 1 (timeout=100ms)
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager -
Registering job manager
90ea75baf5a15f0b5b20981029a34966@akka://flink/user/jobmanager_41 for job
9af5e245bbf18ae17c6bbf586d2cfe59.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Registered
job manager 90ea75baf5a15f0b5b20981029a34966@akka://flink/user/jobmanager_41
for job 9af5e245bbf18ae17c6bbf586d2cfe59.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.JobMaster - JobManager successfully
registered at ResourceManager, leader id: a592c4540e2fa56b672b67c39a4a4b5e.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Requesting new slot
[SlotRequestId{05153887198e4785283798fcf9782857}] and profile
ResourceProfile{cpuCores=-1.0, heapMemoryInMB=-1, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0} from resource manager.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Request
slot with profile ResourceProfile{cpuCores=-1.0, heapMemoryInMB=-1,
directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0} for job
9af5e245bbf18ae17c6bbf586d2cfe59 with allocation id
AllocationID{4265690eff914aac3e4105cd46158311}.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Receive slot request
AllocationID{4265690eff914aac3e4105cd46158311} for job
9af5e245bbf18ae17c6bbf586d2cfe59 from resource manager with leader id
a592c4540e2fa56b672b67c39a4a4b5e.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Allocated slot for
AllocationID{4265690eff914aac3e4105cd46158311}.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Add job
9af5e245bbf18ae17c6bbf586d2cfe59 for job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Try to register at job
manager akka://flink/user/jobmanager_41 with leader id
5b209810-29a3-4966-90ea-75baf5a15f0b.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Resolved JobManager
address, beginning registration
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Registration at
JobManager attempt 1 (timeout=100ms)
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Successful
registration at job manager akka://flink/user/jobmanager_41 for job
9af5e245bbf18ae17c6bbf586d2cfe59.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Establish JobManager
connection for job 9af5e245bbf18ae17c6bbf586d2cfe59.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Offer reserved slots to
the leader of job 9af5e245bbf18ae17c6bbf586d2cfe59.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Activate slot
AllocationID{4265690eff914aac3e4105cd46158311}.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source
-> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source:
Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(attempt #0) to localhost
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source
-> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source:
Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem
(1/1) (attempt #0) to localhost
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (attempt #0) to localhost
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Source:
Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1).
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupByKey
-> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (attempt #0) to
localhost
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) switched from CREATED to DEPLOYING.
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) [DEPLOYING]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying
ToKeyedWorkItem (1/1) (attempt #0) to localhost
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source:
Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) [DEPLOYING].
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Source:
Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem
(1/1).
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) switched from SCHEDULED to DEPLOYING.
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source:
Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem
(1/1) (f1ccfbb670c158d2ba885bbf449a2d18) switched from CREATED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(attempt #0) to localhost
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Creating FileSystem stream leak safety net for task Source: Custom Source ->
14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18) [DEPLOYING]
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading
JAR files for task Source: Custom Source ->
14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18) [DEPLOYING].
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0
(1/1) (cbc3fc1f95bdb28922313187131d36a6) [DEPLOYING].
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Registering task at network: Source: Custom Source ->
14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18) [DEPLOYING].
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1).
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) switched from
CREATED to DEPLOYING.
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Creating FileSystem stream leak safety net for task
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) [DEPLOYING]
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Loading JAR files for task
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) [DEPLOYING].
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Registering task at network:
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) [DEPLOYING].
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupByKey
-> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1).
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) switched from CREATED to DEPLOYING.
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) [DEPLOYING]
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task
GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) [DEPLOYING].
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) [DEPLOYING].
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task
ToKeyedWorkItem (1/1).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (b288cabdb026ec7de8d1d330e65901ff) switched from CREATED
to DEPLOYING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Creating FileSystem stream leak safety net for task ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff) [DEPLOYING]
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Loading JAR files for task ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff) [DEPLOYING].
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Registering task at network: ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff) [DEPLOYING].
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) switched from CREATED to DEPLOYING.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream
leak safety net for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) [DEPLOYING]
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) [DEPLOYING].
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network:
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) [DEPLOYING].
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) switched from DEPLOYING to RUNNING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (b288cabdb026ec7de8d1d330e65901ff) switched from
DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) switched from DEPLOYING to RUNNING.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has
been configured, using default (Memory / JobManager) MemoryStateBackend (data
in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[ToKeyedWorkItem (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff) switched from DEPLOYING to RUNNING.
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) switched from
DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) switched from
DEPLOYING to RUNNING.
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) switched from DEPLOYING to RUNNING.
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) switched from DEPLOYING to RUNNING.
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been
configured, using default (Memory / JobManager) MemoryStateBackend (data in
heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints:
'null', asynchronous: TRUE, maxStateSize: 5242880)
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source
-> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) switched from DEPLOYING to RUNNING.
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source:
Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem
(1/1) (f1ccfbb670c158d2ba885bbf449a2d18) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source
-> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18) switched from DEPLOYING to RUNNING.
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask
- No state backend has been configured, using default (Memory / JobManager)
MemoryStateBackend (data in heap memory / checkpoints to JobManager)
(checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize:
5242880)
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing
heap keyed state backend with stream factory.
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - The
operator name
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
exceeded the 80 characters length limit and was truncated.
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO
org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap
keyed state backend with stream factory.
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap
keyed state backend with stream factory.
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] WARN
org.apache.beam.runners.fnexecution.environment.DockerCommand - Unable to pull
docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause:
Received exit code 1 for command 'docker pull
jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response
from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- GetManifest for
/tmp/flinktestQnB6h1/job_0ca30f36-b23d-475b-979c-950e0582cd8e/MANIFEST
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Loading manifest for retrieval token
/tmp/flinktestQnB6h1/job_0ca30f36-b23d-475b-979c-950e0582cd8e/MANIFEST
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- Manifest at
/tmp/flinktestQnB6h1/job_0ca30f36-b23d-475b-979c-950e0582cd8e/MANIFEST has 0
artifact locations
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
- GetManifest for
/tmp/flinktestQnB6h1/job_0ca30f36-b23d-475b-979c-950e0582cd8e/MANIFEST -> 0
artifacts
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn
Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server
running at localhost:36763
[grpc-default-executor-1] INFO sdk_worker_main.main -
semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session
file found: /tmp/staged/pickled_main_session. Functions defined in __main__
(interactive session) may fail.
[grpc-default-executor-1] INFO pipeline_options.get_all_options - Parsing
unknown args: [u'--direct_runner_use_stacked_bundle', u'--options_id=21',
u'--pipeline_type_check', u'--sdk_worker_parallelism=pipeline']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness
started with pipeline_options: {'runner': u'None', 'streaming': True,
'experiments': [u'beam_fn_api'], 'sdk_location': u'container', 'flink_master':
'[auto]', 'direct_runner_use_stacked_bundle': None, 'sdk_worker_parallelism':
u'pipeline', 'job_name': u'test_windowing_1540577439.87', 'options_id': u'21',
'pipeline_type_check': None, 'parallelism': 1, 'job_endpoint':
u'localhost:50187'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control
channel.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel
established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness
with 12 workers.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating
channel for localhost:45545
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating
channel for localhost:41151
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client
connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source:
Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem
(1/1) (f1ccfbb670c158d2ba885bbf449a2d18) switched from RUNNING to FINISHED.
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing
task resources for Source: Custom Source ->
14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18).
[Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 ->
ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task Source: Custom Source ->
14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Source: Custom
Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem
f1ccfbb670c158d2ba885bbf449a2d18.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source
-> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)
(f1ccfbb670c158d2ba885bbf449a2d18) switched from RUNNING to FINISHED.
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) switched from RUNNING to FINISHED.
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source:
Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6).
[Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task Source: Custom Source ->
26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Source: Custom
Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0
cbc3fc1f95bdb28922313187131d36a6.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source
-> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)
(cbc3fc1f95bdb28922313187131d36a6) switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_7:0
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) switched from
RUNNING to FINISHED.
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7).
[Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem f21e9ebf3967a27da29e749078a099c7.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey ->
72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
-> ToKeyedWorkItem (1/1) (f21e9ebf3967a27da29e749078a099c7) switched from
RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) switched from RUNNING to FINISHED.
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa).
[GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
18def75db1ceee8d72ac420829e340aa.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
ToKeyedWorkItem (1/1) (b288cabdb026ec7de8d1d330e65901ff) switched from RUNNING
to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task ToKeyedWorkItem
b288cabdb026ec7de8d1d330e65901ff.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey ->
24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(18def75db1ceee8d72ac420829e340aa) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1)
(b288cabdb026ec7de8d1d330e65901ff) switched from RUNNING to FINISHED.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique
name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control
plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for
in-flight requests to complete
[grpc-default-executor-1] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data
channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state
handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness
exiting.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client
hanged up.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for
unknown endpoint.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey
-> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317).
[assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)]
INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem
streams are closed for task assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0
12bc0945f45ccc2383a8f4c5e56f5317.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph -
assert_that/Group/GroupByKey ->
42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)
(12bc0945f45ccc2383a8f4c5e56f5317) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
test_windowing_1540577439.87 (9af5e245bbf18ae17c6bbf586d2cfe59) switched from
state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint
coordinator for job 9af5e245bbf18ae17c6bbf586d2cfe59.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job
9af5e245bbf18ae17c6bbf586d2cfe59 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job
test_windowing_1540577439.87(9af5e245bbf18ae17c6bbf586d2cfe59).
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 9af5e245bbf18ae17c6bbf586d2cfe59.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster
- Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection
f16bb80ce4627d0b7296a89f0d384198: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-server] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest
endpoint.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher
akka://flink/user/dispatchera134ff9b-cfe7-46c1-bf4d-d510e38e5338.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all
currently running jobs of dispatcher
akka://flink/user/dispatchera134ff9b-cfe7-46c1-bf4d-d510e38e5338.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect
job manager 90ea75baf5a15f0b5b20981029a34966@akka://flink/user/jobmanager_41
for job 9af5e245bbf18ae17c6bbf586d2cfe59 from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint
org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet.
Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation
until processing is started.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the
SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending
the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Unregister
TaskManager 363fb80efa25fceaf38c402d5a306498 from the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
AllocationID{4265690eff914aac3e4105cd46158311}, jobId:
9af5e245bbf18ae17c6bbf586d2cfe59).
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Could not resolve
JobManager address akka://flink/user/jobmanager_41, retrying in 10000 ms: Could
not connect to rpc endpoint under address akka://flink/user/jobmanager_41..
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
9af5e245bbf18ae17c6bbf586d2cfe59 from job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job
9af5e245bbf18ae17c6bbf586d2cfe59 with leader id
90ea75baf5a15f0b5b20981029a34966 lost leadership.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager
connection for job 9af5e245bbf18ae17c6bbf586d2cfe59.
[ForkJoinPool.commonPool-worker-11] INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
- Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor
akka://flink/user/taskmanager_40.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher
akka://flink/user/dispatchera134ff9b-cfe7-46c1-bf4d-d510e38e5338.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed
spill file directory /tmp/flink-io-11c6a760-59f3-4c34-9edf-0defd5dd8983
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the
network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader
service.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor
akka://flink/user/taskmanager_40.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:44251
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Execution finished in 1828 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner -
__metricscontainers :
org.apache.beam.runners.core.metrics.MetricsContainerStepMap@876b5bea
.
----------------------------------------------------------------------
Ran 26 tests in 75.162s
OK (skipped=7)
:beam-sdks-python:flinkCompatibilityMatrixStreamingDOCKER (Thread[Task worker
for ':' Thread 7,5,main]) completed. Took 1 mins 17.178 secs.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'>
line: 368
* What went wrong:
Execution failed for task
':beam-sdks-python:flinkCompatibilityMatrixBatchDOCKER'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 31s
60 actionable tasks: 55 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bwvsjshazwwg2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
