See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/787/display/redirect?page=changes>
Changes: [github] Remove conscrypt as security provider. (#7056) ------------------------------------------ [...truncated 4.05 MB...] [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Received confirmation of leadership for leader http://localhost:41863 , session=2a5ce224-0829-44f2-b474-b8cfea9b4c87 [flink-runner-job-server] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/dispatcherd31e08ed-66c1-455e-b215-426f6f9f7c15 . [flink-runner-job-server] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Proposing leadership to contender org.apache.flink.runtime.dispatcher.StandaloneDispatcher@538e2a7d @ akka://flink/user/dispatcherd31e08ed-66c1-455e-b215-426f6f9f7c15 [flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Flink Mini Cluster started successfully [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Dispatcher akka://flink/user/dispatcherd31e08ed-66c1-455e-b215-426f6f9f7c15 was granted leadership with fencing token 394bc5ce-8536-4f9b-8af5-edecebb5423c [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Recovering all persisted jobs. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Received confirmation of leadership for leader akka://flink/user/dispatcherd31e08ed-66c1-455e-b215-426f6f9f7c15 , session=394bc5ce-8536-4f9b-8af5-edecebb5423c [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Submitting job 1fc276e70e1b3fc98384586ff0756cd1 (test_windowing_1542422730.62). [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/jobmanager_39 . [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Initializing job test_windowing_1542422730.62 (1fc276e70e1b3fc98384586ff0756cd1). [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Using restart strategy NoRestartStrategy for test_windowing_1542422730.62 (1fc276e70e1b3fc98384586ff0756cd1). [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.slotpool.SlotPool at akka://flink/user/6bc734e3-e242-40d3-b1c1-2a3f4650db16 . [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job recovers via failover strategy: full graph restart [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Running initialization on master for job test_windowing_1542422730.62 (1fc276e70e1b3fc98384586ff0756cd1). [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Successfully ran initialization on master in 0 ms. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Proposing leadership to contender org.apache.flink.runtime.jobmaster.JobManagerRunner@54a02fd2 @ akka://flink/user/jobmanager_39 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobManagerRunner - JobManager runner for job test_windowing_1542422730.62 (1fc276e70e1b3fc98384586ff0756cd1) was granted leadership with session id 80dc07be-6a69-4926-a6eb-0ce91c0002fa at akka://flink/user/jobmanager_39. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Starting execution of job test_windowing_1542422730.62 (1fc276e70e1b3fc98384586ff0756cd1) [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1542422730.62 (1fc276e70e1b3fc98384586ff0756cd1) switched from state CREATED to RUNNING. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) switched from CREATED to SCHEDULED. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) switched from CREATED to SCHEDULED. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) switched from CREATED to SCHEDULED. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) switched from CREATED to SCHEDULED. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) switched from CREATED to SCHEDULED. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) switched from CREATED to SCHEDULED. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{006625c14593cbcb099988567257d4d3}] [jobmanager-future-thread-1] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Received confirmation of leadership for leader akka://flink/user/jobmanager_39 , session=80dc07be-6a69-4926-a6eb-0ce91c0002fa [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Connecting to ResourceManager akka://flink/user/resourcemanager_9c081a15-d6df-47e3-abe9-7bf1d4dc9b43(831eb1d2b1079b60d0bfaa596757426e) [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Resolved ResourceManager address, beginning registration [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Registration at ResourceManager attempt 1 (timeout=100ms) [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Registering job manager a6eb0ce91c0002fa80dc07be6a694926@akka://flink/user/jobmanager_39 for job 1fc276e70e1b3fc98384586ff0756cd1. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Registered job manager a6eb0ce91c0002fa80dc07be6a694926@akka://flink/user/jobmanager_39 for job 1fc276e70e1b3fc98384586ff0756cd1. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - JobManager successfully registered at ResourceManager, leader id: 831eb1d2b1079b60d0bfaa596757426e. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Requesting new slot [SlotRequestId{006625c14593cbcb099988567257d4d3}] and profile ResourceProfile{cpuCores=-1.0, heapMemoryInMB=-1, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0} from resource manager. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Request slot with profile ResourceProfile{cpuCores=-1.0, heapMemoryInMB=-1, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0} for job 1fc276e70e1b3fc98384586ff0756cd1 with allocation id AllocationID{37fde015b2207cd596abc1621a5020f8}. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Receive slot request AllocationID{37fde015b2207cd596abc1621a5020f8} for job 1fc276e70e1b3fc98384586ff0756cd1 from resource manager with leader id 831eb1d2b1079b60d0bfaa596757426e. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Allocated slot for AllocationID{37fde015b2207cd596abc1621a5020f8}. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Add job 1fc276e70e1b3fc98384586ff0756cd1 for job leader monitoring. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Try to register at job manager akka://flink/user/jobmanager_39 with leader id 80dc07be-6a69-4926-a6eb-0ce91c0002fa. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Resolved JobManager address, beginning registration [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Registration at JobManager attempt 1 (timeout=100ms) [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Successful registration at job manager akka://flink/user/jobmanager_39 for job 1fc276e70e1b3fc98384586ff0756cd1. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Establish JobManager connection for job 1fc276e70e1b3fc98384586ff0756cd1. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Offer reserved slots to the leader of job 1fc276e70e1b3fc98384586ff0756cd1. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Activate slot AllocationID{37fde015b2207cd596abc1621a5020f8}. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) switched from SCHEDULED to DEPLOYING. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (attempt #0) to localhost [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) switched from SCHEDULED to DEPLOYING. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (attempt #0) to localhost [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) switched from SCHEDULED to DEPLOYING. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (attempt #0) to localhost [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) switched from SCHEDULED to DEPLOYING. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (attempt #0) to localhost [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1). [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) switched from SCHEDULED to DEPLOYING. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying ToKeyedWorkItem (1/1) (attempt #0) to localhost [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) switched from CREATED to DEPLOYING. [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) [DEPLOYING] [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) switched from SCHEDULED to DEPLOYING. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (attempt #0) to localhost [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1). [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) [DEPLOYING]. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1). [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) switched from CREATED to DEPLOYING. [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) [DEPLOYING]. [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) [DEPLOYING] [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) [DEPLOYING]. [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) switched from CREATED to DEPLOYING. [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) [DEPLOYING] [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) [DEPLOYING]. [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) [DEPLOYING]. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1). [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) [DEPLOYING]. [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) switched from CREATED to DEPLOYING. [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) [DEPLOYING] [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) [DEPLOYING]. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task ToKeyedWorkItem (1/1). [ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) switched from CREATED to DEPLOYING. [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) [DEPLOYING]. [ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) [DEPLOYING] [ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) [DEPLOYING]. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1). [ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) [DEPLOYING]. [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) switched from DEPLOYING to RUNNING. [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) switched from CREATED to DEPLOYING. [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) [DEPLOYING] [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) switched from DEPLOYING to RUNNING. [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) [DEPLOYING]. [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) switched from DEPLOYING to RUNNING. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) switched from DEPLOYING to RUNNING. [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) [DEPLOYING]. [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) switched from DEPLOYING to RUNNING. [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) switched from DEPLOYING to RUNNING. [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) switched from DEPLOYING to RUNNING. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) switched from DEPLOYING to RUNNING. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) switched from DEPLOYING to RUNNING. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) switched from DEPLOYING to RUNNING. [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) [ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) switched from DEPLOYING to RUNNING. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) switched from DEPLOYING to RUNNING. [ToKeyedWorkItem (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 exceeded the 80 characters length limit and was truncated. [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] WARN org.apache.beam.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found [grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/flinktest9703Af/job_31220d94-85f3-4f65-9915-90bab03095c5/MANIFEST [grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/flinktest9703Af/job_31220d94-85f3-4f65-9915-90bab03095c5/MANIFEST [grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/flinktest9703Af/job_31220d94-85f3-4f65-9915-90bab03095c5/MANIFEST has 0 artifact locations [grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/flinktest9703Af/job_31220d94-85f3-4f65-9915-90bab03095c5/MANIFEST -> 0 artifacts [grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected. [grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created. [grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:45813 [grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp [grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail. [grpc-default-executor-1] INFO pipeline_options.get_all_options - Parsing unknown args: [u'--direct_runner_use_stacked_bundle', u'--options_id=20', u'--pipeline_type_check', u'--sdk_worker_parallelism=1'] [grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'runner': u'None', 'streaming': True, 'experiments': [u'beam_fn_api'], 'sdk_location': u'container', 'flink_master': '[auto]', 'direct_runner_use_stacked_bundle': None, 'sdk_worker_parallelism': u'1', 'job_name': u'test_windowing_1542422730.62', 'options_id': u'20', 'pipeline_type_check': None, 'parallelism': 1, 'job_endpoint': u'localhost:50497'} [grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel. [grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established. [grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers. [grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1 [grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating channel for localhost:35845 [grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0 [grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0 [grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:40021 [grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected. [grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0 [grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0 [grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0 [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) switched from RUNNING to FINISHED. [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832). [Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) [FINISHED] [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem f803e54e46aef7e9cc0ebbdeba11c832. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source -> 14Create/Impulse.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (f803e54e46aef7e9cc0ebbdeba11c832) switched from RUNNING to FINISHED. [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) switched from RUNNING to FINISHED. [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e). [Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) [FINISHED] [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 5d0529f61bffaf9aaa8f717c553c9c3e. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source -> 26assert_that/Create/Impulse.None/beam:env:docker:v1:0 (1/1) (5d0529f61bffaf9aaa8f717c553c9c3e) switched from RUNNING to FINISHED. [grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0 [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) switched from RUNNING to FINISHED. [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520). [Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) [FINISHED] [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem 3c546bdf8ef3c9b4f5f27e4daee24520. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey -> 72Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 -> ToKeyedWorkItem (1/1) (3c546bdf8ef3c9b4f5f27e4daee24520) switched from RUNNING to FINISHED. [grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0 [grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0 [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) switched from RUNNING to FINISHED. [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492). [GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) [FINISHED] [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 c065a228a412b5276aab5b505d70a492. [ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) switched from RUNNING to FINISHED. [ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8). [ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) [FINISHED] [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem e7298ee13b4d82c60eca47951b7bead8. [grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> 24GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (c065a228a412b5276aab5b505d70a492) switched from RUNNING to FINISHED. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (e7298ee13b4d82c60eca47951b7bead8) switched from RUNNING to FINISHED. [grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane [grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete [grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels. [grpc-default-executor-0] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint. [grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers. [grpc-default-executor-1] INFO sdk_worker.run - Done consuming work. [grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting. [grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up. [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint. [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) switched from RUNNING to FINISHED. [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396). [assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) [FINISHED] [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 3b15ad7ccf1b15814b03cc1cfbe44396. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:docker:v1:0 (1/1) (3b15ad7ccf1b15814b03cc1cfbe44396) switched from RUNNING to FINISHED. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1542422730.62 (1fc276e70e1b3fc98384586ff0756cd1) switched from state RUNNING to FINISHED. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 1fc276e70e1b3fc98384586ff0756cd1. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 1fc276e70e1b3fc98384586ff0756cd1 reached globally terminal state FINISHED. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1542422730.62(1fc276e70e1b3fc98384586ff0756cd1). [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1fc276e70e1b3fc98384586ff0756cd1. [flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 1a8d9f175edefa75c0c669abf1454535: JobManager is shutting down.. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started. [flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager a6eb0ce91c0002fa80dc07be6a694926@akka://flink/user/jobmanager_39 for job 1fc276e70e1b3fc98384586ff0756cd1 from the resource manager. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherd31e08ed-66c1-455e-b215-426f6f9f7c15. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherd31e08ed-66c1-455e-b215-426f6f9f7c15. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager. [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager. [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job 1fc276e70e1b3fc98384586ff0756cd1 with leader id a6eb0ce91c0002fa80dc07be6a694926 lost leadership. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator. [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherd31e08ed-66c1-455e-b215-426f6f9f7c15. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{37fde015b2207cd596abc1621a5020f8}, jobId: 1fc276e70e1b3fc98384586ff0756cd1). [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 1fc276e70e1b3fc98384586ff0756cd1 from job leader monitoring. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1fc276e70e1b3fc98384586ff0756cd1. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_38. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager. [ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-e6de6b40-d569-4f76-8512-8eaa96847eae [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_38. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service. [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:43677 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service. [flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 2122 msecs [flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values: [flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@4064a3ad INFO:root:Job state changed to DONE . ---------------------------------------------------------------------- Ran 26 tests in 74.710s OK (skipped=8) :beam-sdks-python:flinkCompatibilityMatrixStreamingDOCKER (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 1 mins 16.714 secs. FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 390 * What went wrong: Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchDOCKER'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 10m 23s 60 actionable tasks: 55 executed, 4 from cache, 1 up-to-date Publishing build scan... https://gradle.com/s/66rzvlzsu5zgi Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
