[
https://issues.apache.org/jira/browse/FLINK-20433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245537#comment-17245537
]
Arvid Heise commented on FLINK-20433:
-------------------------------------
Here is what I found so far
{noformat}
2352548 [Canceler/Interrupts for Co-Flat Map (5/10)#0
(1eb45101078c3c44fa9afe0dbc24438d).] WARN
org.apache.flink.runtime.taskmanager.Task [] - Task 'Co-Flat Map (5/10)#0' did
not react to cancelling signal for 30 seconds, but is stuck in method:
sun.misc.Unsafe.park(Native Method)
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailboxImpl.take(TaskMailboxImpl.java:146)
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMail(MailboxProcessor.java:299)
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:184)
org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:575)
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:539)
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:722)
org.apache.flink.runtime.taskmanager.Task.run(Task.java:547)
java.lang.Thread.run(Thread.java:748)
2352549 [Channel state writer Co-Flat Map (5/10)#0] INFO
org.apache.flink.runtime.checkpoint.channel.ChannelStateWriteRequestExecutorImpl
[] - Co-Flat Map (5/10)#0 discarding 0 drained requests
2420987 [flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Releasing idle
slot [5850c7cfe5d8e887fe4737fb0986758c].
2420988 [flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot
TaskSlot(index:5, state:ACTIVE, resource profile:
ResourceProfile{managedMemory=12.800mb (13421772 bytes), networkMemory=1.211mb
(1269760 bytes)}, allocationId: 5850c7cfe5d8e887fe4737fb0986758c, jobId:
65ffa0ced988506d4592f90c99ab229e).
2461120 [flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - The
heartbeat of JobManager with id 3753a8e06a92fbde2fb9f5d3df9765d1 timed out.
2461121 [flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Disconnect job manager
bd023567e60248ccc91218c3199b454e@akka://flink/user/rpc/jobmanager_2651 for job
65ffa0ced988506d4592f90c99ab229e from the resource manager.
2461169 [flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of
JobManager with id 3753a8e06a92fbde2fb9f5d3df9765d1 timed out.
2501973 [Cancellation Watchdog for Source: source1 (1/10)#0
(47b4cde3fa5e54347c5db26b93c02184).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2501978 [Cancellation Watchdog for Source: source1 (1/10)#0
(47b4cde3fa5e54347c5db26b93c02184).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2501984 [Cancellation Watchdog for Co-Flat Map (8/10)#0
(f03a73c986d011c44ab8c329085804bd).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2501984 [Cancellation Watchdog for Co-Flat Map (8/10)#0
(f03a73c986d011c44ab8c329085804bd).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502444 [Cancellation Watchdog for Source: source2 (10/10)#0
(7a22e419a0146e25271189020934a960).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502444 [Cancellation Watchdog for Source: source2 (10/10)#0
(7a22e419a0146e25271189020934a960).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502455 [Cancellation Watchdog for Co-Flat Map (4/10)#0
(a075ed79662df896685feb37b902d955).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502455 [Cancellation Watchdog for Source: source2 (6/10)#0
(72ec87ae80a77e00fd1f84b89b166c0f).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502455 [Cancellation Watchdog for Co-Flat Map (4/10)#0
(a075ed79662df896685feb37b902d955).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502455 [Cancellation Watchdog for Source: source2 (7/10)#0
(24fda3060a38f00121e0aa25b4f7e9d9).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502455 [Cancellation Watchdog for Source: source2 (6/10)#0
(72ec87ae80a77e00fd1f84b89b166c0f).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502455 [Cancellation Watchdog for Source: source2 (5/10)#0
(bf1cd7da9c901353b9c8187cc1db500f).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502455 [Cancellation Watchdog for Source: source2 (5/10)#0
(bf1cd7da9c901353b9c8187cc1db500f).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502455 [Cancellation Watchdog for Source: source2 (7/10)#0
(24fda3060a38f00121e0aa25b4f7e9d9).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502472 [Cancellation Watchdog for Co-Flat Map (10/10)#0
(a90a10bf8a01935775737ee1438b0ce0).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502472 [Cancellation Watchdog for Source: source3 (1/10)#0
(11cade852942882f435bddf9c3b6cfd3).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502472 [Cancellation Watchdog for Co-Flat Map (10/10)#0
(a90a10bf8a01935775737ee1438b0ce0).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502472 [Cancellation Watchdog for Co-Flat Map (9/10)#0
(502e8b25f9c33abd6d0e615b510ce22f).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502472 [Cancellation Watchdog for Source: source3 (1/10)#0
(11cade852942882f435bddf9c3b6cfd3).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502472 [Cancellation Watchdog for Co-Flat Map (3/10)#0
(0a7deb8cda33a56bc79beae85bf24dc4).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502472 [Cancellation Watchdog for Co-Flat Map (9/10)#0
(502e8b25f9c33abd6d0e615b510ce22f).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502472 [Cancellation Watchdog for Co-Flat Map (3/10)#0
(0a7deb8cda33a56bc79beae85bf24dc4).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Source: source3 (2/10)#0
(d7cad58baef7f789afc9d0d2c7dfaaa2).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Source: source3 (5/10)#0
(0c794fe8fc03bf9f6ea08d51dfd823d8).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Source: source3 (2/10)#0
(d7cad58baef7f789afc9d0d2c7dfaaa2).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Source: source3 (4/10)#0
(bf77a39b6129d4a729b08e20b24ca49e).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Source: source3 (5/10)#0
(0c794fe8fc03bf9f6ea08d51dfd823d8).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Source: source3 (3/10)#0
(d7851d29aa2e4eecdfef37246a29270c).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Source: source3 (4/10)#0
(bf77a39b6129d4a729b08e20b24ca49e).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Co-Flat Map (10/10)#0
(1cbd7d12a3a921e5566192e2617139a4).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Source: source3 (3/10)#0
(d7851d29aa2e4eecdfef37246a29270c).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502484 [Cancellation Watchdog for Co-Flat Map (10/10)#0
(1cbd7d12a3a921e5566192e2617139a4).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502511 [Cancellation Watchdog for Co-Flat Map (2/10)#0
(bcab4e1a913ff9ed9c41bec9e4767d59).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502511 [Cancellation Watchdog for Co-Flat Map (2/10)#0
(bcab4e1a913ff9ed9c41bec9e4767d59).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502511 [Cancellation Watchdog for Source: source3 (8/10)#0
(5ccac7de9b45d631a6ce060c2cca0118).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502512 [Cancellation Watchdog for Source: source3 (8/10)#0
(5ccac7de9b45d631a6ce060c2cca0118).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502512 [Cancellation Watchdog for Source: source3 (9/10)#0
(a24446ab9b63bc8b94fd3474b108cd48).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502512 [Cancellation Watchdog for Source: source3 (9/10)#0
(a24446ab9b63bc8b94fd3474b108cd48).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502519 [Cancellation Watchdog for Co-Flat Map (1/10)#0
(884100dac941362fa235cc0f3f8b3da6).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502519 [Cancellation Watchdog for Co-Flat Map (1/10)#0
(884100dac941362fa235cc0f3f8b3da6).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502533 [Cancellation Watchdog for Source: source3 (6/10)#0
(bc5635c4872cc096f797b085d4953b10).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502533 [Cancellation Watchdog for Co-Flat Map (6/10)#0
(ced0432e702b16981de3aec2d2900665).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502533 [Cancellation Watchdog for Co-Flat Map (5/10)#0
(1eb45101078c3c44fa9afe0dbc24438d).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502533 [Cancellation Watchdog for Source: source3 (6/10)#0
(bc5635c4872cc096f797b085d4953b10).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502533 [Cancellation Watchdog for Co-Flat Map (6/10)#0
(ced0432e702b16981de3aec2d2900665).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502533 [Cancellation Watchdog for Source: source3 (7/10)#0
(95dab299c2b85baf67e5ed066d6ff596).] ERROR
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Task did not exit
gracefully within 180 + seconds.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502534 [Cancellation Watchdog for Co-Flat Map (5/10)#0
(1eb45101078c3c44fa9afe0dbc24438d).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
2502534 [Cancellation Watchdog for Source: source3 (7/10)#0
(95dab299c2b85baf67e5ed066d6ff596).] ERROR
org.apache.flink.runtime.minicluster.MiniCluster [] - TaskManager #2 failed.
org.apache.flink.util.FlinkRuntimeException: Task did not exit gracefully
within 180 + seconds.
at
org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1573)
[classes/:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
{noformat}
> UnalignedCheckpointTestBase.execute failed with "TestTimedOutException: test
> timed out after 300 seconds"
> ---------------------------------------------------------------------------------------------------------
>
> Key: FLINK-20433
> URL: https://issues.apache.org/jira/browse/FLINK-20433
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
> Affects Versions: 1.12.0, 1.13.0
> Reporter: Dian Fu
> Assignee: Arvid Heise
> Priority: Critical
> Labels: test-stability
> Fix For: 1.12.0, 1.13.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10353&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=a99e99c7-21cd-5a1f-7274-585e62b72f56
> {code}
> 2020-12-01T01:33:37.8672135Z [ERROR] execute[Parallel cogroup, p =
> 10](org.apache.flink.test.checkpointing.UnalignedCheckpointITCase) Time
> elapsed: 300.308 s <<< ERROR!
> 2020-12-01T01:33:37.8672736Z org.junit.runners.model.TestTimedOutException:
> test timed out after 300 seconds
> 2020-12-01T01:33:37.8673110Z at sun.misc.Unsafe.park(Native Method)
> 2020-12-01T01:33:37.8673463Z at
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> 2020-12-01T01:33:37.8673951Z at
> java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
> 2020-12-01T01:33:37.8674429Z at
> java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
> 2020-12-01T01:33:37.8686627Z at
> java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
> 2020-12-01T01:33:37.8687167Z at
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 2020-12-01T01:33:37.8687859Z at
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1842)
> 2020-12-01T01:33:37.8696554Z at
> org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:70)
> 2020-12-01T01:33:37.8697226Z at
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1822)
> 2020-12-01T01:33:37.8697885Z at
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1804)
> 2020-12-01T01:33:37.8698514Z at
> org.apache.flink.test.checkpointing.UnalignedCheckpointTestBase.execute(UnalignedCheckpointTestBase.java:122)
> 2020-12-01T01:33:37.8699131Z at
> org.apache.flink.test.checkpointing.UnalignedCheckpointITCase.execute(UnalignedCheckpointITCase.java:159)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
