[
https://issues.apache.org/jira/browse/FLINK-31669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724815#comment-17724815
]
Sergey Nuyanzin edited comment on FLINK-31669 at 5/22/23 10:03 AM:
-------------------------------------------------------------------
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=49123&view=logs&j=5cae8624-c7eb-5c51-92d3-4d2dacedd221&t=5acec1b4-945b-59ca-34f8-168928ce5199&l=25935
HiveTableSinkITCase failed with {noformat}05:30:58,039
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting down
BLOB cache
05:30:58,039 [flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down
BLOB cache
05:30:58,044 [flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB
server at 0.0.0.0:46707
05:30:58,045 [flink-akka.actor.internal-dispatcher-3] ERROR
org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread
'flink-akka.actor.internal-dispatcher-3' produced an uncaught exception.
Stopping the process...
java.lang.NoClassDefFoundError: akka/actor/SuppressedDeadLetter
at
akka.actor.EmptyLocalActorRef.publishSupressedDeadLetter(ActorRef.scala:712)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:706)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:740)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:728)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailboxes$$anon$1.systemEnqueue(Mailboxes.scala:53)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:313)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.run(Mailbox.scala:231)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
[?:1.8.0_292]
at
java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
[?:1.8.0_292]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
[?:1.8.0_292]
at
java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
[?:1.8.0_292]
Caused by: java.lang.ClassNotFoundException: akka.actor.SuppressedDeadLetter
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
~[?:1.8.0_292]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_292]
at
org.apache.flink.core.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:149)
~[flink-core-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
at
org.apache.flink.core.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:112)
~[flink-core-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_292]
... 13 more
05:30:58,046 [flink-akka.actor.default-dispatcher-6] ERROR
org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread
'flink-akka.actor.default-dispatcher-6' produced an uncaught exception.
Stopping the process...
java.lang.NoClassDefFoundError: akka/actor/SuppressedDeadLetter
at
akka.actor.EmptyLocalActorRef.publishSupressedDeadLetter(ActorRef.scala:712)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:706)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:740)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:728)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailboxes$$anon$1.systemEnqueue(Mailboxes.scala:53)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:313)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.run(Mailbox.scala:230)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
[?:1.8.0_292]
at
java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
[?:1.8.0_292]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
[?:1.8.0_292]
at
java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
[?:1.8.0_292]{noformat} in logs
was (Author: sergey nuyanzin):
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=49123&view=logs&j=5cae8624-c7eb-5c51-92d3-4d2dacedd221&t=5acec1b4-945b-59ca-34f8-168928ce5199&l=25935
HiveTableSinkITCase failed with {noformat}05:30:58,039
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting down
BLOB cache
05:30:58,039 [flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down
BLOB cache
05:30:58,044 [flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB
server at 0.0.0.0:46707
05:30:58,045 [flink-akka.actor.internal-dispatcher-3] ERROR
org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread
'flink-akka.actor.internal-dispatcher-3' produced an uncaught exception.
Stopping the process...
java.lang.NoClassDefFoundError: akka/actor/SuppressedDeadLetter
at
akka.actor.EmptyLocalActorRef.publishSupressedDeadLetter(ActorRef.scala:712)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:706)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:740)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:728)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailboxes$$anon$1.systemEnqueue(Mailboxes.scala:53)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:313)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:273)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.run(Mailbox.scala:231)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
[?:1.8.0_292]
at
java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
[?:1.8.0_292]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
[?:1.8.0_292]
at
java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
[?:1.8.0_292]
Caused by: java.lang.ClassNotFoundException: akka.actor.SuppressedDeadLetter
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
~[?:1.8.0_292]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_292]
at
org.apache.flink.core.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:149)
~[flink-core-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
at
org.apache.flink.core.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:112)
~[flink-core-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_292]
... 13 more
05:30:58,046 [flink-akka.actor.default-dispatcher-6] ERROR
org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread
'flink-akka.actor.default-dispatcher-6' produced an uncaught exception.
Stopping the process...
java.lang.NoClassDefFoundError: akka/actor/SuppressedDeadLetter
at
akka.actor.EmptyLocalActorRef.publishSupressedDeadLetter(ActorRef.scala:712)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:706)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:740)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:728)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailboxes$$anon$1.systemEnqueue(Mailboxes.scala:53)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:313)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.run(Mailbox.scala:230)
~[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
[flink-rpc-akka_fed3d292-8e56-4744-acfd-0b51e8fd93fe.jar:1.16-SNAPSHOT]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
[?:1.8.0_292]
at
java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
[?:1.8.0_292]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
[?:1.8.0_292]
at
java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
[?:1.8.0_292]{noformat} in logs
since before {{NoClassDefFoundError}} in same thread it tries to shutdown blob
cache
{noformat}
INFO org.apache.flink.runtime.blob.PermanentBlobCache [] -
Shutting down BLOB cache
05:30:58,039 [flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down
BLOB cache
05:30:58,044 [flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB
server at 0.0.0.0:46707
{noformat}
couldn't it be the problem with {{blobCacheService}} in
{{org.apache.flink.runtime.taskexecutor.TaskManagerRunner#shutDownServices}} ?
> DynamicFilteringITCase failed fataly because of NoClassDefFoundError of
> akka/actor/SuppressedDeadLetter
> -------------------------------------------------------------------------------------------------------
>
> Key: FLINK-31669
> URL: https://issues.apache.org/jira/browse/FLINK-31669
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
> Affects Versions: 1.16.1, 1.18.0
> Reporter: Matthias Pohl
> Assignee: Chesnay Schepler
> Priority: Critical
> Labels: test-stability
> Attachments: mvn.FLINK-31669.log
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=47692&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=13752
> {code}
> [...]
> Mar 30 06:02:56 [ERROR] Error occurred in starting fork, check output in log
> Mar 30 06:02:56 [ERROR] Process Exit Code: 239
> Mar 30 06:02:56 [ERROR] Crashed tests:
> Mar 30 06:02:56 [ERROR]
> org.apache.flink.table.planner.runtime.batch.sql.DynamicFilteringITCase
> Mar 30 06:02:56 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:748)
> [...]
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)