To summarize, here is my setup: App ---> Cluster Singleton ---> Cluster sharded actor
In the failure scenario above, this looks like: App(on seed) ---> Cluster Singleton(on seed) --> Cluster sharded actor (on node1, separate node) So, my functional tests work fine when everything is in the same cluster. Even seems to run fine if I run everything on 127.0.0.1 (using net="host"). It is only when I am trying to start up each node separately that I am getting the issue. This is the same behavior whether I use --link or just standalone docker containers. This message is definitely the best clue I have so far, it happens when the Cluster Singleton tries to communicate with the cluster sharded actor on node1, a separate node... 01:07:37.565UTC [test] ERROR akka.remote.EndpointWriter akka.tcp://[email protected]:2551/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FDenis%40172.17.0.31%3A2551-0/endpointWriter - AssociationError [akka.tcp://[email protected]:2551] -> [akka.tcp://[email protected]:2551]: Error [Message is null] [ akka.actor.InvalidMessageException: Message is null at akka.dispatch.Envelope$.apply(AbstractDispatcher.scala:27) at akka.actor.Cell$class.sendMessage(ActorCell.scala:290) at akka.actor.ActorCell.sendMessage(ActorCell.scala:369) at akka.actor.LocalActorRef.$bang(ActorRef.scala:384) at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:89) at akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:929) at akka.actor.Actor$class.aroundReceive(Actor.scala:467) at akka.remote.EndpointActor.aroundReceive(Endpoint.scala:405) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238) at akka.dispatch.Mailbox.run(Mailbox.scala:220) at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) ] -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
