Hi all,
I have the task of maintaining a year old akka app using remoting. The app
consists of two services (lets say frontend and backend) communicating
using remoting with protobuf serialization.
Both the services are currently running as a service in docker swarm. When
there is only 1 replica running of both, everything works perfectly fine.
But as soon as you scale up or increase the number of replicas, I see a lot
of message loss. Messages sent by the frontend service to the backend
service are not seen in the logs of backend. There are no errors in the
logs.
After a few hours, no message reaches the backend service. And I have to
force restart both the services to have some messages flowing across them.
Here is some information I think would be useful. Let me know if you guys
need to something else.
Scala version : 2.11.8
Akka version : 2.4.10
Protobuf version : 2
Remoting config for frontend service :
remote {
enabled-transports = ["akka.remote.netty.tcp"]
netty.tcp {
hostname = frontend # external (logical) hostname
port = 40 # external (logical) port
//bind-hostname = ${?CLUSTER_IP} # internal (bind) hostname
bind-port = 0
}
log-sent-messages = on
log-received-messages = off
}
Remoting config for backend service :
remote {
enabled-transports = ["akka.remote.netty.tcp"]
netty.tcp {
hostname = backend # external (logical) hostname
port = 40 # external (logical) port
bind-hostname = "0.0.0.0" # internal (bind) hostname
bind-port = 40
}
log-sent-messages = on
log-received-messages = on
}
I thought there is some problem with the config but then no messages should
have gotten through. Number of messages getting across consistently
deteriorates as time passes.
The problem can be with docker swarm too but I have got many apps
communicating over tcp and I see no message loss there.
If you guys can help me resolve this problem, it would be great.
--
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ:
>>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.
