Hi Piyush
There might be some network issue due to which were unable to send large > message, but when we switched the cluster on different network we were able > to send large messages of size 6.4 MB across machines. This is fine. > TCP operates on streams of bytes, there is no concept of message in the TCP level. The amount data should not matter whatever network you use. I suspect that while you increased the maximum frame size, you have not increased the send buffer for TCP. You should set akka.remote.netty.tcp. send-buffer-size and receive-buffer-size to larger values, otherwise your large messages might not fit into the buffers. See the configuration: http://doc.akka.io/docs/akka/2.2.3/scala/remoting.html#Remote_Configuration > > But when we try to send a message more than 6.4 Mb then cluster nodes > becomes unreachable to each other and no message is received at remote > machine. Now we are unable to reproduce the current issue and root cause > behind it. > All messages, including heartbeats share the same TCP connection. If you send large messages, heartbeats suffer delays because they have to wait until all the large messages has been pumped out. This might cause failure detectors to trigger. These are the points to consider: - Avoid using large messages - If you can't - split up large messages and send in chunks - or use a side-channel to send large chunks of data (i.e. a separate TCP connection) - If none of the above is possible, as a last resort, decrease the sensitivity of the failure detectors so they don't trigger on the delays caused by huge messages. > > Is there any hard limit on message-frame-size, or it is dependent on > network parameters, or os level tcp configuration. > There is no inherent limit on message-frame-size, but your messages should fit inside the TCP buffers. -Endre > > Please suggest us. > > Thanks in advance. > > > > > > > > On Monday, December 23, 2013 5:51:00 PM UTC+5:30, Patrik Nordwall wrote: > >> Hi, >> >> >> On Mon, Dec 23, 2013 at 10:31 AM, Piyush Mishra <[email protected]>wrote: >> >>> Thanks Björn, It is working. >>> >>> But now i have another problem. >>> >>> I am using clustering in my project. >>> >>> I have two seed nodes in my app.conf like this. >>> >>> "akka.tcp://[email protected]:2551", => Machine 1 >>> "akka.tcp://[email protected]:2552"] => Machine 2 >>> >>> >>> maximum-frame-size = 2097152 >>> send-buffer-size = 52428800 >>> receive-buffer-size = 52428800 >>> >>> I am able to send a large message(1 MB) from *Machine 2* to *Machine 1*, >>> but not able to do vice versa. This is strange, would you please suggest >>> the possible cause. >>> >> >> Works for me. I can't reproduce. Verify that you use the same >> configuration (maximum-frame-size) in both actor systems. >> >> /Patrik >> >> >>> >>> >>> On Tuesday, November 26, 2013 3:11:47 AM UTC+5:30, Björn Antonsson wrote: >>> >>>> Hi, >>>> >>>> On Monday, 25 November 2013 at 09:33, Piyush Mishra wrote: >>>> >>>> Hi All, >>>> >>>> We are using akka clustering in our project. We read bytes from a file >>>> and send it to the dispatcher remotely. We are getting the exception >>>> "Discarding oversized payload sent to Actor :: max allowed size 128000 >>>> bytes, actual size of encoded class scala.Tuple3 was 5995533 bytes." >>>> >>>> What should we do in order to send message of any size to the >>>> dispatcher. Please tell us about the configuration. >>>> >>>> >>>> The setting is named akka.remote.netty.tcp.maximum-frame-size >>>> >>>> It is documented in the configuration section of the >>>> docs<http://doc.akka.io/docs/akka/2.2.3/general/configuration.html> >>>> . >>>> >>>> This is from the reference configuration file: >>>> >>>> # Maximum message size the transport will accept, but at least >>>> # 32000 bytes. >>>> # Please note that UDP does not support arbitrary large datagrams, >>>> # so this setting has to be chosen carefully when using UDP. >>>> # Both send-buffer-size and receive-buffer-size settings has to >>>> # be adjusted to be able to buffer messages of maximum size. >>>> maximum-frame-size = 128000b >>>> >>>> B/ >>>> >>>> >>>> Thanks in advance. >>>> >>>> -- >>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>> >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >>>> >>>>>>>>>> Search the archives: https://groups.google.com/grou >>>> p/akka-user >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Akka User List" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> To post to this group, send email to [email protected]. >>>> >>>> Visit this group at http://groups.google.com/group/akka-user. >>>> For more options, visit https://groups.google.com/groups/opt_out. >>>> >>>> >>>> -- >>>> Björn Antonsson >>>> Typesafe <http://typesafe.com/> – Reactive Apps on the JVM >>>> twitter: @bantonsson <http://twitter.com/#!/bantonsson> >>>> >>>> -- >>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>> >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >>> >>>>>>>>>> Search the archives: https://groups.google.com/ >>> group/akka-user >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Akka User List" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To post to this group, send email to [email protected]. >>> Visit this group at http://groups.google.com/group/akka-user. >>> For more options, visit https://groups.google.com/groups/opt_out. >>> >> >> >> >> -- >> >> Patrik Nordwall >> Typesafe <http://typesafe.com/> - Reactive apps on the JVM >> Twitter: @patriknw >> >> -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: http://akka.io/faq/ > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/groups/opt_out. > -- Akka Team Typesafe - The software stack for applications that scale Blog: letitcrash.com Twitter: @akkateam -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/groups/opt_out.
