I'm not particularly surprised by this, but I'm curious: do you know if anyone has done any serious work on Akka "meta-clusters" for situations like this? For example, while it's certainly at least a few years off, I should *probably* eventually distribute my Cluster Sharding geographically, depending on where the owner lives. (Since I believe the users of a given Space are likely to cluster geographically, it makes sense from a latency POV to use that.) Architecturally these would be distinct clusters, but from an app POV I'd want to be able to route messages at least somewhat transparently between sharded clusters. It feels like there are some high-level abstractions to be teased out here.
It wouldn't surprise me if this is completely unknown territory; I've only begun to muse about it myself. Just wondering if you've encountered anyone beginning to take a principled look at it yet... On Thu, Aug 11, 2016 at 1:34 PM, Patrik Nordwall <patrik.nordw...@gmail.com> wrote: > I agree with Ryan that it's generally not recommended. > > I would like to add that the cluster membership and distributed data will > work pretty fine across DC thanks to their gossip based protocols, but > there are other tools, such as cluster sharding, that are not a good fit > for it. > > Cluster downing can be a challenge. Network partitions vs. crashes. The > downing strategy should probably be DC aware. > > /Patrik > > tors 11 aug. 2016 kl. 18:47 skrev Ryan Tanner <ryan.tan...@gmail.com>: > >> Akka is generally not recommended for spanning data centers. >> >> I would consider the cluster client, though personally I'd probably >> choose Kafka for this role, with separate clusters in each DC. IME >> cross-DC communication is generally a scenario where you really want to >> make sure messages are persisted to disk before being consumed on the other >> side, it just makes failure recovery 100x easier (unless you just don't >> care about missing messages). >> >> >> On Thursday, August 11, 2016 at 7:00:21 AM UTC-6, Eli Jordan wrote: >>> >>> >>> I am writing a system that needs to be distributed across various data >>> centers e.g. US, Europe, Asia. I need to replicate a small amount of >>> configuration data between the nodes in each datacenter (there are a small >>> number of nodes in each data center, 1 or 2) and this configuration can be >>> updated in any of the data centers. >>> >>> I am considering using akka clustering with the distributed data feature >>> to replicate this configuration data. However, I haven't been able to find >>> any documentation about whether it is recommended to have an akka cluster >>> span data centers, over a network leg that is much more unreliable than a >>> LAN connection or what guarantees are provided in such a configuration. >>> >>> Is this a configuration that will work well? Or is something like akka >>> cluster client a better approach? Or is there another solution akka can >>> offer to this problem? >>> >>> Any help appreciated >>> >> -- >> >>>>>>>>>> Read the docs: http://akka.io/docs/ >> >>>>>>>>>> Check the FAQ: http://doc.akka.io/docs/akka/ >> current/additional/faq.html >> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user >> --- >> You received this message because you are subscribed to the Google Groups >> "Akka User List" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to akka-user+unsubscr...@googlegroups.com. >> To post to this group, send email to akka-user@googlegroups.com. >> Visit this group at https://groups.google.com/group/akka-user. >> For more options, visit https://groups.google.com/d/optout. >> > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: http://doc.akka.io/docs/akka/ > current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to akka-user+unsubscr...@googlegroups.com. > To post to this group, send email to akka-user@googlegroups.com. > Visit this group at https://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to akka-user+unsubscr...@googlegroups.com. To post to this group, send email to akka-user@googlegroups.com. Visit this group at https://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
