On Tue, Sep 29, 2015 at 6:46 PM, Paul Cleary <[email protected]> wrote:
> Interesting, so is it possible that the Cluster state exceeds 400k > serialized? I tend to find that hard to believe that it would be bigger > than that, especially for a small cluster > I agree. Here is the protobuf representation for the snapshot: https://github.com/akka/akka/blob/master/akka-cluster-sharding/src/main/protobuf/ClusterShardingMessages.proto#L10-L19 So it depends on number of shards, but I would guess 400kB should be enough for a few thousand shards. Worst case you can implement your own serializer for CoordinatorState that gzips it. There is a lot of repetition in the actor refs. /Patrik > > > On Tuesday, September 29, 2015 at 9:01:27 AM UTC-4, Filippo De Luca wrote: >> >> The dynamodb object are limited to 400K, implementing a snapshot plugin >> on that, maybe pointless. My 2cents. >> >> On 28 September 2015 at 22:48, Paul Cleary <[email protected]> wrote: >> >>> Thanks Konrad, yes, I am using that plugin for my journal. >>> >>> Akka Clustering stores cluster state (singletons, shards) as snapshots, >>> that is why I need the snapshot plugin. >>> >>> Not a high throughput system, but failure recovery is important. >>> >>> On Monday, September 28, 2015 at 5:06:32 PM UTC-4, Konrad Malawski wrote: >>>> >>>> Hi Paul! >>>> I'm aware of this journal implementation: >>>> https://github.com/sclasen/akka-persistence-dynamodb/ >>>> however it has not been updated to 2.4 SPIs yet. >>>> I'm not sure if it has also implemented a snapshot-store, I think not >>>> (by skimming it for 10seconds). >>>> >>>> You may want to reach out to that plugin's author to see if you could >>>> collaborate on updating the plugin to 2.4.x (we're expecting the 2.4.0 to >>>> be released this or next week). >>>> >>>> Thanks in advance and don't hesitate to ask for help if in trouble >>>> while implementing a journal. >>>> >>>> On Mon, Sep 28, 2015 at 10:59 PM, Paul Cleary <[email protected]> >>>> wrote: >>>> >>>>> Before I go and create a dynamodb snapshot plugin of my own, I wanted >>>>> to see if anyone else had done this and maybe it is open sourced someplace >>>>> (or is planned on being open sourced). >>>>> >>>>> Seems simple enough to write, but this question is much faster ;) >>>>> >>>>> Thanks! >>>>> >>>>> -- >>>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>> >>>>>>>>>> Check the FAQ: >>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>> >>>>>>>>>> Search the archives: >>>>> https://groups.google.com/group/akka-user >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Akka User List" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> To post to this group, send email to [email protected]. >>>>> Visit this group at http://groups.google.com/group/akka-user. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> >>>> >>>> -- >>>> Cheers, >>>> Konrad 'ktoso' Malawski >>>> Akka <http://akka.io/> @ Typesafe <http://typesafe.com/> >>>> >>> -- >>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>> >>>>>>>>>> Check the FAQ: >>> http://doc.akka.io/docs/akka/current/additional/faq.html >>> >>>>>>>>>> Search the archives: >>> https://groups.google.com/group/akka-user >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Akka User List" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To post to this group, send email to [email protected]. >>> Visit this group at http://groups.google.com/group/akka-user. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> >> >> -- >> >> [image: --] >> Filippo De Luca >> [image: http://]about.me/FilippoDeLuca >> <http://about.me/FilippoDeLuca?promo=email_sig> >> >> > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- Patrik Nordwall Typesafe <http://typesafe.com/> - Reactive apps on the JVM Twitter: @patriknw -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
