Commendable... but insane! I still think the answer is to move the collector outside of GAE. Hell, run it in Google Compute Engine. I have a java server that handles a thousand qps doing push notifications on an $11/mo rackspacecloud vps... and that isn't even topped out.
Ultimately you're just collecting a bunch of numbers, then providing them to a reaper process. You're spending 50X what you should and writing all this ugly sharding code just because GAE backends have a massive throughput problem. I'm not saying abandon GAE, just move the parts that GAE does poorly elsewhere. I can't see any compelling reason to keep the collector in appengine, and a lot of good reasons to move it. Jeff On Fri, Aug 3, 2012 at 9:39 PM, Richard <[email protected]> wrote: > 6 hours of straight coding and testing later, we now have a new backend with > 10 static B1's acting as a sharded memory proxy for the results. > > We seem to be handling around 900 players with no problems at the moment. > > Special thanks to Takashi for the design & a lot more! > > Time for some much needed sleep. > > > On Friday, August 3, 2012 11:18:37 PM UTC-4, Takashi Matsuo (Google) wrote: >> >> Dynamic backend instances automatically scale up/down. >> >> On Aug 4, 2012 9:21 AM, "Richard" <[email protected]> wrote: >>> >>> Hi Takashi, >>> >>> Yes, I read your post with a theoretical model, but unfortunately, I >>> don't really know how to tell it to scale up/down ? >>> >>> -R >>> >>> On Friday, August 3, 2012 6:07:10 PM UTC-4, Takashi Matsuo (Google) >>> wrote: >>>> >>>> >>>> Just wanted to make sure... >>>> Have you seen my post about auto-scaling in-memory backends? >>>> >>>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Google App Engine" group. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msg/google-appengine/-/9Z77HBrZDEYJ. >>> To post to this group, send email to [email protected]. >>> To unsubscribe from this group, send email to >>> [email protected]. >>> For more options, visit this group at >>> http://groups.google.com/group/google-appengine?hl=en. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/W707lh8eSDwJ. > > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
