Probably worth mentioning that on the way up that slope, we still encountered a number of 10-s "we can't get an instance for you" errors - around 4% of the requests failed like this. Our instances were set to 3-Auto and our latency was set to Auto-1s; I was really hoping that the scheduler would keep up with these settings, but it appears not.
Once spun up however, it's rocking. j On Thursday, 24 January 2013 11:47:50 UTC-6, Jason Collins wrote: > > We are doing a data migration between apps (moving our services layer (and > data) to a different app than our user-facing app). > > On Monday, 14 January 2013 15:41:15 UTC-6, Igor Kharin wrote: >> >> Not much? With crawler I'd rather "fan in" in MapReduce Framework's >> MutationPool style. It's a waste of instance time to make whole thread >> wait for just a single website. >> >> On Tue, Jan 8, 2013 at 10:34 PM, alex <[email protected]> wrote: >> > looks like it's a crawler so there's not much you can do when external >> > sites respond slowly, except for fanning out. >> > >> > On Tue, Jan 8, 2013 at 3:30 PM, Jeff Schnitzer <[email protected]> >> wrote: >> >> On Mon, Jan 7, 2013 at 1:54 PM, Kristopher Giesing < >> [email protected]> >> >> wrote: >> >>> >> >>> 16s average latency though... >> >> >> >> >> >> ...and 294 instances at an average 0.175 qps. Ouch. >> >> >> >> Jeff >> >> >> >> -- >> >> You received this message because you are subscribed to the Google >> Groups >> >> "Google App Engine" group. >> >> To post to this group, send email to [email protected]. >> >> To unsubscribe from this group, send email to >> >> [email protected]. >> >> For more options, visit this group at >> >> http://groups.google.com/group/google-appengine?hl=en. >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups "Google App Engine" group. >> > To post to this group, send email to [email protected]. >> > To unsubscribe from this group, send email to >> [email protected]. >> > For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > >> > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/TRAJmnJM8fkJ. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
