Hi, The reason you're seeing the results you are is because of the CPU limit. The number of threads that will run in parallel is affected by how much CPU each thread uses - there's no point starting more threads if the CPU is already fully utilized, it would just slow the existing requests down. The good news is, you're fully utilizing your appserver. If you want to increase the concurrency further, you'd need to reduce the amount of CPU time you're consuming.
-Nick Johnson On Mon, Sep 5, 2011 at 8:31 AM, de Witte <[email protected]> wrote: > I'm trying optimize our application to the max, so far so good, but... > > It appears that the threadpool of the Java instance is limited to 18, for > which ~10 are used to handle requests. > > Our average latency is 100ms. 1 minute / 100ms = 600 requests, x10 threads, > so a single instance should be able to handle *6000 requests a minute. * > > According to the logs the limit is 1000 request a minute. A higher rate > will trigger a new instance regardless the average latency time. regardless > any settings. > > Is this correct or can we get a higher request rate per minute? > > Otherwise there is no *cost *involved reason to optimize if your latency > is below *600ms*. (Hence, frontend is most of the time waiting (idle) for > the backend) > > Another side effect of this limitation is that the the Min Pending Latency > setting has no effect. > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/o3uDifrLVaEJ. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- Nick Johnson, Developer Programs Engineer, App Engine -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
