There is no official description, somewhere, of "how the scaling has changed" or "how it has been implemented differently", as there is no change in scaling behavior, and no different implementation. This is an assumption while we investigate the situation described by Joshua above. I could not find a similar issue in the Public Issue Tracker <https://issuetracker.google.com/>, so the difference in scaling between Python 2 and 3 is likely a one-time occurrence, and caused by idiosyncratic settings in the project, or application-specific factors. Such issue are difficult to approach in a publicly-accessible thread as this one, as investigation needs particulars such as project ID, and access to other private data. To have this issue properly addressed, it's better to open a support case <https://cloud.google.com/support/docs/manage-cases#creating_cases> or an issue in the Public Issue Tracker <https://issuetracker.google.com/>.
On Friday, 05 November 2021 at 05:50:42 UTC-4 Nicolas Fonrose (Teevity) wrote: > Hello David, > > >There’s not an official way of forcing the scaling to behave like it used > to be on python 2.7. > Is there an official description, somewhere, of "how the scaling has > changed" or "how it has been implemented differently" ? > Or this change just a side effect of technical choices that were made in > the new runtimes? > > Thanks, > > On Thursday, November 4, 2021 at 9:56:43 PM UTC+1 David (Cloud Platform > Support) wrote: > >> Hello, >> >> Other than applying changes within your own application so it will go >> easy at startup, you can try using warmup requests >> <https://cloud.google.com/appengine/docs/standard/python3/configuring-warmup-requests> >> >> along with tweaking the min_idle_instances element >> <https://cloud.google.com/appengine/docs/standard/python3/config/appref#scaling_elements> >> >> in your app.yaml, in order to reduce request and response latency during >> the time when your app's code is being loaded to a newly created instance. >> There’s not an official way of forcing the scaling to behave like it used >> to be on python 2.7. However, this type of feedback can be passed to the >> App Engine engineering team in the form of a feature request. You can >> create such a feature request here >> <https://issuetracker.google.com/issues/new?component=187191&template=1162953>. >> >> The App Engine engineering team would then evaluate it and decide whether >> it could be implemented or not. >> On Thursday, November 4, 2021 at 11:38:52 AM UTC-4 Joshua Smith wrote: >> >>> Thanks for sending out this update. I did, indeed, miss most of this >>> news. >>> >>> This item, in particular, is *awesome*: >>> >>> >>> >>> - >>> >>> Extending support for App Engine bundled services >>> >>> <https://cloud.google.com/blog/products/serverless/support-for-app-engine-services-in-second-generation-runtimes> >>> >>> (Sep 2021) >>> >>> >>> This sounds like it will make it so much easier to migrate to Python 3.7. >>> >>> One thing I've noticed is that my older apps on 2.7 seem to handle peak >>> scaling a lot better than my newer apps on 3.7. For example, if I have a >>> web page that hits a 2.7 app with 100 REST calls at startup (bad design, >>> but it happens), the old app serves them all eventually. But if I do the >>> same thing in a 3.7 app, it's likely to choke and fail a bunch of those >>> requests with these: >>> >>> >>> The specific pattern is that after the first couple requests, it spins >>> up a new instance. That takes 5 seconds to serve its first request (simple >>> app, so I guess that's just GAE overhead). Then it spins up a couple more. >>> Then I start getting those errors on some of the requests, because 15s have >>> passed. In this capture the blue ones are new instances spinning up, and >>> the orange ones are timeout errors (note the 15s time on those). >>> >>> >>> I've been designing around the issue by making sure my web apps go easy >>> on the server on startup. But it is yet another concern about migrating. >>> >>> Is there a way to tune the auto-scaling for 3.7 to behave like the 2.7? >>> Here's a similar set of requests to my 2.7 app, which only spins up one >>> extra instance, and never throws timeout errors, ever: >>> >>> >>> -Joshua >>> >>> >>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/321e134a-09d4-4536-9426-1a65170ca498n%40googlegroups.com.
