I hope that new background servers will be designed with the option to enable multithreading for processing.
The reason is simply that many libraries (especially for computationally intensive tasks involving things like branch-and.bound tree search) are implemented using threads, and obviously this makes them unusable on GAE. Patching these libraries is not an option - too long task to do to simply use them. So I hope multithreading will be an option for background processing. As for the planned SQL support this could be a major usability improvement, letting users choose between scalability and processing power. Anyway thank you Nick for your help. Regards Lorenzo On Sep 6, 6:42 pm, Jeff Schwartz <[email protected]> wrote: > Hi Nick. Yes, I intend to shard as much as possible and to create small, > efficient tasks :) > > Thanks again. > > Jeff > > On Mon, Sep 6, 2010 at 12:07 PM, Nick Johnson (Google) < > > > > [email protected]> wrote: > > Hi Jeff, > > > On Mon, Sep 6, 2010 at 5:00 PM, Jeff Schwartz > > <[email protected]>wrote: > > >> Hi Nick. Thank you for your offer. I would like to develop a tasks that > >> would benefit from the longer durations. Specifically, it involves sending > >> out emails for all members participating within a social graph. Sort of > >> like > >> the way members receive email notifications on Facebook when someone adds a > >> comment to a post. As the number of members that have to be sent > >> notifications is indeterminate I was concerned about the feasibility of > >> supporting this on AppEngine but I am sure that 10 minutes would be more > >> than enough time. > > > I'd highly recommend building your app such that it shards the email > > sending into many tasks regardless. Longer deadlines will help, but your app > > will be more scalable - and faster to send emails in bulk - if you can break > > it down into smaller tasks. > > >> Let me do this, let me try it first without any increase enabled. I will > >> take some metrics and try to forecast that out to hundreds or even > >> thousands > >> of emails being sent. If I determine that I am going to run into problems > >> running within the current limits I will email you a request to raise them > >> for me. Would that be OK? > > > That's fine - feel free to contact me if you need an increase. > > > -Nick Johnson > > >> Jeff > > >> On Mon, Sep 6, 2010 at 10:55 AM, Nick Johnson (Google) < > >> [email protected]> wrote: > > >>> Hi Jeff, > > >>> I can enable 10 minute timeouts for offline requests (eg, task queue and > >>> cron) and offline URLFetch calls right now, if you have an App ID that > >>> requires it. Other features aren't currently on our timeline, so we can't > >>> provide a concrete estimate of when we're likely to make them available. > > >>> -Nick Johnson > > >>> On Mon, Sep 6, 2010 at 3:47 PM, Jeff Schwartz > >>> <[email protected]>wrote: > > >>>> Hi Nick. I am very encourage by your responses to Ben, specifically > >>>> regarding increasing all these limits across the board and not just for > >>>> business customers. Can you say when Google will announce their > >>>> intentions > >>>> regarding the specifics of these pending changes? It would be very > >>>> beneficial to know these prior to their availability so as to better > >>>> factor > >>>> their benefits into our designs now. > > >>>> Jeff > > >>>> On Mon, Sep 6, 2010 at 8:30 AM, Nick Johnson (Google) < > >>>> [email protected]> wrote: > > >>>>> Hi Ben, > > >>>>> On Fri, Sep 3, 2010 at 10:12 AM, Ben Chung <[email protected]> wrote: > > >>>>>> Hi, App Engine Team: > > >>>>>> Our RD developers, We are very interested in App Engine for Business. > > >>>>>> Because we are assessing to migrate our platform to GAE platform, so > >>>>>> there are some questions for you, hope you can help us to answer them. > > >>>>>> 1) We know there are many 1MB limitation, like datastore for each > >>>>>> entity, image resize, mail attachment, URL fetch, memcache value. > > >>>>>> Does "App Engine for Business" support to revoke these limitations by > >>>>>> paying more costs? > > >>>>> We're working to increase all these limits, but when we do, it's likely > >>>>> to be across the board, not just for Business customers. > > >>>>>> 2) Does "App Engine for Business" support many applications to access > >>>>>> ONE datastore(DB)? > > >>>>> No. If you can explain why you need to do this, we can probably suggest > >>>>> a better alternative, though. > > >>>>>> 3) Does "App Engine for Business" support request handler for more > >>>>>> than 30 seconds? > > >>>>> This is another limitation we're working on. Please contact me off-list > >>>>> if you're interested in learning more. > > >>>>>> 4) Does "App Engine for Business" support socket to use? > > >>>>> No, all outgoing requests must be via one of our APIs, such as > >>>>> URLFetch. > > >>>>> -Nick Johnson > > >>>>>> Thanks in advance. > > >>>>>> BR, > > >>>>>> Ben > > >>>>>> -- > >>>>>> You received this message because you are subscribed to the Google > >>>>>> Groups "Google App Engine" group. > >>>>>> To post to this group, send email to > >>>>>> [email protected]. > >>>>>> To unsubscribe from this group, send email to > >>>>>> [email protected]<google-appengine%[email protected]> > >>>>>> . > >>>>>> For more options, visit this group at > >>>>>>http://groups.google.com/group/google-appengine?hl=en. > > >>>>> -- > >>>>> Nick Johnson, Developer Programs Engineer, App Engine Google Ireland > >>>>> Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 > >>>>> Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration > >>>>> Number: 368047 > > >>>>> -- > >>>>> You received this message because you are subscribed to the Google > >>>>> Groups "Google App Engine" group. > >>>>> To post to this group, send email to [email protected] > >>>>> . > >>>>> To unsubscribe from this group, send email to > >>>>> [email protected]<google-appengine%[email protected]> > >>>>> . > >>>>> For more options, visit this group at > >>>>>http://groups.google.com/group/google-appengine?hl=en. > > >>>> -- > >>>> -- > >>>> Jeff > > >>>> -- > >>>> You received this message because you are subscribed to the Google > >>>> Groups "Google App Engine" group. > >>>> To post to this group, send email to [email protected]. > >>>> To unsubscribe from this group, send email to > >>>> [email protected]<google-appengine%[email protected]> > >>>> . > >>>> For more options, visit this group at > >>>>http://groups.google.com/group/google-appengine?hl=en. > > >>> -- > >>> Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. > >>> :: Registered in Dublin, Ireland, Registration Number: 368047 > >>> Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration > >>> Number: 368047 > > >>> -- > >>> You received this message because you are subscribed to the Google Groups > >>> "Google App Engine" group. > >>> To post to this group, send email to [email protected]. > >>> To unsubscribe from this group, send email to > >>> [email protected]<google-appengine%[email protected]> > >>> . > >>> For more options, visit this group at > >>>http://groups.google.com/group/google-appengine?hl=en. > > >> -- > >> -- > >> Jeff > > >> -- > >> You received this message because you are subscribed to the Google Groups > >> "Google App Engine" group. > >> To post to this group, send email to [email protected]. > >> To unsubscribe from this group, send email to > >> [email protected]<google-appengine%[email protected]> > >> . > >> For more options, visit this group at > >>http://groups.google.com/group/google-appengine?hl=en. > > > -- > > Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. > > :: Registered in Dublin, Ireland, Registration Number: 368047 > > Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: > > 368047 > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group. > > To post to this group, send email to [email protected]. > > To unsubscribe from this group, send email to > > [email protected]<google-appengine%[email protected]> > > . > > For more options, visit this group at > >http://groups.google.com/group/google-appengine?hl=en. > > -- > -- > Jeff -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
