Is it the fetch that is taking too long or the sending of the emails? I cases where the jobs really do get too big (but see Ross' note), the typical approach is to batch up the job and use task queues. For example, you might have your task catch DeadlineExceeded (or whatever Exception that is) and smartly put the remaining 'emails' list on another new task.
On Jan 21, 12:10 pm, Ross M Karchner <[email protected]> wrote: > Cron jobs and tasks can now take up to 10 > minuteshttp://code.google.com/p/googleappengine/wiki/SdkReleaseNotes > > On Fri, Jan 21, 2011 at 12:57 PM, Mayumi Liyanage < > > > > [email protected]> wrote: > > Hi, I need to iterate over all the entities in the Datastore and send > > out emails once a day asynchronously to the actual app. > > Usual way to do this would be to invoke a Servlet using cron which > > would iterate over all the entities to send emails out. However, our > > data is growing at the rapid rate and sooner or later we will have a > > issue with 30 sec limit problem. > > What would be the best way to do this operation using app engine > > without worrying about 30 sec limit? > > > Can we do above using the Mapper API? If so how can we invoke a mapper > > from the servlet? > > > Thanks. > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group. > > To post to this group, send email to [email protected]. > > To unsubscribe from this group, send email to > > [email protected]<google-appengine%[email protected]> > > . > > For more options, visit this group at > >http://groups.google.com/group/google-appengine?hl=en. > > -- > Ross M Karchnerhttp://eventgrinder.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
