+1 Klaus
On Mon, Dec 16, 2013 at 2:22 AM, Klaus Post <[email protected]> wrote: > Hi! > > You should probably take a general look at what you are dealing with, and > consider some which common options are available. > > Some of these could apply to your project: > > 1) Segment data into smaller chunks, and deliver partial data if possible. > 2) Have precomputed a summary, if you are summing up large amount of > items, that are updated on write, or as a cron job every 5 minutes if > changes are flowing in all the time. > 3) Start a background task doing the report, send an update to the client > when the result is ready, so the user can be notified. > 4) If your app is calculation heavy - and not database (datastore) heavy, > consider using the Compute Engine. > 5) I haven't tried it myself, but mapreduce could help you summarising big > amounts of data. Just google "app engine mapreduce". > > Either way your design should have a maximum execution time of only a > fraction of the timeout limit - 10 seconds is an acceptable *worst case* > target. My rule of thumbs is - if you cannot promise that, you should > redesign what you are doing. > > I hope this helps a bit. > > Regards, > > Klaus > > On Sunday, December 15, 2013 12:01:19 PM UTC+1, Anil S wrote: >> >> >> HI, >> >> I have been using Google app engine for a while and faced some timeout >> issues while handling large data sets. MY application developed on Java >> Platform. >> >> Problem: >> When customer selects a date duration from UI, request goes to app engine >> to fetch the data from data store and run through custom logic on results >> and sends summarized view of data back to display in chats. Due to large >> volume of data, I am getting DeadlineExceededException. >> >> I can't really use task queues as I need to show the data on view for >> user request. >> >> Can anyone suggest how to resolve this issue? >> >> Note: I am using Objectfy 4 >> >> Thanks in advance, >> Anil. >> > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/google-appengine. > For more options, visit https://groups.google.com/groups/opt_out. > -- *Jayakrishnan Damodaran* *Uroleaf Technologies* Skype: jayakrishnand88 Phone: 8281853554 -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
