This is where I will look into: The data for each task is small, but it may be appended to an existing entity, whose size may be already close to 1M.
Thanks for all your input. Will On Thu, Aug 4, 2011 at 1:48 PM, Nicholas Verne <[email protected]> wrote: > The RequestTooLargeError is probably referring to the size of the > transactional task list together with the datastore entitity size, > which cannot exceed 1 MB. What is the total size of tasks plus data > you are trying to add? > > Nick Verne > > On Fri, Aug 5, 2011 at 2:09 AM, Will <[email protected]> wrote: >> More background of the program. >> >> I use task queue as a fail over mechanism when writing to M/S >> datastore failed in the first place, usually due to DEE. >> >> Normally there are hundreds of tasks being added to the queue per day. >> Like I said, before it worked fine, I rarely even see one error of >> RequestTooLargeError raised by a task. But all the sudden, there are >> hundreds, and all that I examined only want to write less than 200 >> bytes to the db. >> >> Thanks, >> >> Will >> >> On Wed, Aug 3, 2011 at 6:30 PM, Greg Darke <[email protected]> wrote: >>> How large is your put to datastore? >>> >>> On 4 August 2011 02:45, Will <[email protected]> wrote: >>>> It's on MS datastore. The program hasn't been changed. Seems started >>>> happening several hours ago. >>>> >>>> On Wed, Aug 3, 2011 at 8:44 AM, Will <[email protected]> wrote: >>>>> Hi all, >>>>> >>>>> Some of my tasks suddenly started to report this error: >>>>> >>>>> error - <class >>>>> 'google.appengine.runtime.apiproxy_errors.RequestTooLargeError'>. The >>>>> request to API call datastore_v3.Put() was too large. >>>>> >>>>> When I checked, the payloads of the tasks are usually under 200 bytes. >>>>> >>>>> Anything I should look into? >>>>> >>>>> Thanks, >>>>> >>>>> Will >>>>> >>>> >>>> -- >>>> You received this message because you are subscribed to the Google Groups >>>> "Google App Engine" group. >>>> To post to this group, send email to [email protected]. >>>> To unsubscribe from this group, send email to >>>> [email protected]. >>>> For more options, visit this group at >>>> http://groups.google.com/group/google-appengine?hl=en. >>>> >>>> >>> >>> >>> >>> -- >>> Greg Darke >>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Google App Engine" group. >>> To post to this group, send email to [email protected]. >>> To unsubscribe from this group, send email to >>> [email protected]. >>> For more options, visit this group at >>> http://groups.google.com/group/google-appengine?hl=en. >>> >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to [email protected]. >> To unsubscribe from this group, send email to >> [email protected]. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
