Hi ShriJ, On Wed, Sep 2, 2009 at 2:44 AM, ShriJ <[email protected]> wrote:
> > Hi, > > I've been having a very hard time since the last few days w.r.t. > deleting existing data and uploading new data in my datastore. > > For deleting: I get a row using the key_name and then delete it. > dbRow = modelObject.get_by_key_name(key_name) > if dbRow: > dbRow.delete() > My datastore has roughly 60K rows and I delete them one by one. Many > times when doing this, I get a quota exceeded exception. But when I > login to appspot.com for seeing whats wrong, I don't see any error. > It's possible to run out of short-term quota without exhausting your daily quota. This limit exists in order to prevent a burst of traffic taking your site offline for the rest of the day. Is there a reason you're not deleting records in batches? This will be much easier on your quotas. > Similarly, when uploading data, I am using the bulkload_client.py > script for uploading the data. There again I see the same issues. > There are times when after inserting 500 rows, I get the error and > thereafter no matter how many times I start again, I see the same > error. > You need to ratelimit the upload to a slower speed in order to not exhaust your short-term quotas. -Nick Johnson > > I've almost come to the conclusion that downloading and uploading the > data on the same day is kinda impossible. > > Am I doing something fundamentally incorrect? If not, is there any ETA > on when will things get better. My website has been down since the > last 4 days because of these issues :(. > > -Shri > > > -- Nick Johnson, Developer Programs Engineer, App Engine --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
