On Tue, Jul 30, 2013 at 1:29 AM, Andrew Free <[email protected]>wrote:
> Is this something in my code or something I can't change related to adding > data to a datastore. I'm stuck and confused after hours/days of playing > around with it. > Try looking into the task queue service. You can have one instance parsing out the XML, and then every x number of items, parcel out the item information into a task. The task can then write the item information to the datastore within a short lived request. By breaking your writes into multiple short lived task requests, it's easier for the GC to go in and free up memory. On Tue, Jul 30, 2013 at 6:17 PM, Andrew Free <[email protected]>wrote: > My understanding is that the map reduce is run after the items are already > in the datastore? Not while they are being added? > > You can add datastore entities using mapreduce if you want to. Do whatever makes you feel most comfortable. ----------------- -Vinny P Technology & Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
