I also advise you to call gc.collect() after every batch. I found that python's garbage collection is really bad. Give it a try.
On Jan 18, 10:58 am, Jules <[email protected]> wrote: > What I shall try next is processing a batch of records and then > closing the file and kicking off a new process, which will start where > the old one left off. What I don't know is whether without the > finalize the data already written will be lost. > > Jules -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
