Have you looked into using the Remote API https://developers.google.com/appengine/docs/python/tools/remoteapi https://developers.google.com/appengine/articles/remote_api
You use your local machine to parse the file [no memory problems], create the needed objects, and put them in the datastore in batches. You can use a modified class Mapper to do the batch write as found in https://developers.google.com/appengine/articles/deferred -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
