[appengine-java] Re: Delete Lots Of Data

2011-09-12 Thread Cyrille Vincey
you MUST have a look at http://ikaisays.com/2010/07/09/using-the-java-mapper-framework-for-app-engine/ There's a special section at the end of the post delete all entities of a given kind. You can delete 35M entities in a few minutes using mapreduce. -- You received this message because you are

[appengine-java] Re: Delete Lots Of Data

2011-09-11 Thread Nichole
Can use low-level datastore and iterate over batches: binSize = 1000;// or smaller if needed 30 sec timeout DatastoreService datastore = DatastoreServiceFactory.getDatastoreService(); Keys only select and delete: javax.jdo.Query q = pm.newQuery(select key from +

[appengine-java] Re: Delete Lots Of Data

2011-09-09 Thread Didier Durand
If you don't want to introduce MapReduce solely for this purpose, you can write a queued task that loops through the data to delete it and that recreates a new instance of itself just before time limit (10 min) to continue the deletion. regards didier On Sep 9, 8:37 pm, Marcelo Liberato