Hi,

So i'm playing around with the map reduce and just faced this problem (more 
of a unknown actually)

The one i ran takes about 40GB worth of entities and deletes them (i'm not 
using the datastore admin since i actually need to speed the process by 
sharding more and increasing the process rate). Unfortunately, reaching the 
end 2 shards faced some validation problems and the task queues were just 
too much pushed back and i just aborted the map reduce.

I'm sending all the delete operations (i know they are expensive) thru the 
Mutation Pool api that the MapReduce library provides.

1.) as i understand it (looking at the code) the mutation pool is flushed 
(actual db operation) until a max of entities (or size) is reached, this is 
per shard right?
2.) if the previous is correct, i should have about 90% of my deletes 
completed. Anyone know when these are actually accomplished? (i know it 
takes some time to reflect the actual change in your entity/datastore due to 
the nature of deletes) but just wondering if i should expect an approximate 
time.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Reply via email to