It's easy to traverse entities on parallel, as far as I understand this is what map does, you can also restrict them with a slight improvement But I think the hardest part is combining the information, are you going to use memcached? then you will probably lose some of the data and if you are going to use datastore, the parallel processes would have to wait to write data
probably you would need to implement parallel processing + sharded counters On May 1, 7:29 am, nischalshetty <[email protected]> wrote: > IMO a map reduce would be good. But then it runs over all your entities of > the specified kind so you need to decide if you are ready for the overhead. > If you have a lot of data it can be a pain. > > I read somewhere that mapreduce over a subset will someday be implemented, > of course someday can mean anything. Interested to see how you end up > solving this because in a few months we will be wanting to do something > similar. Keep this thread updated on your trials and erros. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
