Interesting. If the map-reduce job reduce job requires writing to the datastore and the article suggests disabling writes while it runs, this would suggest inconsistent expectations about its behavior. Either the map-reduce behavior should not require writes or the article is incorrect and should be changed. Either way, this may be an issue with the platform.
I would recommend filing a public issue on the Issue Tracker. When doing so, please include the relevant error logs along with minimal reproduction that exemplifies this error. Be sure to also post a link to the issue here so that others in the community can also follow along. As for encoding protobuf data into json, I'd recommend using Google's *protobuf* library <https://pypi.python.org/pypi/protobuf> and looking at the *json_format* module to achieve your goals. On Wednesday, April 26, 2017 at 1:01:41 AM UTC-4, Attila-Mihaly Balazs wrote: > > Lets assume that I have a "properly" written AppEngine application (writes > to the datastore are wrapped into transactions, tasks are put in the task > queue and retried, etc) and I want to make a "consistent" backup (ie. I > don't want half-committed transactions in the backup). The documentation > [1] suggests disabling writes and running a backup from the datastore > admin, which sounds sensible but fails because the backup map-reduce job > itself needs to write to the datastore. Any other suggestions? > > On a related note, the backup is just a dump in protobuff format. I can > create a hacky python script to extract the data, but is there a > recommended/supported way to transform it into something like JSON or CSV? > > Attila > > [1] > https://cloud.google.com/datastore/docs/console/datastore-backing-up-restoring > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at https://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/f0e167ac-21be-421d-ab07-d1f0dbbd8975%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
