It's most likely not data corruption - most of the time this error is due to non-UTF8 data being saved to the datastore.
You wrote that you're seeing this error within 2 different kinds: what data are those kinds storing? Is it possible that they're storing non-UTF8 characters? Can you try filtering for non-UTF8 characters before writing entities to the datastore? ----------------- -Vinny P Technology & Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com On Tue, Mar 11, 2014 at 3:04 PM, Arthur Wiebe <[email protected]> wrote: > I just recently started seeing problems in my app where a specific > property just seemed to disappear. > > And if I use the Datastore Viewer under > https://appengine.google.com/datastore/explorer I see the following > error: (I renamed the actual property name to my_property_name) > > Error fetching entities: Property my_property_name is corrupt in the > datastore: Traceback (most recent call last): File > "/base/data/home/runtimes/python/python_lib/versions/1/google/appengine/api/datastore.py" > , line 1145, in _FromPb value = datastore_types.FromPropertyPb(prop) File > "/base/data/home/runtimes/python/python_lib/versions/1/google/appengine/api/datastore_types.py" > , line 1850, in FromPropertyPb value = unicode(value, 'utf-8') > UnicodeDecodeError: 'utf8' codec can't decode byte 0x80 in position 0: > unexpected code byte > > This has happened with 2 separate Kinds, all the others seem to be OK. > > I'm really concerned about this which seems to be data corruption on > Google's end. If it was my fault that would be one thing but during the > time this happened I didn't make any major changes. > > Also I'm using Python with the NBD Datastore. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
