Hey there, we are using the datastore batch export feature to do nightly ETL runs of our datastore instance into BigQuery. Unfortunately, BigQuery skips Blob and JSON properties (which we use to store large JSON strings). To overcome this limitation, we were thinking to first turn the datastore export into CSV and then import that into BigQuery.
As I understand Cloud Datastore backups are in LevelDB format. So far, my attempts to open the file(s) with LevelDB client libraries were unsuccessful. Has anyone succeeded parsing/processing raw datastore backups? If so, can you recommend any client libraries (for node or Python) and have some sample code? Thanks heaps for any assistance! Soeren -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/6da88dc6-8f8f-427c-bdc5-8a574e15b2b1%40googlegroups.com.
