One other issue seems to be that the bulk down/uploader doesn't have access to the indexed state of individual properties (there is no API to obtain this information). So you might get the right data structure on restore, but all the wrong indexes (typically "none" or "all"). The only way around this right now seems to be a) feed a python schema to the bulkloader (annoying if you're in java, and broken if you have partial indexes), write your own tools, or just re-put all your entities using index-aware tooling post-load.
Jeff On Sun, Jun 26, 2011 at 9:38 PM, Robert Kluin <[email protected]>wrote: > Hey Vlad, > One reason I wrote my own tools was because I was also doing schema > changes, that was a good opportunity to do so. I also did not want to > transfer all of my entities, so I used my app's standard APIs so that > all of my stats / reporting entities would just be regenerated > instead. I also didn't want to waste resources downloading then > re-uploading all of my data, rather I transferred them directly from > one app to another. If I were doing another large migration I would > probably dump to the blobstore, transfer the blob, then reconstitute > my entities from the blob. > > > > Robert > > > > > > On Mon, Jun 27, 2011 at 00:20, vlad <[email protected]> wrote: > > Robert, why did you need to develop your own data migration tools? What > is > > wrong with appcfg.py [upload_data/download_data] ? Admittedly I ran > > bulkloader only on small datasets but it was pretty quick and straight > > forward. > > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group. > > To view this discussion on the web visit > > https://groups.google.com/d/msg/google-appengine/-/SOIcCHwjsnMJ. > > To post to this group, send email to [email protected]. > > To unsubscribe from this group, send email to > > [email protected]. > > For more options, visit this group at > > http://groups.google.com/group/google-appengine?hl=en. > > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
