I found my workaround. I used the appcfg bulk loaders to accomplish what I needed. I just did a appcfg.py download_data on each of the kinds from the source app. Then I did appcfg.py upload_data to target app and all of the entities got transferred successfully. For the entity type that was about 2GB of data it took about an 1hr 20min to download and about 3 hours to upload. The good news also is that it only cost me $7 in CPU to upload. Previously when I did it through the datastore admin tool it cost about $80.
I wish I had known that before so I could have saved the $80. Hope this helps anyone with the same issue. On Mar 10, 3:25 pm, Petey <[email protected]> wrote: > It does seem like it copied over some child entities so that isn't the > exact issue. > The main problem I have is that not everything gets copied. For > example, I have one entity kind that only got 730,000 entities copied > when the source app has 810,000 entities. I don't know how I would > find the missing ones and just copy those over. I also am afraid to > try it again because I don't want to get charged another $80. > > On Mar 10, 2:01 pm, Jamie H <[email protected]> wrote: > > > > > > > > > You are not alone. I experienced the same issues you are experiencing > > when I did my migration. I received no response from Google but this > > is no doubt an issue. I received the same namespace error, along with > > several mappers just hanging idle. > > > On Mar 10, 2:01 pm, Petey <[email protected]> wrote: > > > > It looks like this happens to all child entities in an entity group. I > > > can't get any entities that are children to copy over. I even tried > > > altering the order in which I copied the parent and child entities. > > > > Does anyone have any workarounds? I really need this to work. I've > > > noticed several other people have had this issue, but they also have > > > gotten no response. > > > > On Mar 9, 9:02 pm, Petey <[email protected]> wrote: > > > > > I just noticed these errors in the logs of my source application. I'm > > > > guessing this might have something to do with it. Why is this > > > > happening and how can I get around the issue? > > > > > The app/namespace arguments (<sourceapp>/) should match parent.app/ > > > > namespace() (s~<targetapp>/) > > > > Traceback (most recent call last): > > > > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > > > > ext/webapp/__init__.py", line 517, in __call__ > > > > handler.post(*groups) > > > > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > > > > ext/mapreduce/base_handler.py", line 59, in post > > > > self.handle() > > > > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > > > > ext/mapreduce/handlers.py", line 172, in handle > > > > ctx.flush() > > > > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > > > > ext/mapreduce/context.py", line 244, in flush > > > > pool.flush() > > > > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > > > > ext/datastore_admin/copy_handler.py", line 221, in flush > > > > 1, maxid) > > > > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > > > > ext/db/__init__.py", line 1455, in allocate_id_range > > > > start_key = Key.from_path(key.kind(), start, parent=key.parent()) > > > > File "/base/python_runtime/python_lib/versions/1/google/appengine/ > > > > api/datastore_types.py", line 387, in from_path > > > > (app_id, namespace, parent.app(), parent.namespace())) > > > > BadArgumentError: The app/namespace arguments (<sourceapp>/) should > > > > match parent.app/namespace() (s~<targetapp>/) -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
