2 related while we look what's google3.net.proto.ProtocolBuffer ...are http://groups.google.com/group/google-appengine-python/browse_thread/thread/947b0c978f41541a/b0fe9ff8a337be08 http://groups.google.com/group/google-appengine-python/browse_thread/thread/947b0c978f41541a/b2c148ade4611314 On Mar 13, 8:55 am, Josh Moore <[email protected]> wrote: > Hi I am trying to download all of the datastore objects in my application > with thebulkloaderand then upload them into a different application. > > I use this command to download:bulkloader.py --dump --app_id=jsm277 > --url=http://bulkmove.latest.jsm277.appspot.com/remote_api--filename=test_download_data > > and I get this output: > > /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py:64: > DeprecationWarning: the sha module is deprecated; use the hashlib module > instead > import sha > /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/dev_appserver_login.py:33: > DeprecationWarning: the md5 module is deprecated; use hashlib instead > import md5 > [INFO ] Logging tobulkloader-log-20100313.160710 > [INFO ] Throttling transfers: > [INFO ] Bandwidth: 250000 bytes/second > [INFO ] HTTP connections: 8/second > [INFO ] Entities inserted/fetched/modified: 20/second > [INFO ] Opening database:bulkloader-progress-20100313.160710.sql3 > [INFO ] Opening database:bulkloader-results-20100313.160710.sql3 > [INFO ] Connecting to bulkmove.latest.jsm277.appspot.com/remote_api > [INFO ] Downloading kinds: [u'Blogs', u'Posts', u'Blog', u'Person', > u'Post', u'_ah_SESSION'] > ......[INFO ] _ah_SESSION: No descending index on __key__, performing > serial download > .................................................................................................................................................................................................................... > [INFO ] Have 21307 entities, 0 previously transferred > [INFO ] 21307 entities (7414423 bytes) transferred in 1063.4 seconds > > Then I use this command to upload to my new application: > > bulkloader.py --restore > --url=http://bulkmove.latest.railsturbinetest.appspot.com/--filename=test_download_data > --app_id=railsturbinetest > > And this is the output that I am getting: > Josh-Moores-MacBook:datadownload joshmoore$bulkloader.py --restore > --url=http://bulkmove.latest.railsturbinetest.appspot.com/--filename=test_download_data > --app_id=railsturbinetest ~/Documents/code/new_rails_turbine/ > /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py:64: > DeprecationWarning: the sha module is deprecated; use the hashlib module > instead > import sha > /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/dev_appserver_login.py:33: > DeprecationWarning: the md5 module is deprecated; use hashlib instead > import md5 > [INFO ] Logging tobulkloader-log-20100313.164108 > [INFO ] Throttling transfers: > [INFO ] Bandwidth: 250000 bytes/second > [INFO ] HTTP connections: 8/second > [INFO ] Entities inserted/fetched/modified: 20/second > [INFO ] Opening database:bulkloader-progress-20100313.164108.sql3 > [INFO ] Connecting to bulkmove.latest.railsturbinetest.appspot.com/ > Traceback (most recent call last): > File "/usr/local/bin/bulkloader.py", line 68, in <module> > run_file(__file__, globals()) > File "/usr/local/bin/bulkloader.py", line 64, in run_file > execfile(script_path, globals_) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 4031, in <module> > sys.exit(main(sys.argv)) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 4027, in main > return _PerformBulkload(arg_dict) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 3880, in _PerformBulkload > return_code = app.Run() > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 3170, in Run > kinds = self.RunPostAuthentication() > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 3278, in RunPostAuthentication > self.request_manager.IncrementId(list(ancestor_path), kind, high_id) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 1215, in IncrementId > start, end = datastore.AllocateIds(model_key, 1) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore.py", > line 1481, in AllocateIds > datastore_pb.AllocateIdsResponse(), rpc) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore.py", > line 177, in _MakeSyncCall > rpc.check_success() > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/apiproxy_stub_map.py", > line 474, in check_success > self.__rpc.CheckSuccess() > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/apiproxy_rpc.py", > line 149, in _WaitImpl > self.request, self.response) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py", > line 226, in MakeSyncCall > response) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py", > line 155, in MakeSyncCall > self._MakeRealSyncCall(service, call, request, response) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py", > line 168, in _MakeRealSyncCall > response_pb.ParseFromString(encoded_response) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/net/proto/ProtocolBuffer.py", > line 58, in ParseFromString > self.MergeFromString(s) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/net/proto/ProtocolBuffer.py", > line 71, in MergeFromString > self.Merge(d) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/net/proto/ProtocolBuffer.py", > line 175, in Merge > self.TryMerge(d) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_pb.py", > line 473, in TryMerge > d.skipData(tt) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/net/proto/ProtocolBuffer.py", > line 414, in skipData > raise ProtocolBufferDecodeError, "corrupted" > google.net.proto.ProtocolBuffer.ProtocolBufferDecodeError: corrupted > > I am using the Java SDK, but I am not sure if that makes a difference. I > have completed the download twice and get the same message about corruption > each time when I try to restore it. Can anybody point me in the write > direction to figure out this problem? > > Thanks, > > Josh
-- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
