Few more concerning issues we've seen in this regard. Why should the GAE backup process exceed any limits here?
1. 2012-11-23 12:09:59.114 /_ah/mapreduce/worker_callback 500 18339ms 2kb AppEngine-Google; (+http://code.google.com/appengine)0.1.0.2 - - [23/Nov/2012:04:09:59 -0800] "POST /_ah/mapreduce/worker_callback HTTP/1.1" 500 2592 "http://ah-builtin-python-bundle-dot-latest-dot.appspot.com/_ah/mapreduce/worker_callback"; "AppEngine-Google; (+http://code.google.com/appengine)" "ah-builtin-python-bundle-dot-latest-dot.appspot.com" ms=18339 cpu_ms=16769 cpm_usd=0.000290 queue_name=default task_name=appengine-mrshard-158262053021454DD84AC-1-13 instance= 00c61b117c34c5634e86dc85a5e55323018ab2<https://appengine.google.com/instances?app_id=s%7Etruesplit&version_id=ah-builtin-python-bundle.352804153354501097&key=00c61b117c34c5634e86dc85a5e55323018ab2#00c61b117c34c5634e86dc85a5e55323018ab2> 1. D 2012-11-23 12:09:40.919 Could not import map from google.appengine.ext.datastore_admin.backup_handler.BackupEntity. Will try recursively. Traceback (most recent call last): File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/util.py", line 98, in for_name result = __import__(module_name, None, None, [short_name]) ImportError: No module named BackupEntity E 2012-11-23 12:09:59.028 *string property entity_type_info is too long. It cannot exceed 1000000 characters.* Traceback (most recent call last): File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/_webapp25.py", line 712, in __call__ handler.post(*groups) File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/base_handler.py", line 81, in post self.handle() File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/handlers.py", line 223, in handle ctx.flush() File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/context.py", line 348, in flush pool.flush() File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/datastore_admin/backup_handler.py", line 1461, in flush db.run_in_transaction(tx) File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 2433, in RunInTransaction return RunInTransactionOptions(None, function, *args, **kwargs) File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 2571, in RunInTransactionOptions ok, result = _DoOneTry(new_connection, function, args, kwargs) File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 2593, in _DoOneTry result = function(*args, **kwargs) File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/datastore_admin/backup_handler.py", line 1457, in tx aggregation.put(force_writes=True) File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/db/__init__.py", line 1074, in put return datastore.Put(self._entity, **kwargs) File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 579, in Put return PutAsync(entities, **kwargs).get_result() File "/base/python_runtime/python_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 604, in get_result return self.__get_result_hook(self) File "/base/python_runtime/python_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1569, in __put_hook self.check_rpc_success(rpc) File "/base/python_runtime/python_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1224, in check_rpc_success raise _ToDatastoreError(err)*BadRequestError: string property entity_type_info is too long. It cannot exceed 1000000 characters. * 2. 2012-11-23 12:09:54.845 /_ah/mapreduce/worker_callback 500 22865ms 2kb AppEngine-Google; (+http://code.google.com/appengine)0.1.0.2 - - [23/Nov/2012:04:09:54 -0800] "POST /_ah/mapreduce/worker_callback HTTP/1.1" 500 2875 "http://ah-builtin-python-bundle-dot-latest-dot.appspot.com/_ah/mapreduce/worker_callback"; "AppEngine-Google; (+http://code.google.com/appengine)" "ah-builtin-python-bundle-dot-latest-dot.appspot.com" ms=22865 cpu_ms=15340 cpm_usd=0.000321 queue_name=default task_name=appengine-mrshard-158262053021454DD84AC-20-9 instance= 00c61b117cbbc7d880c5bc39716fdc80406d5e8c<https://appengine.google.com/instances?app_id=s%7Etruesplit&version_id=ah-builtin-python-bundle.352804153354501097&key=00c61b117cbbc7d880c5bc39716fdc80406d5e8c#00c61b117cbbc7d880c5bc39716fdc80406d5e8c> D 2012-11-23 12:09:32.674 1. Could not import map from google.appengine.ext.datastore_admin.backup_handler.BackupEntity. Will try recursively. Traceback (most recent call last): File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/util.py", line 98, in for_name result = __import__(module_name, None, None, [short_name]) ImportError: No module named BackupEntity E 2012-11-23 12:09:52.330 *The request to API call datastore_v3.Put() was too large.* Traceback (most recent call last): File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/_webapp25.py", line 712, in __call__ handler.post(*groups) File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/base_handler.py", line 81, in post self.handle() File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/handlers.py", line 223, in handle ctx.flush() File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/context.py", line 348, in flush pool.flush() File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/datastore_admin/backup_handler.py", line 1461, in flush db.run_in_transaction(tx) File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 2433, in RunInTransaction return RunInTransactionOptions(None, function, *args, **kwargs) File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 2571, in RunInTransactionOptions ok, result = _DoOneTry(new_connection, function, args, kwargs) File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 2593, in _DoOneTry result = function(*args, **kwargs) File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/datastore_admin/backup_handler.py", line 1457, in tx aggregation.put(force_writes=True) File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/db/__init__.py", line 1074, in put return datastore.Put(self._entity, **kwargs) File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 579, in Put return PutAsync(entities, **kwargs).get_result() File "/base/python_runtime/python_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 604, in get_result return self.__get_result_hook(self) File "/base/python_runtime/python_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1569, in __put_hook self.check_rpc_success(rpc) File "/base/python_runtime/python_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1222, in check_rpc_success rpc.check_success() File "/base/python_runtime/python_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 570, in check_success self.__rpc.CheckSuccess() File "/base/python_runtime/python_lib/versions/1/google/appengine/api/apiproxy_rpc.py", line 133, in CheckSuccess raise self.exception*RequestTooLargeError: The request to API call datastore_v3.Put() was too large.* -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/w4EHtDCCM6IJ. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
