Thanks  for all you work so far, 

I've upgraded to 2.21; and started to try again ; but I got a crash after 
24 hours:-
mount.s3ql[181225:Thread-6] root.excepthook: Uncaught top-level exception:
                                           Traceback (most recent call 
last):
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/mount.py",
 
line 64, in run_with_except_hook
                                               run_old(*args, **kw)
                                             File 
"/usr/lib/python3.4/threading.py", line 868, in run
                                               self._target(*self._args, 
**self._kwargs)
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/block_cache.py",
 
line 405, in _upload_loop
                                               self._do_upload(*tmp)
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/block_cache.py",
 
line 432, in _do_upload
                                               % obj_id).get_obj_size()
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/common.py",
 
line 108, in wrapped
                                               return method(*a, **kw)
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/common.py",
 
line 340, in perform_write
                                               return fn(fh)
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/comprenc.py",
 
line 346, in __exit__
                                               self.close()
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/comprenc.py",
 
line 340, in close
                                               self.fh.close()
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/comprenc.py",
 
line 505, in close
                                               self.fh.close()
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/common.py",
 
line 108, in wrapped
                                               return method(*a, **kw)
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/s3c.py",
 
line 913, in close
                                               headers=self.headers, 
body=self.fh)
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/s3c.py",
 
line 467, in _do_request
                                               query_string=query_string, 
body=body)
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/s3ql-2.21-py3.4-linux-x86_64.egg/s3ql/backends/s3c.py",
 
line 702, in _send_request
                                               headers=headers, 
body=BodyFollowing(body_len))
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/dugong/__init__.py", line 570, 
in send_request
                                               self.timeout)
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/dugong/__init__.py", line 1496, 
in eval_coroutine
                                               if not 
next(crt).poll(timeout=timeout):
                                             File 
"/root/s3qlenv/lib/python3.4/site-packages/dugong/__init__.py", line 600, 
in co_send_request
                                               raise StateError('body data 
has not been sent completely yet')
                                           dugong.StateError: body data has 
not been sent completely yet

This is on Debain jessie ; with the s3ql built into a virtualenv.  

I think this possibly a race between the metadata upload and heavy 
filesystem modification; When I start the filesystem I have a heavy update 
load for the first 36 hours or so; I'm going to try a fsck and restart in 
the hope that we avoid the race hazard this time.

Judging by the log entries immediately before the metadata upload was 
occuring at this point; (The message  s3ql.metadata.upload_metadata: 
Compressing and uploading metadata...
 occurred a few seconds  before hand) .



-- 
You received this message because you are subscribed to the Google Groups 
"s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
For more options, visit https://groups.google.com/d/optout.

Reply via email to