I use s3ql-2.13 in CentOS7 packages with OpenStack Swift (/v1) as
backed storage.

S3ql is offen crached when the same file "s3ql_data_593221" tried to delete.

Is it a bug of s3ql?

*)Log of Swift's Object Server
Jun  1 02:00:21 swift5 object-server: 192.168.21.42 - -
[31/May/2015:17:00:21 +0000] "DELETE
/sdb1/104326/AUTH_mail/tumail/s3ql_data_593221" 204 - "DELETE
https://swift-proxy.int.center.tottori-u.ac.jp/v1/AUTH_mail/tumail/s3ql_data_593221";
"txdb28c26681314519ab627-00556b3e1a" "proxy-server 23208" 0.0066
Jun  1 02:00:21 swift5 object-server: 192.168.21.42 - -
[31/May/2015:17:00:21 +0000] "DELETE
/sdb1/104326/AUTH_mail/tumail/s3ql_data_593221" 404 - "DELETE
https://swift-proxy.int.center.tottori-u.ac.jp/v1/AUTH_mail/tumail/s3ql_data_593221";
"tx64af8b5fb25f4bf1a9dec-00556b3e24" "proxy-server 23209" 0.0065

*)mount.log with debug option (dugong)
2015-06-01 02:00:10.575 6580:Thread-7 dugong.eval_coroutine: polling
2015-06-01 02:00:10.575 6580:Thread-7 dugong.co_send_request: start
2015-06-01 02:00:10.575 6580:Thread-7 dugong.co_send_request: sending
DELETE /v1
/AUTH_mail/tumail/s3ql_data_593221
2015-06-01 02:00:10.576 6580:Thread-7 dugong._co_send: trying to send
228 bytes
2015-06-01 02:00:10.576 6580:Thread-7 dugong._co_send: sent 228 bytes
2015-06-01 02:00:10.576 6580:Thread-7 dugong._co_send: done
2015-06-01 02:00:10.576 6580:Thread-7 dugong.eval_coroutine: polling
2015-06-01 02:00:10.576 6580:Thread-7 dugong.co_read_response: start
2015-06-01 02:00:10.576 6580:Thread-7 dugong._co_read_status: start
2015-06-01 02:00:10.576 6580:Thread-7 dugong._co_readstr_until: reading
until b'
\r\n'
2015-06-01 02:00:10.577 6580:Thread-7 dugong._try_fill_buffer: start
2015-06-01 02:00:10.577 6580:Thread-7 dugong._try_fill_buffer: done
(nothing rea
dy)
2015-06-01 02:00:10.577 6580:Thread-7 dugong._co_readstr_until: need
more data,
yielding
2015-06-01 02:00:10.577 6580:Thread-7 dugong.poll: calling poll
2015-06-01 02:00:20.588 6580:Thread-7 dugong.disconnect: start
2015-06-01 02:00:20.614 6580:Thread-7 dugong.eval_coroutine: polling
2015-06-01 02:00:20.614 6580:Thread-7 dugong.co_send_request: start
2015-06-01 02:00:20.615 6580:Thread-7 dugong.connect: start
2015-06-01 02:00:20.615 6580:Thread-7 dugong.connect: connecting to
('swift-prox
y.int.center.tottori-u.ac.jp', 443)
2015-06-01 02:00:20.620 6580:Thread-7 dugong.connect: establishing ssl layer
2015-06-01 02:00:20.647 6580:Thread-7 dugong.connect: done
2015-06-01 02:00:20.647 6580:Thread-7 dugong.co_send_request: sending
DELETE /v1
/AUTH_mail/tumail/s3ql_data_593221
2015-06-01 02:00:20.648 6580:Thread-7 dugong._co_send: trying to send
228 bytes
2015-06-01 02:00:20.648 6580:Thread-7 dugong._co_send: sent 228 bytes
2015-06-01 02:00:20.649 6580:Thread-7 dugong._co_send: done
2015-06-01 02:00:20.649 6580:Thread-7 dugong.eval_coroutine: polling
2015-06-01 02:00:20.649 6580:Thread-7 dugong.co_read_response: start
2015-06-01 02:00:20.650 6580:Thread-7 dugong._co_read_status: start
2015-06-01 02:00:20.650 6580:Thread-7 dugong._co_readstr_until: reading
until b'
\r\n'
2015-06-01 02:00:20.651 6580:Thread-7 dugong._try_fill_buffer: start
2015-06-01 02:00:20.651 6580:Thread-7 dugong._try_fill_buffer: done
(nothing rea
dy)
2015-06-01 02:00:20.651 6580:Thread-7 dugong._co_readstr_until: need
more data,
yielding
2015-06-01 02:00:21.314 6580:Thread-7 dugong.eval_coroutine: polling
2015-06-01 02:00:21.314 6580:Thread-7 dugong._try_fill_buffer: start
2015-06-01 02:00:21.314 6580:Thread-7 dugong._try_fill_buffer: done (got
265 byt
es)
2015-06-01 02:00:21.315 6580:Thread-7 dugong._co_readstr_until: found
substr at
22
2015-06-01 02:00:21.315 6580:Thread-7 dugong._co_read_status: done
2015-06-01 02:00:21.315 6580:Thread-7 dugong.co_read_response: got 404
Not Found
2015-06-01 02:00:21.315 6580:Thread-7 dugong._co_read_header: start
2015-06-01 02:00:21.315 6580:Thread-7 dugong._co_readstr_until: reading
until b'
\r\n\r\n'
2015-06-01 02:00:21.316 6580:Thread-7 dugong._co_readstr_until: found
substr at
191
2015-06-01 02:00:21.316 6580:Thread-7 dugong._co_read_header: done (171
characte
rs)
2015-06-01 02:00:21.318 6580:Thread-7 dugong.co_read_response: identity
encoding
 detected
2015-06-01 02:00:21.318 6580:Thread-7 dugong.co_read_response: done
(in_remainin
g=70)
2015-06-01 02:00:21.319 6580:Thread-7 dugong.eval_coroutine: polling
2015-06-01 02:00:21.319 6580:Thread-7 dugong.co_discard: start
2015-06-01 02:00:21.319 6580:Thread-7 dugong.co_readinto: start
(buflen=65536)
2015-06-01 02:00:21.319 6580:Thread-7 dugong._co_readinto_id: start
(buflen=6553
6)
2015-06-01 02:00:21.319 6580:Thread-7 dugong._co_readinto_id: updated
len_=70
2015-06-01 02:00:21.319 6580:Thread-7 dugong._co_readinto_id: using
buffered dat
a
2015-06-01 02:00:21.320 6580:Thread-7 dugong._co_readinto_id: done (got
all we n
eed, 70 bytes)
2015-06-01 02:00:21.320 6580:Thread-7 dugong.co_discard: discarding 70 bytes
2015-06-01 02:00:21.320 6580:Thread-7 dugong.co_readinto: start
(buflen=65536)
2015-06-01 02:00:21.320 6580:Thread-7 dugong._co_readinto_id: start
(buflen=6553
6)
2015-06-01 02:00:21.320 6580:Thread-7 dugong.co_discard: done
2015-06-01 02:00:21.323 6580:Thread-7 root.excepthook: Uncaught
top-level exception:
Traceback (most recent call last):
  File
"/usr/lib64/python3.3/site-packages/s3ql-2.13-py3.3-linux-x86_64.egg/s3ql
/backends/swift.py", line 387, in delete
    resp = self._do_request('DELETE', '/%s%s' % (self.prefix, key))
  File
"/usr/lib64/python3.3/site-packages/s3ql-2.13-py3.3-linux-x86_64.egg/s3ql
/backends/swift.py", line 251, in _do_request
    raise HTTPError(resp.status, resp.reason, resp.headers)
s3ql.backends.s3c.HTTPError: 404 Not Found

uring handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File
"/usr/lib64/python3.3/site-packages/s3ql-2.13-py3.3-linux-x86_64.egg/s3ql/mount.py",
line 64, in run_with_except_hook
    run_old(*args, **kw)
  File "/usr/lib64/python3.3/threading.py", line 594, in run
    self._target(*self._args, **self._kwargs)
  File
"/usr/lib64/python3.3/site-packages/s3ql-2.13-py3.3-linux-x86_64.egg/s3ql/block_cache.py",
line 688, in _removal_loop
    backend.delete_multi(['s3ql_data_%d' % i for i in ids])
  File
"/usr/lib64/python3.3/site-packages/s3ql-2.13-py3.3-linux-x86_64.egg/s3ql/backends/comprenc.py",
line 274, in delete_multi
    return self.backend.delete_multi(keys, force=force)
  File
"/usr/lib64/python3.3/site-packages/s3ql-2.13-py3.3-linux-x86_64.egg/s3ql/backends/common.py",
line 407, in delete_multi
    self.delete(key, force=force)
  File
"/usr/lib64/python3.3/site-packages/s3ql-2.13-py3.3-linux-x86_64.egg/s3ql/backends/common.py",
line 52, in wrapped
    return method(*a, **kw)
  File
"/usr/lib64/python3.3/site-packages/s3ql-2.13-py3.3-linux-x86_64.egg/s3ql/backends/swift.py",
line 391, in delete
    raise NoSuchObject(key)
s3ql.backends.common.NoSuchObject: Backend does not have anything stored
under key 's3ql_data_593221'


Install information as follows.

*)pip -V
pip 7.0.1 from /usr/lib/python3.3/site-packages (python 3.3)

*)piplist
You are using pip version 7.0.1, however version 7.0.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
apsw (3.8.10.1.post1)
defusedxml (0.4.1)
dugong (3.5)
llfuse (0.40)
pip (7.0.1)
pycrypto (2.6.1)
requests (2.7.0)
s3ql (2.13)
setuptools (16.0)
wheel (0.24.0)

-- 
You received this message because you are subscribed to the Google Groups 
"s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
For more options, visit https://groups.google.com/d/optout.

Reply via email to