I can't be sure the upgrade path here, but lit's probably Debian "stretch"
S3QL 3.x to the latest in the Debian "buster"
backports, 3.3+dfsg-1~bpo10+1. (It's definitely not an upgrade from the
earlier S3QL filesystem 2.x version.) Everything's been working happily
until earlier today when my client system crashed. The S3QL filesystem was
in use at the time to an S3 backend, and unsurprisingly when it all came
back up I needed fsck.
Here's where it's gone pear-shaped. The fsck fails during the cycling of
the metadata. I've added some debug to help identify what's going on, but I
can't see where the HTTPError is escaping without being rewritten as
NoSuchObject:
2019-10-09 21:23:01.976 3725:MainThread s3ql.backends.swift._detect_features
: Detected Swift features for XXX:
copy via COPY, Bulk delete 1000 keys at a time, maximum meta value length is
255 bytes
2019-10-09 21:23:03.320 3725:MainThread s3ql.fsck.main: Starting fsck of
swift://YYY/ZZZ/
2019-10-09 21:23:04.218 3725:MainThread s3ql.fsck.main: Using cached
metadata.
2019-10-09 21:23:04.431 3725:MainThread s3ql.fsck.main: Remote metadata is
outdated.
...
2019-10-09 21:24:08.019 3725:MainThread s3ql.metadata.upload_metadata:
Compressing and uploading metadata...
2019-10-09 21:24:41.005 3725:MainThread s3ql.metadata.upload_metadata: Wrote
10.2 MiB of compressed metadata.
2019-10-09 21:24:41.005 3725:MainThread s3ql.metadata.upload_metadata:
Cycling metadata backups...
2019-10-09 21:24:41.006 3725:MainThread s3ql.metadata.cycle_metadata:
Backing up old metadata...
2019-10-09 21:24:41.006 3725:MainThread s3ql.metadata.cycle_metadata: - [CJD
] copy old metadata 9...
2019-10-09 21:24:52.037 3725:MainThread s3ql.metadata.cycle_metadata: - [CJD
] copy old metadata 8...
2019-10-09 21:25:07.689 3725:MainThread s3ql.metadata.cycle_metadata: - [CJD
] copy old metadata 7...
2019-10-09 21:25:08.686 3725:MainThread root.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/bin/fsck.s3ql", line 11, in <module>
load_entry_point('s3ql==3.3', 'console_scripts', 'fsck.s3ql')()
File "/usr/lib/s3ql/s3ql/fsck.py", line 1298, in main
dump_and_upload_metadata(backend, db, param)
File "/usr/lib/s3ql/s3ql/metadata.py", line 319, in
dump_and_upload_metadata
upload_metadata(backend, fh, param)
File "/usr/lib/s3ql/s3ql/metadata.py", line 333, in upload_metadata
cycle_metadata(backend)
File "/usr/lib/s3ql/s3ql/metadata.py", line 126, in cycle_metadata
cycle_fn("s3ql_metadata_bak_%d" % i, "s3ql_metadata_bak_%d" % (i + 1))
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 310, in copy
self._copy_or_rename(src, dest, rename=False, metadata=metadata)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 343, in
_copy_or_rename
self.backend.copy(src, dest, metadata=meta_raw)
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 656, in copy
self._copy_via_copy(src, dest, metadata=metadata)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 108, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 646, in _copy_via_copy
resp = self._do_request('COPY', '/%s%s' % (self.prefix, src), headers=
headers)
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 267, in _do_request
raise HTTPError(resp.status, resp.reason, resp.headers)
s3ql.backends.s3c.HTTPError: 404 Not Found
Suggestions gratefully appreciated.
Thanks,
Chris
--
You received this message because you are subscribed to the Google Groups
"s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/s3ql/e1445ecd-db8e-49ab-9456-9a2b6e01f5d7%40googlegroups.com.
