On Mar 27 2018, Chris Davies <[email protected]> wrote:
> Hello,
>
> I'm using OVH Cloud with a large S3QL filesystem. (This is not hubiC.). OVH
> Cloud is OpenStack and uses swiftks. Normally the response time from OVH
> Cloud is exceedingly fast, but recently I'm getting a very large number of
> timeouts after needing to run an fsck on the filesystem.
>
> fsck.s3ql --cachedir /autofs/cache/s3ql --log
> /autofs/cache/s3ql/fsck.GRA1_Live.log --backend-options tcp-timeout=90
> swiftks://auth.cloud.ovh.net/GRA1:XXXXXX/
>
> Here is a sample from the log file:
>
[...]
> 2018-03-27 20:19:44.250 1483:MainThread s3ql.backends.common.wrapped:
> Encountered ConnectionTimedOut (send/recv timeout exceeded), retrying
> Backend._copy_helper (attempt 3)...
> ...
> 2018-03-27 20:52:26.376 1483:MainThread s3ql.backends.common.wrapped:
> Encountered ConnectionTimedOut (send/recv timeout exceeded), retrying
> Backend._copy_helper (attempt 16)...
>
[...]
>
> I'm aware that I have a very large database (the uncompressed size is now
> 12GB) and I want to split it. But until I can get this filesystem mounted I
> can't copy off the data and so I can't reduce its size. I've increased
> --backend-options
> tcp-timeout=90 from its previous default of 20 but that doesn't seem to be
> making any difference.
>
> What controls the metadata copy timeout, and can I increase it enough to
> get my filesystem mounted?
The only timeout that S3QL sets is the tcp-timeout. But it may be that
your operating system (or some router along the way) terminates the TCP
connection when it is idle for that long. That's a deficiency of
OpenStack, AWS solves this problem by sending dummy data over the wire
while the request is being carried out.
Best,
-Nikolaus
--
GPG Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
»Time flies like an arrow, fruit flies like a Banana.«
--
You received this message because you are subscribed to the Google Groups
"s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
