On Apr 21 2016, Chris Davies <[email protected]> wrote: > Hello, > > I'm using S3QL with OVH Cloud Storage (no, that's not Hubic) and it's > working mostly very nicely, thank you. This is running S3QL from Debian > unstable (version "2.17.1+hg2+dfsg-3"). > > Unfortunately I'm getting around two or three filesystem crashes each day. > strace shows the python process stuck on a futex (I can't help you more > than that without some hand-holding, sorry) and the only solution is to > kill the process and run fsck.s3ql. It's possibly due to the amount of data > I'm writing to the store > > Directory entries: 6017319 > Inodes: 5991966 > Data blocks: 761943 > Total data size: 4.79 TB > After de-duplication: 1.12 TB (23.38% of total) > After compression: 972 GiB (19.81% of total, 84.75% of de-duplicated) > Database size: 944 MiB (uncompressed) > Cache size: 10.00 GiB, 1030 entries > Cache size (dirty): 10.00 GiB, 1030 entries > > I only mount the S3QL filesystem from one client. > > Given that I want to remount the filesystem as soon as the fsck has > completed, is there any sense or possibility in being able to avoid the > "committing block..." section of the fsck process? This could leave the > blocks marked as dirty cache and these could be swept up at a later > time [...]
People never cease to amaze me. You really want to invest your time in making fsck.s3ql run faster, and live with periodic crashes/hangs? Well, that's certainly up to you. I, however, will only spend my time on trying to fix the underlying bug, which I consider a much more fruitful endeavor. If you want to help me, please follow the instructions on https://bitbucket.org/nikratio/s3ql/wiki/Providing%20Debugging%20Info. If you could create a backtrace at the time the mount.s3ql process hangs, that would be very helpful. Best, -Nikolaus -- GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F »Time flies like an arrow, fruit flies like a Banana.« -- You received this message because you are subscribed to the Google Groups "s3ql" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
