Just so everyone knows, since disabling SSL via backend option "no-ssl" on Amazon S3, I haven't had a single incidence of the transport endpoint not connected error killing my mount. I have had three simultaneous s3 buckets mounted and transferred well over 8TB now without the endpoint disconnecting. I got the idea after seeing an SSL error in the mount.log after the last error and decided to disable it. It has been fine since. I don't know if this is a coincidence or if there's an issue with SSL, but I just wanted to let everyone know that for me disabling ssl did the trick. It's been nice and stable since.
Thanks for all the help! Brandon On Jun 19, 2016 11:35 PM, "Brandon Orwell" <[email protected]> wrote: So - what is the among other things in reference to increasing default block size? I have one set to 30MB. What problems could this cause? Please elaborate if you will. Thanks again, Brandon On Sun, Jun 19, 2016 at 7:37 PM, Nikolaus Rath <[email protected]> wrote: > On Jun 19 2016, Brandon Orwell <[email protected]> wrote: > > Right, but in this case, what's the difference? > > You should not deviate from the default without good reason. So if you > think it doesn't make a difference, that's an argument for going with > the default. > > > Does having a. Lower size help ensure there > > are no issues in the case of an interrupted transfer? > > Yes, among other things. > > > And it would matter because if we're talking 45TB, which is what is > > being uploaded, and we had to recover from a catastrophic failure, the > > amount of GETs to recover and amount of PUTs to store in any case > > wouldbe high if the object size is low. So the math here is its very > > expensive if there are that many objects. > > I highly recommend that you actually *do* the math, instead of relying > on your intuition of what the result will be. > > Suppose you use standard storage. Transferring 45 TB costs you about > $0.090/GB * 45 TB = $ 4147. With the default block size, you need > 4718592 GET requests, costing you $ 1.887 ($ 0.004 for 10,000 > requests). In other words, in the best case you will save less than $ 2 > out of $ 4149. > > > Best, > -Nikolaus > > -- > GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F > Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F > > »Time flies like an arrow, fruit flies like a Banana.« > > -- > You received this message because you are subscribed to a topic in the > Google Groups "s3ql" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/s3ql/8XlDBUn8poo/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "s3ql" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
