On 01/25/2015 09:55 PM, Di Pe wrote:
We have our local swift cluster and we have a few use cases for s3ql.
One of them is keeping a mirror of a posix file system. For this we want
to maximize write throughput per process. I am aware that each copy
process is limited by the write throughput of the swift cluster which
is between 50 and 60 MB/s. I thought that compression would be able to
improve upload performance but no matter which compression type I use my
1GB test file always needs 24-28 sec to upload and rsync shows between
30 and 40 MB/s throughput. Is zlib perhaps too slow to do real
on-the-fly compression and has to do most of the work after the file is
uploaded?
contrib/benchmark.py should be able to answer that question.
Best,
-Nikolaus
--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
»Time flies like an arrow, fruit flies like a Banana.«
--
You received this message because you are subscribed to the Google Groups
"s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
