On May 04 2015, Maxim Kostrikin <[email protected]> wrote:
>> >> I see almost 16 connections with s3 servers, but tcpdump shows small
>> >> rate
>> >> > of uploading PUTs.
>> >>
>> >> What do you mean with small? What do you expect it to be, and what did
>> >> you find instead?
>> >>
>> > 200 bytes - 1k per file.
>> > The dirty size was big (1-2GiB).
>>
>> No, I was talking about the small rate of PUTs that you saw in tcpdump.
>>
>> If we assume about 100 ms network latency, then with 200 byte files
>> you'd be able to transfer at most 200 bytes / 100 ms = 2 kB/s for each
>> active thread. So your 5 kb/s isn't completely the wrong order of
>> magnitude.
>>
>> I would expect that the initial fast period is just when you file up
>> your cache. Am I right that, if you set the cache to something small
>> (say 2 * <number of threads> entries), you're getting a constant
>> transfer rate from the very beginning?
>>
>> In tcpdump, how many PUTs do you see per second? Is that number constant?
>>
> All right, but why only 16 threads were transferring?
I could try to determine that, if you'd answer my question...
Best,
-Nikolaus
--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
»Time flies like an arrow, fruit flies like a Banana.«
--
You received this message because you are subscribed to the Google Groups
"s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
