Obviously self-promotional, but Parsyncfp?
https://github.com/hjmangalam/parsyncfp
There are other like scripted parallel rsyncs, but I like this one. ;)
Hjm
On Mon, Apr 17, 2023, 3:42 AM just subscribed for rsync-qa from bugzilla
via rsync wrote:
>
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #12 from Paulo Marques ---
Using multiple connections also helps when you have LACP network links, which
are relatively common in data center setups to have both redundancy and
increased bandwidth.
If you have two 1Gbps links
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #11 from Scott Peterson ---
(In reply to Haravikk from comment #4)
SPDY has apparently evolved into QUIC. QUIC supports multiple streams, which
can be created by either end. There can be a huge number of these. It seems
like a sender
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #10 from Scott Peterson ---
(In reply to Paul Slootman from comment #9)
Multiple connections also makes sense on high bandwidth links. I’ve never been
able to rsync at wire speed on a 40G link using only one connection.
--
You are
I made a bash script doing this in parallel, checks how many rsyncs are
running and then starts another 'concurrent one'. My parallel sessions
are against different servers. I doubt if it would make any sense doing
multiple sessions between the same two hosts. My single rsync sessions
was
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #9 from Paul Slootman ---
The issue when copying a large number of small files is disk IO / seeking.
Check the wait for IO values using top / whatever when doing such a transfer.
Running multiple threads in such a situation will only
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #8 from Michael ---
+1 from me on this.
We have several situations where we need to copy a large number of very small
files, and I expect that having multiple file transfer threads, allowing say ~5
transfers concurrently, would speed
On 10/11/2018 10:51 AM, just subscribed for rsync-qa from bugzilla via
rsync wrote:
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #7 from Luiz Angelo Daros de Luca ---
I also vote for this feature. Using multiple connections, rsync can use
multiples internet connections at the
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #7 from Luiz Angelo Daros de Luca ---
I also vote for this feature. Using multiple connections, rsync can use
multiples internet connections at the same time.
--
You are receiving this mail because:
You are the QA Contact for the bug.
On 26/01/14 18:03, L.A. Walsh wrote:
But multiple TCP connections are not used to load a single picture.
They are used
for separate items on the page. A single TCP stream CAN be very fast
and rsync
isn't close to hitting that limit.
The proof? Using 1Gb connections, smb/cifs could get
Matthias Schniedermeyer wrote:
On 25.01.2014 21:03, L.A. Walsh wrote:
If rsync already hitting over 200MB (even over 100MB)/s I'd agree that using
multiple TCP connections would help as they could be processed by different
cpu's on both ends. But since it doesn't even hit 100MB/s locally,
On 28.01.2014 04:26, L.A. Walsh wrote:
Matthias Schniedermeyer wrote:
On 25.01.2014 21:03, L.A. Walsh wrote:
If rsync already hitting over 200MB (even over 100MB)/s I'd agree that using
multiple TCP connections would help as they could be processed by different
cpu's on both ends. But
On 25.01.2014 21:03, L.A. Walsh wrote:
If rsync already hitting over 200MB (even over 100MB)/s I'd agree that using
multiple TCP connections would help as they could be processed by different
cpu's on both ends. But since it doesn't even hit 100MB/s locally, the
limit *isn't* TCP
samba-b...@samba.org wrote:
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #5 from Andrew J. Kroll fo...@dr.ea.ms 2014-01-19 03:10:35 UTC ---
Another proven case is your typical modern web browser.
There is a very good reason why multiple connections are used to load in those
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #5 from Andrew J. Kroll fo...@dr.ea.ms 2014-01-19 03:10:35 UTC ---
Actually having two or three TCP streams at the same time has proven to be
faster, because it can scan ahead. It is proven that if you download one large
file, while
https://bugzilla.samba.org/show_bug.cgi?id=5124
--- Comment #4 from Haravikk m...@haravikk.com 2014-01-14 17:40:22 UTC ---
I see this is quite old, and to be honest I'm not completely familiar with
rsync's implementation, but more rsync performance is of benefit to everyone so
I thought I'd chip
16 matches
Mail list logo
