Re: rsync performance question
jw schultz writes: On Thu, Jan 08, 2004 at 01:05:25PM -0500, Rick Frerichs wrote: Hello, I seem to be having a performance problem with rsync. ... If I do a transfer (either way) with ftp, I get about 500 Kbytes/sec. Using rsync to do the same transfer (either way) I only get about 50 Kbytes/sec. You really need to provide us with more information - what operating systems are you using on both ends, how much memory do you have on the machines on both ends, and how many files are you attempting to transfer? This could be an antiquated hardware / not enough memory issue, as JW suggested, or it could be a network-related issue if one or both of the machines in question is a Windows box. Jim Salter -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync performance question Part II
Hello, I have more info on my specific problem. pop 1) RedHat 7.3, fs1 fs3 pop 2) BSD/OS 4.3.1 www files rsync version 2.6.0 protocol version 27 fs1 -- fs3 500kB/s fs1 -- fs3 420kB/s fs1 -- www20kB/s fs1 -- www20kB/s files -- www 2.9 MB/s files -- www 4,4 Mb/s This shows that within their own networks, there is no problem. It is only between the two pops. The machines have a enough RAM and speed. I always keep enough RAM so that it never has to swap. The times are for a single 10 MB file. I have tried with and without the -a option and that doesn't seem to make a difference. I would be surprised if it did. The interface on the RedHat side is set to 10 Mbps FD. The interface on the BSD side is 100Mbps FD. The Redhat pop gives you a 10 Mbps link and you can use as much as you can get. There is no limit on the BSD side. That is probably the reason that the transfer rates between fs1 and fs3 are somewhat lower than files and www. rsh is the shell, not ssh yet. The lav on the machines is less than 0.05. There is an external firewall (pop main cisco router) on the BSD side. These are the generic args: permit icmp any any echo permit tcp any any established permit udp any eq domain any permit udp any eq ntp any Specific args: permit tcp any gt 1023 host 66.205.95.230 gt 1023 permit tcp any host 66.205.95.230 eq www permit tcp any host 66.205.95.230 eq 443 permit tcp any gt 1023 host 66.205.95.230 eq ftp permit tcp any gt 1023 host 66.205.95.230 eq ftp-data Thank you for reading this, Rick ps. mirror... 8-) -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync performance question
Hello, I seem to be having a performance problem with rsync. I have done some testing of rsync and ftp. If I do a transfer (either way) with ftp, I get about 500 Kbytes/sec. Using rsync to do the same transfer (either way) I only get about 50 Kbytes/sec. I am only testing straight file copies. There is a firewall which I believe is configured properly. The ethernet interface is running at 10 Mbit full duplex. Does anyone have an idea of where I should be looking to solve this problem? Thank you, Rick -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync performance question
On Thu, Jan 08, 2004 at 01:05:25PM -0500, Rick Frerichs wrote: Hello, I seem to be having a performance problem with rsync. I have done some testing of rsync and ftp. If I do a transfer (either way) with ftp, I get about 500 Kbytes/sec. Using rsync to do the same transfer (either way) I only get about 50 Kbytes/sec. I am only testing straight file copies. There is a firewall which I believe is configured properly. The ethernet interface is running at 10 Mbit full duplex. Does anyone have an idea of where I should be looking to solve this problem? A mirror :) Seriously, rsync increases the load on CPU, memory and disk for the sake of reducing load on the network for synchronising files and directory trees. Rsync is less efficient than most copy utilities at straight copying and it's performance as a copy utility should not be considered when evaluating it as a synchronisation utility. The performance hit you are getting seems greater than i would normally expect. It may be rsync is pushing you over a threshold into a swap storm. Perhaps you are using some odd options (-c, -T) that slow things down dramatically. A 10MbFD network sounds very odd, FD would be switched or on a crossover 10Mb would be obsolete hardware indicating that possibly you have a very slow CPU, small memory and slow disks. As you provide no information regarding system configuration, versions or command-line options i can only speak in generalities. -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
