Re: help over rsync vs cvsupd perfmance
The testing is not yet done for my job commitments, but I want to test rsync and cvsup performances. At this point, I think that I must to test with DragonFly 1.8 and DragonFly 1.9 releases. I hope (and I will try hard) that I could to finish my pledge before the end of next mounth. Congratulations for 1.8 release! Saverio ___ Vinci i biglietti per FIFA World Cup in Germania! yahoo.it/concorso_messenger
Re: help over rsync vs cvsupd perfmance
I tried: cvsup -h theshell.com /usr/share/examples/cvsup/DragonFly-src-supfile to update DragonFly's source. How can I update DragonFly's source with rsync? I tried: rsync -e rsh rsync://rsync.theshell.com/pub/DragonFly /usr/src but it don't work. Where is my error? Saverio __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
On Wed, Jan 03, 2007 at 11:20:11PM +0100, Saverio Iacovelli wrote: I tried: cvsup -h theshell.com /usr/share/examples/cvsup/DragonFly-src-supfile to update DragonFly's source. How can I update DragonFly's source with rsync? I tried: rsync -e rsh rsync://rsync.theshell.com/pub/DragonFly /usr/src but it don't work. Where is my error? I think you're expecting to be able to rsync a checked-out version of the src tree? If so, theshell.com doesn't offer that. If you want to grab the cvs repository, try something like: rsync -rtl --delete rsync.theshell.com/pub/DragonFly/dcvs/ /home/dcvs This will fetch the entire cvs repository, and then you'll be able to check out sources using cvs from that. To be fair for testing, you'll probably want to make cvsup grab the same thing (look at /usr/share/examples/cvsup/DragonFly-cvs-supfile). If checked-out sources are desired, I guess I could set that up. I think you need to figure out exactly what you're benchmarking. --Peter pgpzP9CsoAjA7.pgp Description: PGP signature
RE: help over rsync vs cvsupd perfmance
Um, I just meant cvsup vs. rsync without ssh. Rsync can talk to the rsync daemon that runs on the remote server, I'd think this is the best way that you can use rsync. I don't know enough about cvsup to say anything like that, though. For using ssh/rsh with rsync, you just need to do the following: rsync -e ssh/rsh other options And yes, probably the most important test is seeing how fast partial updates work, like Justin said. One other (not so important) thing you might want to try is to see what happens when you try to update say, 1.6 to 1.6 - ideally you should get a near-zero download. It'd be interesting to see how much data is actually transferred by cvsup and rsync. Hope this helps, K. One of the biggest issues I have with rsync is the amount of time it takes to produce and transfer the list of files before it moves any deltas between hosts. I sync two repositories every day, consisting of over 60,000 files. rsync's incredibly efficient when it comes to pumping the changes across, but it's the wall-lock time for the list of files that I find a little annoying - takes about 20 minutes before any syncing is done... Perhaps a tiny bit of development on rsync itself might be in order - perhaps threading, so that the list of files can be transferred while deltas start being pumped... Nige.
Re: help over rsync vs cvsupd perfmance
Ok, I want to do a good test. So, I need some days yet, about one or two weeeks, the CVSup and rsync mirrors that I will test they are: 1) chlamydia.fs.ei.tum.de 2) AllBSD.org 3) TheShell.com My intention about test is the following: 1) I will test CVSup: - without and with compression of all data sent over network - without and with ssh connection to server 2) I will test rsync: - without and with compression of all data sent over network - without and with ssh connection to server __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
On 1/1/07, Saverio Iacovelli [EMAIL PROTECTED] wrote: Ok, I want to do a good test. So, I need some days yet, about one or two weeeks, the CVSup and rsync mirrors that I will test they are: 1) chlamydia.fs.ei.tum.de 2) AllBSD.org 3) TheShell.com My intention about test is the following: 1) I will test CVSup: - without and with compression of all data sent over network - without and with ssh connection to server 2) I will test rsync: - without and with compression of all data sent over network - without and with ssh connection to server Offhand, I think that both the compression and the encryption due to ssh would result in overheads we could do without. Personally, I'd be interested in raw cvsup vs. raw rsync :) But that's just my opinion, let that not stop you from finding out for yourself! BTW, Saverio - when you say you're testing rsync without ssh, I'm assuming that you'll be talking to the rsync daemon on the remote server - is that right? Have fun testing! Cheers, Karthik.
Re: help over rsync vs cvsupd perfmance
1) What meaning raw cvsup vs. raw rsync? 2) What is raw BTW, Saverio - when you say you're testing rsync without ssh, I'm assuming that you'll be talking to the rsync daemon on the remote server - is that right? I don't know if I will test this particul feature of rsync, but the problem for me it will be to disable ssh on the client to transfer files over rsh __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
On Mon, January 1, 2007 10:30 am, Saverio Iacovelli wrote: Ok, I want to do a good test. So, I need some days yet, about one or two weeeks, the CVSup and rsync mirrors that I will test they are: 1) chlamydia.fs.ei.tum.de 2) AllBSD.org 3) TheShell.com My intention about test is the following: You may want to test partial updates - i.e. test an update from 1.6 to 1.7. There may be a speed difference in the way the two programs do the update checks, as compared to downloading all the files at once.
Re: help over rsync vs cvsupd perfmance
On 2007-01-01 18:23, Justin C. Sherrill wrote: On Mon, January 1, 2007 10:30 am, Saverio Iacovelli wrote: Ok, I want to do a good test. So, I need some days yet, about one or two weeeks, the CVSup and rsync mirrors that I will test they are: 1) chlamydia.fs.ei.tum.de 2) AllBSD.org 3) TheShell.com My intention about test is the following: You may want to test partial updates - i.e. test an update from 1.6 to 1.7. There may be a speed difference in the way the two programs do the update checks, as compared to downloading all the files at once. Yes, this is probably the most useful test since I expect that this is the most common usage. If one needs to go from scratch there are tar- balls of the source that can be downloaded and then cvsup/rsync can be used to get to latest. But don't let that stop you from testing going from scratch also. -- Erik Wikström
Re: help over rsync vs cvsupd perfmance
On 1/1/07, Saverio Iacovelli [EMAIL PROTECTED] wrote: 1) What meaning raw cvsup vs. raw rsync? 2) What is raw Um, I just meant cvsup vs. rsync without ssh. Rsync can talk to the rsync daemon that runs on the remote server, I'd think this is the best way that you can use rsync. I don't know enough about cvsup to say anything like that, though. For using ssh/rsh with rsync, you just need to do the following: rsync -e ssh/rsh other options And yes, probably the most important test is seeing how fast partial updates work, like Justin said. One other (not so important) thing you might want to try is to see what happens when you try to update say, 1.6 to 1.6 - ideally you should get a near-zero download. It'd be interesting to see how much data is actually transferred by cvsup and rsync. Hope this helps, K.
Re: help over rsync vs cvsupd perfmance
Justin C. Sherrill wrote: On Sat, December 30, 2006 2:22 pm, Saverio Iacovelli wrote: I have two questions about benchmark: 1) Must I use tools to measure net performance during updating operation with cvsup or rsync? 2) What are important informations which I must to weigh? What are informations that it needs? 1: You can measure network performance, but it's not needed. Not needed, *unless* available b/w might be inconsistent between/during tests. You may already know if that is a likely situation, ELSE should monitor that also. Bill
Re: help over rsync vs cvsupd perfmance
So, I have DragonFly 1.7 updated to 25 december. I'm going to start test, I would know if I can bring my system to DragonFly 1.6.1 with cvsup and rsync, or if I can only update. Regards, Saverio __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
On 2006-12-30 14:08, Saverio Iacovelli wrote: So, I have DragonFly 1.7 updated to 25 december. I'm going to start test, I would know if I can bring my system to DragonFly 1.6.1 with cvsup and rsync, or if I can only update. You can with cvsup, make a copy of the 1.6-release sup-file and changes the line *default release=cvs tag=DragonFly_RELEASE_1_6_Slip to *default release=cvs tag=DragonFly_RELEASE_1_6_1 and use it to pull down the sources. -- Erik Wikström
Re: help over rsync vs cvsupd perfmance
You can with cvsup, make a copy of the 1.6-release sup-file and changes the line *default release=cvs tag=DragonFly_RELEASE_1_6_Slip to *default release=cvs tag=DragonFly_RELEASE_1_6_1 and use it to pull down the sources. and is it possible to set the same feature in rsync or in rsync.conf? Is it possible bring my system from 1.7 DEVELOPMENNT to 1.6.1 version with rsync? Thanks in advance to help, Saverio __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
The best thing to do if you intend to mess around with multiple versions of DragonFly is to pull down the CVS tree rather then the source code and learn a few basic CVS commands to checkout whatever version you want. -Matt
Re: help over rsync vs cvsupd perfmance
I have two questions about benchmark: 1) Must I use tools to measure net performance during updating operation with cvsup or rsync? 2) What are important informations which I must to weigh? What are informations that it needs? __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
I need a list of url where I enabled to download DragonFly source both rsync and cvsup. __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
I need a list of url where I enabled to download DragonFly source both rsync and cvsup. http://www.dragonflybsd.org/main/download.shtml There you are. Scroll down to Source mirrors. But maybe the two already suggested sites, theshell.com and chlamydia.fs.ei.tum.de is enough :-)
help over rsync vs cvsupd perfmance
I find, in the DragonFly project page, the following matter: - Benchmark rsync vs. cvsupd for getting source code updates Ok, I would like to test benchmark, but I need help to choose software for benckmarking and help to formulate test cases. Someone has suggestions? Regards, Saverio __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
Ok, expect you results of test and benchmark between cvsupd and rsyncd within eight days. If I need to help, then I will write over this forum. Regards, Saverio __ Do You Yahoo!? Poco spazio e tanto spam? Yahoo! Mail ti protegge dallo spam e ti da tanto spazio gratuito per i tuoi file e i messaggi http://mail.yahoo.it
Re: help over rsync vs cvsupd perfmance
On 2006-12-25 20:43, Justin C. Sherrill wrote: On Mon, December 25, 2006 10:12 am, Saverio Iacovelli wrote: I find, in the DragonFly project page, the following matter: - Benchmark rsync vs. cvsupd for getting source code updates Ok, I would like to test benchmark, but I need help to choose software for benckmarking and help to formulate test cases. Someone has suggestions? I think I was the one who came up with that idea. Testing it would be relatively simple. Set up two machines, networked together. Set up cvsupd and rsyncd on one machine, both using the same files as a repository. (all of DragonFly src would bet a good example) On the other machine, bring all those files down with rsync, and time how long it takes. Delete the files, and do it again with cvsup. Repeat both a few times just in case something happens to change the numbers during a run. Perhaps it should be included in the test an incremental update, like you have the code for DFly 1.6-RELEASE and update those to latest PREVIEW. I think this is a quite common scenario, probably more common (and thus important), than starting from scratch. -- Erik Wikström
Re: help over rsync vs cvsupd perfmance
Justin C. Sherrill wrote: You could benchmark against one of the public sites that offers DragonFly src both through cvsup and rsync, but the variability of the Internet path from you to them and back would mess up the scores, and the relatively lower speeds may mask any differences in the two protocols. but actually that's the thing they are used for: transferring sources over the internet. if somebody is interested, you are invited to use chlamydia for byte serving. just give me a short heads up before. i am both serving cvsup and rsync. i think it is also important to time the zero-update case, i.e. when you already have the latest sources. cheers simon -- Serve - BSD +++ RENT this banner advert +++ASCII Ribbon /\ Work - Mac +++ space for low €€€ NOW!1 +++ Campaign \ / Party Enjoy Relax | http://dragonflybsd.org Against HTML \ Dude 2c 2 the max ! http://golden-apple.biz Mail + News / \
Re: help over rsync vs cvsupd perfmance
On Tue, Dec 26, 2006 at 03:16:49AM +0100, Simon 'corecode' Schubert wrote: Justin C. Sherrill wrote: You could benchmark against one of the public sites that offers DragonFly src both through cvsup and rsync, but the variability of the Internet path from you to them and back would mess up the scores, and the relatively lower speeds may mask any differences in the two protocols. but actually that's the thing they are used for: transferring sources over the internet. if somebody is interested, you are invited to use chlamydia for byte serving. just give me a short heads up before. i am both serving cvsup and rsync. i think it is also important to time the zero-update case, i.e. when you already have the latest sources. I'll also extend that if anyone wants to use theshell.com, go for it. It is well-connected, and I don't mind if people go to town on it. --Peter pgp8CQIj61JKs.pgp Description: PGP signature
