Re: [Cooker] rsync dead on uninett
Ok, so ever since my friend told me my script wiped out his whole Cooker mirror, I've just been browsing the rsync shares wrong (forgetting the trailing slash) thinking the rsync mirrors were messed up when they might have been fine the whole time (and I was too scared to run my script and confirm/deny). Ok, so now I've added a DRYRUN option to my script: http://luigiwalser.homeip.net:8080/~david/cooksync.pl so you can see what the script would do, before committing, and wiping our your whole mirror or otherwise. --- Salane <[EMAIL PROTECTED]> wrote: > rsync -av --progress --partial --stats --delete > --max-delete=50 > ftp.uninett.no::Mandrake/Mandrake-devel/cooker/i586/ > /path-to/ __ Do you Yahoo!? Yahoo! Mail Plus - Powerful. Affordable. Sign up now. http://mailplus.yahoo.com
Re: [Cooker] rsync dead on uninett
On Monday 03 February 2003 10:10 pm, Chuck Shirley wrote:
> On Monday 03 February 2003 20:54, David Walser wrote:
> >Yeah, I know that, but if you're on dialup even 100
> >deletes still sucks :o(
> >
> >What sucks even more though, is that uninett is still
> >broken!!
> >
> >And it's weird that I never got my original message or
> >Salane's reply.
> >
> >--- Ben Reser <[EMAIL PROTECTED]> wrote:
> >> > If you limit deletes you will never delete all of
> >>
> >> cooker
> >>
> >> Just be sure to set your maxdelete high enough. If
> >> you're getting more
> >> than just i586 50 will be insufficient. I use 100
> >> with pretty good
> >> success on my mirror.
>
> What seems strange to me is that I have been using the
> Uninett mirror with great success. What path are you
> using to sync from? I use this (reconstructed from
> Ron Stodden's Troels perl script):
>
> my $server_no = "rsync://ftp.uninett.no:873";
> my $store = "/mnt";
> sync_profile_rsync("$server_no/Mandrake-devel/cooker/i586/",
> "$store/cooker/i586/"); my $rsync_options = '--delete';
> my $args = ("rsync -av -H -P --progress --stats $options
> --exclude-from=$exclude_file $remotemirror/ $localmirror/");
>
> Yielding:
>
> rsync -av -H -P --progress --stats --delete --exclude-from=$exclude_file
> rsync://ftp.uninett.no:873/Mandrake-devel/cooker/i586/ /mnt/cooker/i586/ I
> use an empty exclude file right now, so for me, I have the equivalent of:
> rsync -avHP --delete rsync://ftp.uninett.no:873/Mandrake-devel/cooker/i586/
> /mnt/cooker/i586/
>
> If you leave off all the fluffy options...
rsync -av --progress --partial --stats --delete --max-delete=50
ftp.uninett.no::Mandrake/Mandrake-devel/cooker/i586/ /path-to/
Re: [Cooker] rsync dead on uninett
I'm using the same (sans the :873). If I look in
Mandrake-devel/cooker all I see is:
drwxr-xr-x4096 2003/01/11 08:11:50 cooker
in which is:
lrwxrwxr-x 5 2002/06/08 07:00:28 cooker
in which is...
link_stat /cooker/cooker/cooker : No such file or
directory
client: nothing to do: perhaps you need to specify
some filenames or the --recursive option?
rsync error: partial transfer (code 23) at main.c(594)
And I (and other people) see the same thing on another
mirror that mirrors from uninett also.
--- Chuck Shirley <[EMAIL PROTECTED]> wrote:
> What seems strange to me is that I have been using
> the
> Uninett mirror with great success. What path are
> you
> using to sync from? I use this (reconstructed from
> Ron Stodden's Troels perl script):
>
> my $server_no = "rsync://ftp.uninett.no:873";
> my $store = "/mnt";
>
sync_profile_rsync("$server_no/Mandrake-devel/cooker/i586/",
> "$store/cooker/i586/");
> my $rsync_options = '--delete';
> my $args = ("rsync -av -H -P --progress --stats
> $options --exclude-from=$exclude_file $remotemirror/
> $localmirror/");
>
> Yielding:
>
> rsync -av -H -P --progress --stats --delete
> --exclude-from=$exclude_file
>
rsync://ftp.uninett.no:873/Mandrake-devel/cooker/i586/
> /mnt/cooker/i586/
> I use an empty exclude file right now, so for me, I
> have the equivalent of:
> rsync -avHP --delete
>
rsync://ftp.uninett.no:873/Mandrake-devel/cooker/i586/
> /mnt/cooker/i586/
>
> If you leave off all the fluffy options...
>
>
>
>
__
Do you Yahoo!?
Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com
Re: [Cooker] rsync dead on uninett
On Monday 03 February 2003 20:54, David Walser wrote:
>Yeah, I know that, but if you're on dialup even 100
>deletes still sucks :o(
>
>What sucks even more though, is that uninett is still
>broken!!
>
>And it's weird that I never got my original message or
>Salane's reply.
>
>--- Ben Reser <[EMAIL PROTECTED]> wrote:
>> > If you limit deletes you will never delete all of
>> cooker
>>
>> Just be sure to set your maxdelete high enough. If
>> you're getting more
>> than just i586 50 will be insufficient. I use 100
>> with pretty good
>> success on my mirror.
What seems strange to me is that I have been using the
Uninett mirror with great success. What path are you
using to sync from? I use this (reconstructed from
Ron Stodden's Troels perl script):
my $server_no = "rsync://ftp.uninett.no:873";
my $store = "/mnt";
sync_profile_rsync("$server_no/Mandrake-devel/cooker/i586/", "$store/cooker/i586/");
my $rsync_options = '--delete';
my $args = ("rsync -av -H -P --progress --stats $options --exclude-from=$exclude_file
$remotemirror/ $localmirror/");
Yielding:
rsync -av -H -P --progress --stats --delete --exclude-from=$exclude_file
rsync://ftp.uninett.no:873/Mandrake-devel/cooker/i586/ /mnt/cooker/i586/
I use an empty exclude file right now, so for me, I have the equivalent of:
rsync -avHP --delete rsync://ftp.uninett.no:873/Mandrake-devel/cooker/i586/
/mnt/cooker/i586/
If you leave off all the fluffy options...
Re: [Cooker] rsync dead on uninett
On Monday 03 February 2003 08:06 pm, Ben Reser wrote: > On Sat, Feb 01, 2003 at 01:34:32AM -0500, Salane wrote: > > important hint here > > rsync -av --progress --partial --stats --delete --max-delete=50 > > ftp.uninett.no::Mandrake/Mandrake-devel/cooker/i586/ > > > > If you limit deletes you will never delete all of cooker > > Just be sure to set your maxdelete high enough. If you're getting more > than just i586 50 will be insufficient. I use 100 with pretty good > success on my mirror. Yes during heavy update periods sometimes i change it to 100 but most of the time 50 is sufficient.
Re: [Cooker] rsync dead on uninett
Yeah, I know that, but if you're on dialup even 100 deletes still sucks :o( What sucks even more though, is that uninett is still broken!! And it's weird that I never got my original message or Salane's reply. --- Ben Reser <[EMAIL PROTECTED]> wrote: > > If you limit deletes you will never delete all of > cooker > > Just be sure to set your maxdelete high enough. If > you're getting more > than just i586 50 will be insufficient. I use 100 > with pretty good > success on my mirror. > > -- > Ben Reser <[EMAIL PROTECTED]> > http://ben.reser.org > > "America does not go abroad in search of monsters to > destroy. She is > the well-wisher to the freedom and independence of > all. She is the > champion only of her own." -- John Quincy Adams, > July 4th, 1821 > __ Do you Yahoo!? Yahoo! Mail Plus - Powerful. Affordable. Sign up now. http://mailplus.yahoo.com
Re: [Cooker] rsync dead on uninett
On Sat, Feb 01, 2003 at 01:34:32AM -0500, Salane wrote: > important hint here > rsync -av --progress --partial --stats --delete --max-delete=50 > ftp.uninett.no::Mandrake/Mandrake-devel/cooker/i586/ > > If you limit deletes you will never delete all of cooker Just be sure to set your maxdelete high enough. If you're getting more than just i586 50 will be insufficient. I use 100 with pretty good success on my mirror. -- Ben Reser <[EMAIL PROTECTED]> http://ben.reser.org "America does not go abroad in search of monsters to destroy. She is the well-wisher to the freedom and independence of all. She is the champion only of her own." -- John Quincy Adams, July 4th, 1821
Re: [Cooker] rsync dead on uninett
On Friday 31 January 2003 07:56 pm, David Walser wrote: > This is BAD news :o( > > If you go in rsync on uninett to > Mandrake-devel/cooker, it's just a recursive link to > itself, so if anybody tries to rsync from uninett now, > they can kiss Cooker goodbye! > > __ > Do you Yahoo!? > Yahoo! Mail Plus - Powerful. Affordable. Sign up now. > http://mailplus.yahoo.com important hint here rsync -av --progress --partial --stats --delete --max-delete=50 ftp.uninett.no::Mandrake/Mandrake-devel/cooker/i586/ If you limit deletes you will never delete all of cooker
Re: [Cooker] rsync dead on uninett
On Friday 31 January 2003 19:56, David Walser wrote: >This is BAD news :o( > >If you go in rsync on uninett to >Mandrake-devel/cooker, it's just a recursive link to >itself, so if anybody tries to rsync from uninett now, >they can kiss Cooker goodbye! > Seems to be working OK now... : [chas@visitoth chas]$ rsync -av -H -P --progress --stats rsync://ftp.uninett.no:873/Mandrake-devel/cooker/i586/ /mnt/cooker/i586/ receiving file list ... 4394 files to consider rsync[14742] (receiver) heap statistics: arena: 573880 (bytes from sbrk) ordblks:1 (chunks not in use) smblks: 0 hblks: 1 (chunks from mmap) hblkhd:319488 (bytes from mmap) usmblks:0 fsmblks:0 uordblks: 555736 (bytes used) fordblks: 18144 (bytes free) keepcost: 18144 (bytes in releasable chunk) Number of files: 4394 Number of files transferred: 0 Total file size: 2284272043 bytes Total transferred file size: 0 bytes Literal data: 0 bytes Matched data: 0 bytes File list size: 170990 Total bytes written: 109 Total bytes read: 171027 wrote 109 bytes read 171027 bytes 68454.40 bytes/sec total size is 2284272043 speedup is 13347.70
