On Fri, Jul 27, 2001 at 01:55:35PM +0000, [EMAIL PROTECTED] wrote:
> Hi,
>
> I came accross with some problems while using wget to download Debian
> 2.2(stable) release using ftp.
>
> There is symlinks to other branches of directories. (There is symlinks to
> files in <../binary-all/...> and <../../../ .... /pool/......> directories
> in ..../main/binary-i386/admin/ directory.) Is it possible to make wget
> follow symlinks and downloads files, symlink'ed to, to local appropriate
> directories?(Not using "retr_symlink" option) I can do this with Perl, but
> I want wget do this. (To retrieve only symlink'ed files sitting in the
> other directories.)
>
>
> While using "retr_symlinks" option symlink'ed files are retrieved again and
> again, its failing to take into account that local files are not old.
>
>
> I am not subscribed to newsgroup.
>
> With respect,
> Gintaras
I have scripts to download Debian, by first fetching the Packages file and then
feeding all the URLs from there into wget -c-. However the trunk wget insists on
opening a new connection for each file; I have a patch which will fix this.
Script is attached; patch is in the mailing list archive. Will require some
customization.
--
Always hardwire the explosives
-- Fiona Dexter quoting Monkey, J. Gregory Keyes, Dark Genesis
#!/bin/bash
cd /usr/make/debian
export SITE="ftp://ftp.de.debian.org/debian-non-US";
export y="/non-US/"
export z="ftp.de.debian.org/debian-non-US/dists"
export q="main contrib non-free"
/home/browser/scripts/mirrordebiana
export SITE="ftp://ftp.de.debian.org/debian";
export y="/"
export z="ftp.de.debian.org/debian/dists"
export q="main contrib non-free"
/home/browser/scripts/mirrordebiana
wget --mirror --recursive --level 1 --include-directories=/~ovek/
http://www.winehq.com/~ovek/
#!/bin/bash
wget -T15 --mirror $SITE/dists/woody$y/Contents-i386.gz
for x in $q; do
wget -T15 --mirror $SITE/dists/{woody,potato,sid}$y/$x/binary-{i386,all}/
wget -T15 --mirror $SITE/dists/proposed-updates/;
done
(cd $z; for x in `find -name Packages`; do cat $x ; done) | perl -n -e "if ( \$_ =~
s/^Filename: pool/pool/g ) { print \"\$ENV{SITE}\/\"; print \$_; }" | sort |uniq |
wget --mirror -i- --retr-symlinks -T15
#!/bin/bash
cd /usr/make/debian/
(cd ftp.de.debian.org; for x in `find -name Packages`; do cat $x ; done ) | perl -n -e
"if ( \$_ =~ s/^Filename: //g ) { print \"./debian/\"; print \$_; }" | sed
"s/^.\/debian\/pool\/non-US/.\/debian\/non-US\/pool\/non-US/g" | sort | uniq >
~/keep.txt
(cd ftp.de.debian.org; find -iname "*.deb" | sort ) > ~/all.txt
comm -3 -1 ~/keep.txt ~/all.txt > ~/remove.txt
(cd ftp.de.debian.org; cat ~/remove.txt | xargs rm)
