Mark Post wrote:


Getting to the real point, however, I've been having problems with the new
Novell download servers.  They're not as simply set up as the old SUSE
portal server.  You can't just mirror an entire directory with wget.  Or,
I'm just not able to figure out how to do it yet.

When I want to download stuff, I often use lynx to get the index page.
Lynx creates a list of URIs which I can then munge with grep, sed
and/awk to taste. Here's a sample of what I look for:
[EMAIL PROTECTED] ~]$ lynx  -dump http://rhel.demo.lan/ | tail -10
References

   1. http://rhel.demo.lan/?C=N;O=D
   2. http://rhel.demo.lan/?C=M;O=A
   3. http://rhel.demo.lan/?C=S;O=A
   4. http://rhel.demo.lan/?C=D;O=A
   5. http://rhel.demo.lan/3.90/
   6. http://rhel.demo.lan/3.95/
   7. http://rhel.demo.lan/4/
   8. http://rhel.demo.lan/updates/
[EMAIL PROTECTED] ~]$

Here is what the result might look loke:
[EMAIL PROTECTED] ~]$ lynx  -dump
http://rhel.demo.lan/4/i386/os/RedHat/RPMS/ | awk '/http.*\/ker.*rpm/
{print "wget "$2}'
wget
http://rhel.demo.lan/4/i386/os/RedHat/RPMS/kernel-2.6.9-1.648_EL.i586.rpm
wget
http://rhel.demo.lan/4/i386/os/RedHat/RPMS/kernel-2.6.9-1.648_EL.i686.rpm
wget
http://rhel.demo.lan/4/i386/os/RedHat/RPMS/kernel-doc-2.6.9-1.648_EL.noarch.rpm
wget
http://rhel.demo.lan/4/i386/os/RedHat/RPMS/kernel-hugemem-2.6.9-1.648_EL.i686.rpm
wget
http://rhel.demo.lan/4/i386/os/RedHat/RPMS/kernel-smp-2.6.9-1.648_EL.i586.rpm
wget
http://rhel.demo.lan/4/i386/os/RedHat/RPMS/kernel-smp-2.6.9-1.648_EL.i686.rpm
wget
http://rhel.demo.lan/4/i386/os/RedHat/RPMS/kernel-utils-2.4-13.1.37.i386.rpm
[EMAIL PROTECTED] ~]$

Beware wrapped lines!

One could, of course, simply produce a list of URNs and pipe them into
wget. Which is best depends on circumstances and taste.

--

Cheers
John

-- spambait
[EMAIL PROTECTED]  [EMAIL PROTECTED]
Tourist pics http://portgeographe.environmentaldisasters.cds.merseine.nu/

do not reply off-list

----------------------------------------------------------------------
For LINUX-390 subscribe / signoff / archive access instructions,
send email to [EMAIL PROTECTED] with the message: INFO LINUX-390 or visit
http://www.marist.edu/htbin/wlvindex?LINUX-390

Reply via email to