Re: Wget exit codes

2007-12-11 Thread R Kimber
On Sun, 09 Dec 2007 13:19:51 -0800 Micah Cowan wrote: I believe I already answered this: it is because a non-zero exit status always means something's wrong. Myriad scripts invoke utilities in ways similar to: if ! wget http://foo.com/ then echo Something went wrong with the download.

Re: Wget exit codes

2007-12-11 Thread Micah Cowan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 R Kimber wrote: On Sun, 09 Dec 2007 13:19:51 -0800 Micah Cowan wrote: I believe I already answered this: it is because a non-zero exit status always means something's wrong. Myriad scripts invoke utilities in ways similar to: if ! wget

wget -Y0

2007-12-11 Thread Micah Cowan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 What's up with the -Y option? It doesn't appear in the manual (except in an example invocation, in the section on how to report bugs); but it does show up in --help: -Y, --proxy explicitly turn on proxy. --no-proxy

Question about spidering

2007-12-11 Thread Srinivasan Palaniappan
Hi, I am using WGET version 1.10.2, and trying to crawl through a secured site (that we are developing for our customer) I noticed two things. WGET is not downloading all the binaries in the website. It downloads about 30% of it then skips the rest of the documents. But I don't see any log