Re: Question about spidering

2007-12-12 Thread Micah Cowan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Srinivasan Palaniappan wrote: I am using WGET version 1.10.2, and trying to crawl through a secured site (that we are developing for our customer) I noticed two things. WGET is not downloading all the binaries in the website. It downloads about

Re: Question about spidering

2007-12-12 Thread Micah Cowan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Micah Cowan wrote: Srinivasan Palaniappan wrote: wget -r l5 --save-headers --no-check-certificate https://www.mystie.com ^^ -r doesn't take an argument. Perhaps you wanted a -l before the 15? Or a - before the l5. Curse the visual

Question about spidering

2007-12-11 Thread Srinivasan Palaniappan
Hi, I am using WGET version 1.10.2, and trying to crawl through a secured site (that we are developing for our customer) I noticed two things. WGET is not downloading all the binaries in the website. It downloads about 30% of it then skips the rest of the documents. But I don't see any log