wget -r -np -l0 -S --spider http://172.20.241.206/HTTP_Share/performance_data/mixed/rtf/
--22:35:10-- http://172.20.241.206/HTTP_Share/performance_data/mixed/rtf/ => ` 172.20.241.206/HTTP_Share/performance_data/mixed/rtf/index.html' Connecting to 172.20.241.206:80... connected. HTTP request sent, awaiting response... HTTP/1.1 200 OK Content-Length: 3510 Content-Type: text/html Server: Microsoft-IIS/6.0 X-Powered-By: ASP.NET Date: Wed, 21 Jul 2010 22:31:22 GMT Connection: keep-alive Length: 3,510 (3.4K) [text/html] 200 OK 172.20.241.206/HTTP_Share/performance_data/mixed/rtf/index.html: No such file or directory FINISHED --22:35:10-- Downloaded: 0 bytes in 0 files See I am not able to recursively SPIDER through the URL. Whereas if I remove --spider option, wget recursively downloads all files referred by URL including index.html. My requirement is to spider recursively through a given URL. On Wed, Jul 21, 2010 at 7:04 PM, Giuseppe Scrivano <[email protected]>wrote: > I couldn't reproduce this problem, can you please give me more > information? > > Can you use the -d flag to wget and see what happens? > > Thanks, > Giuseppe > > > > Avinash <[email protected]> writes: > > > Hi All, > > > > I am trying to use --spider option with an URL ending with '/'. > > The error I am getting is, index.html not found. > > > > Whereas, when I remove the --spider option, I can see wget automatically > > downloads index.html and rest of the files referenced by the same URL. > > > > Then, why can't wget automatically download index.html when --spider > option > > is specified ? > -- -Avinash
