On Mon, Jun 21, 2010 at 06:29:47PM -0400, Andrew Farnsworth wrote:
> Good suggestion on robots.txt but I just checked and the robots.txt file
> does not exist.

        If your wget is compiled with debug enabled try running it with 
        --debug specified and see if you can locate the issue?  What
        does the server {access,error}_log say?



                                                        John

-- 
We only think when we are confronted with problems.

-- John Dewey (1859-1952), American philosopher, educator

Attachment: pgpUFd497B0xT.pgp
Description: PGP signature

Reply via email to