Good suggestion on robots.txt but I just checked and the robots.txt file does not exist.
Andy > > > wget -mc is for mirror and continue if stopped.. > > Is there a robots.txt file in Apache I'm assuming stopping your robot. > -- > -- > > Remember it's not that we have something to hide, we just have nothing > we want to show. > ---Keep tunnelling. > > -- You received this message because you are subscribed to the Google Groups "NLUG" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/nlug-talk?hl=en
