On 3/25/06, Jorrit Kronjee <[EMAIL PROTECTED]> wrote: > nocfed wrote: > > > > You have failed to understand the 'hint' part. It was a hint at ONE > > of the switches to use.. > > > > As you apparently have not read the manpage for wget, here is the full > > command. > > > > wget -e robots=off -Hr -nd -np --domains=72.14.203.104 -U Mozilla > > http://www.elsenot.com/frsirt-google.html > > At the risk of stating the obvious and hopefully putting an end to this > thread, http://www.frsirt.com/robots.txt doesn't contain /exploits/ ? So > what's your point? > > - Jorrit >
wget is not crawling nor attempting to request anything form frsirt. google on the other hand DOES use robots which wget will honor by default. _______________________________________________ Full-Disclosure - We believe in it. Charter: http://lists.grok.org.uk/full-disclosure-charter.html Hosted and sponsored by Secunia - http://secunia.com/
