Thomas Boerner wrote: > Is this behaviour: "robots.txt takes precedence over -p" a bug or > a feature?
It is a feature. If you want to ignore robots.txt, use this command line: wget -p -k www.heise.de/index.html -e robots=off Tony
Thomas Boerner wrote: > Is this behaviour: "robots.txt takes precedence over -p" a bug or > a feature?
It is a feature. If you want to ignore robots.txt, use this command line: wget -p -k www.heise.de/index.html -e robots=off Tony