The HTML of those pages contains the meta-tag

<meta name="robots" content="noindex,nofollow" />

and Wget listened, and only downloaded the first page.

Perhaps Wget should give a warning message that the file contained a
meta-robots tag, so that people aren't quite so dumb-founded.


On Fri, 17 Oct 2003, Philip Mateescu wrote:

> Hi,
> I'm having a problem with wget 1.8.2 cygwin and I'm almost ready to
> swear it once worked...
> I'm trying to download the php manual off the web using this command:
> $ wget -nd -nH -r -np -p -k -S

Consider supporting GNU Software and the Free Software Foundation
By Buying Stuff -
                      (GNU and FSF are not responsible for this promotion
                       nor necessarily agree with the views of the author)

Reply via email to