On 16/09/13 13:35, Tim Ruehsen wrote:
I think that's on purpose for making hard to ignore the robots.txt specification.How comes that there is no --robots / --no-robots option ? Instead we have to use -e robots=on/off. This is ok, but a little bit inconsistent and hard to find (wget --help won't show it).I would create a patch if there is any interest... Tim
