How comes that there is no --robots / --no-robots option ? Instead we have to use -e robots=on/off. This is ok, but a little bit inconsistent and hard to find (wget --help won't show it).
I would create a patch if there is any interest... Tim
How comes that there is no --robots / --no-robots option ? Instead we have to use -e robots=on/off. This is ok, but a little bit inconsistent and hard to find (wget --help won't show it).
I would create a patch if there is any interest... Tim