On Thursday 08 August 2013 05:51:08 atar wrote:
wget download the robots.txt file although the '-R txt' option was
specified.
wget -e robots=no url
or to switch if off forever put
robots=no
into /etc/wgetrc or ~/.wgetrc.
Regards, Tim
Thanks!!!
On 08/08/13 16:43, atar wrote:
Hi there!!
I have searched in the wget's man page for info how to prevent wget
from follow after 302 Location headers and I didn't find any
appropriate material. has someone here any idea?
Thanks in advance!!
atar.
Use --max-redirect=0
Thanks!! it works.
Hi there!!!
Just wanted to ask please, if this mailing list is intended to be for help
requests.
Thanks in advance!!
atar.
Hi there!
wget download the robots.txt file although the '-R txt' option was
specified.
How to solve this problem?
Thanks in advance!!
atar.