Re: feature wish: switch to disable robots.txt usage

[Noel Koethe]

On Mit, 10 Apr 2002, Jens Rösner wrote:

Hello Jens,

  is it possible to get a new option to disable the usage
  of robots.txt (--norobots)?

 I think at least since 1.7, probably even longer.
 Cut from the doc:
 robots = on/off
 Use (or not) /robots.txt file (see Robots.). Be sure to know what you
 are doing before changing the default (which is on).
 Please note:
 This is a (.)wgetrc-only command.
 You cannot use it on the command line, if I am not mistaken.

Ok got it. But it is possible to get this option as
a switch for using it on the command line?

thx.

-- 
Noèl Köthe

Re: feature wish: switch to disable robots.txt usage

[Hrvoje Niksic]

Noel Koethe [EMAIL PROTECTED] writes:

 Ok got it. But it is possible to get this option as a switch for
 using it on the command line?

Yes, like this:

wget -erobots=off ...

Re: feature wish: switch to disable robots.txt usage

[Jens Rösner]

Hi!

Just to be complete, thanks to Hrvoje's tip, 
I was able to find 

-e command
--execute command
Execute command as if it were a part of .wgetrc (see Startup File.). 
A command thus invoked will be executed after the 
commands in .wgetrc, thus taking precedence over them.

I always wondered about that. *sigh*
I can now think about changing my wgetgui in this aspect :)

Thanks again
Jens


Hrvoje Niksic wrote:
 
 Noel Koethe [EMAIL PROTECTED] writes:
 
  Ok got it. But it is possible to get this option as a switch for
  using it on the command line?
 
 Yes, like this:
 
 wget -erobots=off ...