"chatiman" <[EMAIL PROTECTED]> writes: > I'm trying to download a robots.txt protexted directory and I'm having the > following problem: > > - wget downloads the files but delete them after they are downloaded with > the following :message (translated from french): > Destroyed <file> because it must be rejected
That message has nothing to do with robots.txt, it means that you have rejected the file using the `-R' or equivalent option.
