Hello,
I'm trying to download a robots.txt protexted directory and I'm having the following problem: - wget downloads the files but delete them after they are downloaded with the following :message (translated from french): Destroyed <file> because it must be rejected How can I prevent this ? Thanks PS: I'm using wget 1.8.1-6