patrick robinson <[EMAIL PROTECTED]> writes: >> That message has nothing to do with robots.txt, it means that you >> have rejected the file using the `-R' or equivalent option. > > Here you go again with this IMHO stupid implemented option.
Why thank you. > I'm using it too but on some suffixes it acts after downloading by > deleting the already downloaded file and on other suffixes it works > in advance. It works /a posteriori/ on HTML documents because they need to be downloaded to be examined for links. Otherwise something like `wget -r -A jpg URL' would not download anything because the index item is not an image. > But I'm only using version 1.8.2 maybe it has been changed in more > recent versions by now. Many things have improved since 1.8.2. I recommend upgrade.
