Maurice Volaski wrote: > wget's -m option seems to be able to ignore most of the files it should > download from a site. Is this simply because wget can download only the > files it can see? That is, if the web server's directory indexing option > is off and a page on the site is present on the server, but it isn't > referenced by any publicly viewable page, wget simply can't see it.
I've been thinking about coding a --extra-sensory-perception option that would cause wget to read the mind of the server so that it can download files that it cannot see. As soon as I get the algorithm worked out, I'll be submitting the patch. So far I've figured out how to download index.html without being able to see it, but I'm sure that if I keep working at it that wget will be able to detect the rest of the files it cannot see. Of course, I could just be taking the wrong approach; it may work better if I try to implement the --psychic option instead. Tony