Hello to everyone on this list,
I am trying to use wget to traverse a whole web site, but
only download the files that are called into an index. The links that
appear on any give page are as such.
If the page /foo/index.ext
The links will be:
/foo/index.ext?/foo/story1.html
/foo/index.ext?/foo/story2.html
/foo/index.ext?/bar/story1.html
/foo/index.ext?/bar/story2.html
/foo/index.ext?/bar/story3.html
/bar/index.ext
/bar/index.ext?/bar/story1.html
Now wget --input-file=url.txt -r --level=3 --accept ext,html does retrive the
files and created the directory /foo/index.ext?/ and /bar/index.ext?/.
What I really want this to do, is to *only* keep the files that are in such
a directory (index.ext? , which is always the same).
I've tried:
using: --accept '.*/index.ext\?/.*' (and a few variations of it) and I
the message:
--11:41:09-- http://www.site.com/foo/bar/index.ext?/foo/stories/somefile.html
=> `www.site.com/foo/bar/index.ext?/foo/stories/somefile.html'
Connecting to www.masslive.com[208.217.109.52]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[ <=>
] 22,413 547.19K/s
11:41:09 (547.19 KB/s) - `www.site.com/foo/bar/index.ext?/foo/stories/somefile.html'
saved [22413]
Removing www.site.com/foo/bar/index.ext?/foo/stories/somefile.html since it should be
rejected.
Any help you can give would be much appreciated, and please send me
mail directly since I am not on the list.
Thank-you in advance,
--jordan
