-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
asm c wrote:
I've recently been using wget, and got it working for the most part, but
there's one issue that's really been bugging me. One of the parameters I
use is '-R *action=*,*oldid=*' (side note on the platform: ZSH on
NetBSD on the SDF public access unix system, although I've also used it
on windows with the same result). The purpose of this parameter is so
that, when wget crawls a mid-sized wiki I'd like to have a local copy
of, it doesn't bother with all the history pages, edit pages, and so
forth. Not downloading these would save me an enormous amount of time.
Unfortunately, the parameter is ignored until after the php page is
downloaded. So, because it waits until it's downloaded to delete it,
using the param doesn't really help at all.
Does anyone know how I can stop wget from even downloading matching pages?
Well, you don't mention it, but I'll assume that those patterns occur in
the query string portion of the URL: that is, they follow a question
mark (?) that appears at some point.
Unfortunately, the -R and -A options only apply to the filename
portion of the URL: that is, whatever falls between the first question
mark, and the first preceding slash (/). Confusingly, it is also then
applied _after_ files are downloaded, to determine whether they should
be deleted after the fact: so Wget probably downloads those files you
really wish it wouldn't, and then deletes them afterwards anyway.
Worse, there's no way around this, currently. This is part of a suite of
problems that are currently slated to be addressed soon. The most
pertinent to your problem, though, is the need for a way to match
against query strings. I'm very much hoping to get around to this before
the next major Wget release, version 1.12. It's being tracked here:
https://savannah.gnu.org/bugs/index.php?22089
If you add yourself to the Cc list, you'll be able to follow along on
its progress.
- --
Cheers!
Micah J. Cowan
Programmer, musician, typesetting enthusiast, gamer.
GNU Maintainer: wget, screen, teseq
http://micah.cowan.name/
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iD8DBQFIr55d7M8hyUobTrERAu4KAJsHmDTZ46ioEGOTprdE/aTGrj853QCfet84
+c+npJnPwC/86/rLpn5rB8s=
=abdv
-END PGP SIGNATURE-
