i made a start on a crawler module yesterday to make it easier to download all releases from an URL. it's still at the very early stage yet (developers only), and isn't integrated with the rest of RAT. it raises some structural issues (it requires Java 5 and integrating into the command line would raise some questions about module dependencies).
i'm thinking of just putting it into trunk so that anyone else who has similar problems can just patch it rather than starting from scratch. - robert
