I'm having trouble when recursively downloading sites with dynamic calendar
pages.  It can take *forever* to get through several levels before hitting
the recursion level limit.  I can reject pages with a .pl or .asp extension, 
but they're apparently still downloaded and scanned for links before being 
removed.  Is there a solution to this?  I'm using v. 1.8.1.


Stan Reeves
Electrical and Computer Engineering Dept.
Auburn University
Auburn, AL  36849
[EMAIL PROTECTED]
http://www.eng.auburn.edu/~sjreeves

Reply via email to