On Nov 9, 2007, at 12:30 , Hendrik wrote:
> It could just be the fast sequence of requests for the BibTeX
> entries that triggers it. In which case it might make sense to
> change the scraper to only request the pages with the BibTeX upon
> request. That is, when the user clicks on items in the second pane.
FWIW, it is certainly true that the frequency of requests can trigger
robot alerts. I've gotten caught by that a couple of times: once
when I kept beating on a link because it didn't appear to be working
(a bunch of bad configuration options on my end kept me from seeing
that the down-load worked); and several times using a 'wget' script
(which can certainly be confused with robotics :-}).
Justin
--
Justin C. Walker, Curmudgeon-At-Large
Director
Institute for the Enhancement of the Director's Income
--------
"Weaseling out of things is what separates us from the animals.
Well, except the weasel."
- Homer J Simpson
--------
-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
_______________________________________________
Bibdesk-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/bibdesk-users
