On Mon, Jun 10, 2013 at 6:11 PM, Stephan Beal <[email protected]> wrote:
> Hi, all, > > i have one repo where i "would like to" enable downloading of the zip > without logging in, but i am concerned about bot traffic. Is there any > evidence (in your collective experience) regarding how problematic bots are > (or are not) when it comes to crawling through the history, in particular > the zip/tar links? > > Both Fossil and SQLite allow user "nobody" to download ZIP archives and tarballs. Bots have not been a problem there, due to the spider defenses. See http://www.fossil-scm.org/fossil/doc/trunk/www/antibot.wiki for a detailed description of the spider defenses. In the past, there have been problems from bots walking the timeline and downloading millions of diffs and annotations. But we haven't had any problems since the latest anti-spider enhancements to Fossil. I suspect that at some point the arms race will need to continue. But for now, the fortifications seem to be holding. -- D. Richard Hipp [email protected]
_______________________________________________ fossil-users mailing list [email protected] http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users
