Hello, again, I have a repository with timeline links disabled unless people log in. And googlebot traverses it. I checked the TCP stream of the connections, and it identifies as googlebot.
Here is the apache access log: access_log:66.249.72.137 - - [08/Dec/2011:14:48:25 +0100] "GET /robots.txt HTTP/1.1" 200 2 access_log:66.249.72.137 - - [08/Dec/2011:14:48:26 +0100] "GET /cgi-bin/btar HTTP/1.1" 302 101 access_log:66.249.72.137 - - [08/Dec/2011:14:48:26 +0100] "GET /cgi-bin/btar/doc/trunk/doc/home.wiki HTTP/1.1" 200 3657 access_log:66.249.72.137 - - [08/Dec/2011:15:29:06 +0100] "GET /cgi-bin/btar/doc/trunk/doc/home.wiki HTTP/1.1" 200 3657 access_log:66.249.72.137 - - [08/Dec/2011:15:30:32 +0100] "GET /cgi-bin/btar/info/b9adcd2c23a5a42e92afc1d532d9a4204c7f8085 HTTP/1.1" 200 2272 access_log:66.249.72.137 - - [08/Dec/2011:15:37:03 +0100] "GET /cgi-bin/btar/info/843c068a8883dc4aca75a932b37cb6e7507c7621 HTTP/1.1" 200 2369 access_log:66.249.72.137 - - [08/Dec/2011:16:01:42 +0100] "GET /cgi-bin/btar/info/699a4b42fb6f0f2ba74dec97f65c016716058d92 HTTP/1.1" 200 1275 access_log:66.249.72.137 - - [08/Dec/2011:16:03:11 +0100] "GET /cgi-bin/btar/info/97001f4066ff2ab3e00f3793c54d25c8f00240c6 HTTP/1.1" 200 2260 .... How can it be that it finds the links? That URL is valid since one hour or two ago; before, it never existed. That annoys me quite a lot, because then it goes to 'annotate' for huge repositories, and the machine gets a big cpu usage. The server is fossil 1.20 at http://viric.name/cgi-bin/btar Thank you, Lluís. _______________________________________________ fossil-users mailing list [email protected] http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users
