Hi !
I recently had trouble running htdig with cron but thanks to the "rundig.sh"
script you provided everything is
now fine but I noticed that every morning when I arrive at the office the search
engine had crashed.
But looking through Apache's access log I noticed the following 2 lines :
my_server - - [12/Sep/2000:04:02:00 +0200] "GET /robots.txt HTTP/1.0" 404 278
my_server - - [12/Sep/2000:04:02:00 +0200] "GET
/r2_admin/robot_init_page/?ht_dig_robot=1 HTTP/1.0" 401
471
I did not do a "robots.txt" file as my server is the only one to index the site.
It looks as if there is some kind of automatic indexing (of course 4:02 is
nowhere to be found in my crontab)
but I did not find anything in the documentation about it and the problem is
that after it my db.wordlist file is
empty...
What can I do to stop this ?
Thanks a lot !
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
List archives: <http://www.htdig.org/mail/menu.html>
FAQ: <http://www.htdig.org/FAQ.html>
