Hi there,
I'm new to htdig so please forgive me if this a novice question, but I
couldn't find an answer in the htdig documentation or the list archives.
Our replacement web server is a Sun Ultra 5 with 128Mb RAM and 1Gb of
swap. We have a 4Gb NFS mounted web document partition with about 3Gb of
data in it. We are running htdig 3.1.2 and our database_dir is a
dedicated 4Gb partition. The only change we made to htdig.conf was to
change start_url to http://www.rdg.acuk/
However rundig takes 10-12 hours to run, but doesn't complete because
db.docdb db.wordlist completely fill the 4Gb partition so rundig can't do
the merge (I'm not using the -a option)
The server is running Apache 1.3.6 but as it is currently under test only
a handful of users are using it so it is very lightly loaded, even with
rundig running:
#uptime
10:52am up 6 day(s), 45 min(s), 2 users, load average: 1.00, 0.95, 0.89
Now I'm trying again with max_head_length and max_meta_description set to
0 and max_doc_size to 10000 to reduce the disk space used and hopefully
make the digging quicker. However it is still taking ages, and taking a
great deal of deal space - I suspect database_dir will hit 100% yet
again.
Any thoughts on my problems please and what I can do?
Rgds.,
Nick.
========================================================================
"Animal? No, worse - human!", Manny - "Runaway Train"
Nick O'Brien Phone: +44 118 931 8432
Computer Officer Email: [EMAIL PROTECTED]
Reading University, UK Web: http://www.rdg.ac.uk/~suq98ngo/
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word unsubscribe in
the SUBJECT of the message.
