According to Mike Marseglia: > I had a 512MB swap and a GB of RAM, but htmerge used the /tmp directory > which was only 250MB. htmerge would constantly core dump. I hacked the > source for words.cc to use a different temp directory and htmerge worked > fine. > > Mike > > On Wed, 3 Oct 2001, Gilles Detillieux wrote: > > > According to Nico De Ranter: > > > we have htdig running on a VA Linux box running Debian Linux. > > > The system has 512MB RAM and 512MB swap. A few hours after starting > > > an update of the htdig database the system runs out of memory > > > and crashes. Is there any way to restrict the amount of memory > > > the update can use? > > > > > > Running htdig 3.1.5, on Intel32 with kernel 2.4.6 > > > > Does the whole operating system crash, or is it just htdig that dies? > > If it's the whole system, I'd suspect a kernel bug or a hardware > > problem, either with RAM or memory management. > > > > If it's just htdig, then you probably need to work out a way of > > limiting how much it tries to index all at once. E.g. you can index a > > few subsections of your site separately, and then merge them together > > afterward.
Hi, Mike. I think you and Nico ran into two different problems. Nico reported afterward that the kernel started killing processes and logging "Out of Memory" errors. That wouldn't happen just because the /tmp volume fills up. Also, my understanding was that the problem Nico had occurred while running htdig, not htmerge. For the problem of htmerge running out of space on /tmp, you shouldn't need to hack the source. You can set TMPDIR to get htmerge to tell sort to use a different directory for temp. files. This works on most systems, but not on a lot of BSD systems where the sort command has a different -T option than on other systems. On BSD systems, the source hack may be needed. -- Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]> Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/~grdetil Dept. Physiology, U. of Manitoba Phone: (204)789-3766 Winnipeg, MB R3E 3J7 (Canada) Fax: (204)789-3930 _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
