I recently implemented htdig 3.2.b4. I had been using htdig 3.2.b3 to dig a remote site, but then that site changed all their urls.... But what's occurring now, never happened before.
So here's what's happening. About every third time I crawl their site and build the db, htpurge tells me the database is empty. Last night, htdig reported 7173 connections opened and closed, 7173 http requests, and over 80 Megabytes served. And then moments later, htpurge told me the database was empty. I don't think it's a start url or exclude pattern problem, because as I've said, the htdig often succeeds. I don't think it's a size issue, my server has 1G RAM and most of it is unused and 80G disks, and anecdotally, I understand there are htdig users with far far greater databases. What steps can I take to track down the problem? Thank you, Jerry Asher ------------------------------------------------------- This SF.net email is sponsored by: VM Ware With VMware you can run multiple operating systems on a single machine. WITHOUT REBOOTING! Mix Linux / Windows / Novell virtual machines at the same time. Free trial click here: http://www.vmware.com/wl/offer/345/0 _______________________________________________ ht://Dig general mailing list: <[EMAIL PROTECTED]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
