> I think that machine's got 128MB of RAM and 256 of SWAP. The URL list
> physical size is 147K or so and it contain's 10028 URL's all
> terminated with a /.
>
> You think that's why?

Well, the guaranteed way to know is to see if you're hitting swap as you 
start to index. I wouldn't be surprised if you do. Take a look at the 
memory usage from htdig and see how it goes up.

Of course you also said "it doesn't work" but didn't give many details. 
It's also possible that there's something confusing the configuration 
parser halfway through your combined list. What exactly do you mean by 
"it doesn't work?"

But I'd probably look at memory considerations first. Remember that 
htdig has been designed for adding URLs to the queue as it goes. So 
you're really forcing a large number of URLs right from the getgo. It's 
not quite as happy.

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/



-------------------------------------------------------
This sf.net email is sponsored by: Jabber - The world's fastest growing 
real-time communications platform! Don't just IM. Build it in! 
http://www.jabber.com/osdn/xim
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a 
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html

Reply via email to