Re: New to nutch, seem to be problems

2007-08-30 Thread misc
tuck for a long time. Don't these time out? thanks - Original Message - From: "misc" <[EMAIL PROTECTED]> To: Sent: Wednesday, August 29, 2007 5:31 PM Subject: Re: New to nutch, seem to be problems Hello- I will reply to my

Re: New to nutch, seem to be problems

2007-08-30 Thread misc
ent: Wednesday, August 29, 2007 9:34 PM Subject: Re: New to nutch, seem to be problems Hi, You might want to use the broken down method for whole web search. (see wiki for nutch tutorial or crawl method explaind) it's broken down to serveral seperate commands. another thing.. as for DNS.

Re: New to nutch, seem to be problems

2007-08-29 Thread eyal edri
Hi, You might want to use the broken down method for whole web search. (see wiki for nutch tutorial or crawl method explaind) it's broken down to serveral seperate commands. another thing.. as for DNS. in /etc/nscd.conf change the enable-cache hostsr yesto no. that way the nscd d

Re: New to nutch, seem to be problems

2007-08-29 Thread misc
Hello- I will reply to my own post with new findings and observations. About the slowness of generate, I just don't believe that it should take many hours to generate (any sized) list on a database that is a couple million large. I could do the equivalant on plain text lists using grep,