Dennis, you shouldn't hyjack my thread ;) Anyway. it's all about crawl, update your DB's and recrawl and keep repeating the same loop over and over.
Cheers, On Tuesday 28 September 2010 10:08:00 Dennis wrote: > Hi, all, > I want to crawl the whole www, how do I config "crawl-urlfilter.txt"?It > used to be:# accept hosts in > MY.DOMAIN.NAME+^http://([a-z0-9]*\.)*MY.DOMAIN.NAME/ ThanksDennis > Markus Jelsma - Technisch Architect - Buyways BV http://www.linkedin.com/in/markus17 050-8536620 / 06-50258350

