Re: indexing folders with nutch

2006-09-01 Thread Lourival JĂșnior
Yes Cam, if you use a depth 1 you will crawl only the first document. With a depth 2 you will crawl the first document and all the links found on this document. With depth 3, you will crawl the first one, its links and all links found in cycle 2. And so on. Increasing you depth will increasing

indexing folders with nutch

2006-08-31 Thread Cam Bazz
Hello, I have a problem. I tried to index some localfiles with nutch. What I have done is put them in a local apache server, (html files) and create a urls file that contains http://localhost/file01.html etc. then I do a nutch crawl urls . -dir crawl -depth 1 but the crawl stales after a

Re: indexing folders with nutch

2006-08-31 Thread Sandy Polanski
Cam, try increasing the depth and see what happens. It seems that logic would say that they're on the same directory depth/level; however, just give it a try because I ran into a similar problem, and if I'm not mistaken, that fixed it. --- Cam Bazz [EMAIL PROTECTED] wrote: Hello, I have a