The job should terminate in it's own, but not as soon as all pages are
found - only after -depth iterations.
Are you saying It won't honor the -depth parameter?
--
Sami Siren
Sandy Polanski wrote:
Sami, in 0.7.2 my intranet crawling job did terminate on its own. The issue
that I described only started since I began to use 0.8. Maybe you understand
the changes in the code/methods better than I do between the versions so that
you could point me in the right direction (for opening an issue or writing a
patch).
sami siren <[EMAIL PROTECTED]> wrote: There's no such feature present in Nutch
currently. Feel free to open issue
(of type new feature) in Nutch Jira and provide a patch or wait until
someone else gets to it.
--
Sami Siren
2006/8/27, Sandy Polanski :
On my intranet, I have 8100 documents. The nutch crawler finds all of
them fine, but the process does not end. It just keeps on creating empty
segments timestamp directories. What conf setting will make it stop on its
own when there are no more links in the fetch list?
Thanks,
Sandy
---------------------------------
Talk is cheap. Use Yahoo! Messenger to make PC-to-Phone calls. Great rates
starting at 1ยข/min.
