I just tried this and it looks is working: nutch index test/indexes1 test/crawldb linkdb test/segments/20060522181136 nutch index test/indexes2 test/crawldb linkdb test/segments/20060522181136 nutch merge test/index test/indexes1 test/indexes2
querying also works, I have setup searcher.dir in nutch-site.xml as "test" and used the following line to query : /opt/nutch-0.8-dev/bin/nutch org.apache.nutch.searcher.NutchBean computer I am just experimenting, so I do not know if is the right way to do things -Corrado Stefan Neufeind wrote:
I haven't yet tried - but could you maybe: - move the new segments somewhere independent of the existing ones - create a separate linkdb for it (to my understanding the linkdb is only needed when indexing) - create a separate index on that - then move segment into segments-dir and new index into indexes-dir as "part-XXXX" - just merge indexes (should work relatively fast) In the long term your segments, indexes etc. add up - so in this case you'd need to maybe think about merging segments etc. Also, this is "only" my current understanding of the topic. It would be nice to get feedback and maybe easier solutions from others as well. Regards, Stefan
