Benjamin Higgins wrote:
How can I instruct Nutch to refetch specific files and then update the
index
entries for those files?
I am indexing files on a fileserver and I am able to produce a report of
changed files about every 30 minutes.
I'd like to feed that into Nutch at approximately the same interval so
I can
keep the index up-to-date.
Thanks.
Conceptually this should be easy - you just need to generate a fetchlist
directly from your list of changed files, and not through
injecting/generating from a crawldb.
I wrote a tool for 0.7 which does this - look at the NUTCH-68 issue in
JIRA. This would have to be ported to 0.8 - check how Injector does this
in the first stage, when it converts a simple text file to a MapFile.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
