Andy Liu wrote:
This is built into Nutch. Instead of injecting http:// url's, use
file:// , and Nutch will use protocol-file to fetch the files locally.
Andy
Also, there is a tool I created to skip importing these URLs into
database first... Take a look at
http://issues.apache.org/jira/browse/NUTCH-68
So, you can do the following:
cd target
find . -exec printf "file:/`pwd`/{}\n" \; > url.lst
and convert this url.lst to a new segment containing a fetchlist.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
-------------------------------------------------------
SF.Net email is Sponsored by the Better Software Conference & EXPO
September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices
Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA
Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
