Instead of using the crawl script create your own script. 

Just run the bin/nutch command individually yourself in the script.

http://wiki.apache.org/nutch/NutchTutorial#A3.2_Using_Individual_Commands_for_Whole-Web_Crawling



You can do the follow for the each iteration

generate segment
fetch segment
parse segment 
update crawldb with segment 
solrindex the crawldb and segment 





--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-crawl-and-index-parallel-way-from-Nutch-into-Solr-tp4125990p4126106.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Reply via email to