Hi Markus and Sethi, Thank you for your reply, I was stuck and tried the following and it works for me: bin/nutch solrindex http://127.0.0.1:8983/solr/crawl/crawldb crawl/linkdb crawl/segments/*
May I know where is the lucene index directory for the /crawl folder? I would like to use Luke-Lucene Index Toolbox to open the index. On the sidenote, I think Nutch 1.2 is way much better than Nutch 1.3. Nutch 1.2 autocreates Lucene index, does not need solr, and has more functions. Why in the first place is the lucene index removed from Nutch 1.3? ________________________________ From: "Sethi, Parampreet" <[email protected]> To: "[email protected]" <[email protected]>; Kelvin <[email protected]> Sent: Tuesday, 19 July 2011 11:51 PM Subject: Re: SolrDeleteDuplicates error Hey Kelvin, The issue is with the Solr version incompatibility in Nutch 1.3 and the Solr server that you are running. Remove the SolrjClient jar from nutch/runtime/local/lib folder and copy the Solrj client jar from your Solr installation to it. This will solve your problem. (I was facing the same error yesterday and this fix resolved it =) ) I am creating notes about how I setup Nutch with Solr and what issues I faced with solutions at my blog http://param-techie.blogspot.com/2011/07/nutch-13-and-solr-integration.html Hope it Helps! -param On 7/19/11 11:28 AM, "Markus Jelsma" <[email protected]> wrote: > The solrdedup job completes without failure, it is the solrindex job that's > actually failing. See your hadoop.log and check Solr's output. > > On Tuesday 19 July 2011 17:23:51 Kelvin wrote: >> Sorry for the multiple postings. I am trying out nutch 1.3, which requires >> solr for indexing >> >> I try to crawl and index with solr with this simple command >> bin/nutch crawl urls -solr http://localhost:8983/solr/ -depth 3 -topN 10 >> >> But why does it gives me the following error? Thank you for your kind help >> >> >> SolrIndexer: starting at 2011-07-19 23:13:31 >> java.io.IOException: Job failed! >> SolrDeleteDuplicates: starting at 2011-07-19 23:13:33 >> SolrDeleteDuplicates: Solr url: http://localhost:8983/solr/ >> SolrDeleteDuplicates: finished at 2011-07-19 23:13:34, elapsed: 00:00:01 >> crawl finished: crawl-20110719231304
