[Nutch Wiki] Update of "RunningNutchAndSolr" by uygar bayar
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The following page has been changed by uygar bayar: http://wiki.apache.org/nutch/RunningNutchAndSolr -- at org.apache.nutch.indexer.SolrIndexer.run(SolrIndexer.java:112) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:94) + -- + It works like a charm thanks for your help. + (I repeated a mistake in nutch-trunk/src/java/org/apache/nutch/indexer/Indexer.java file + It is explained here http://variogram.com/latest/?p=26 + +++ src/java/org/apache/nutch/indexer/Indexer.java (working copy) + - private static class LuceneDocumentWrapper implements Writable { + + public static class LuceneDocumentWrapper implements Writable { ). +
[Nutch Wiki] Update of "RunningNutchAndSolr" by uygar bayar
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The following page has been changed by uygar bayar: http://wiki.apache.org/nutch/RunningNutchAndSolr -- at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:93) --- + Sorry but nothing change!! Same as below.. + ERROR I changed lines and it worked.But this time gave this error. I tried both private and protected scopes but nothing changed. I also changed this line Document doc = (Document) ((ObjectWritable) value).get(); with this Document doc = (Document) ((NutchWritable) value).get(); this time gave build error..
[Nutch Wiki] Update of "RunningNutchAndSolr" by uygar bayar
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The following page has been changed by uygar bayar: http://wiki.apache.org/nutch/RunningNutchAndSolr -- '''Troubleshooting:''' * If you get errors about "Type mismatch in value from map:" (expected ObjectWritable, but received NutchWritable), then you likely are missing the two steps I just added in step 9 above. Sorry about that, I forgot about making the change there in SolrIndexer. --- + ERROR I did everything but i got this error any idea?? 2008-04-03 15:42:28,009 WARN mapred.LocalJobRunner - job_local_1 @@ -46, +47 @@ at org.apache.nutch.indexer.SolrIndexer.run(SolrIndexer.java:111) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:93) + --- + ERROR + I changed lines and it worked.But this time gave this error. I tried both private and protected scopes but nothing changed. + I also changed this line Document doc = (Document) ((ObjectWritable) value).get(); with this Document doc = (Document) ((NutchWritable) value).get(); this time gave build error.. + 2008-04-04 10:41:48,490 WARN mapred.LocalJobRunner - job_local_1 + + java.lang.ClassCastException: org.apache.nutch.indexer.Indexer$LuceneDocumentWrapper + at org.apache.nutch.indexer.SolrIndexer$OutputFormat$1.write(SolrIndexer.java:135) + at org.apache.hadoop.mapred.ReduceTask$2.collect(ReduceTask.java:315) + at org.apache.nutch.indexer.Indexer.reduce(Indexer.java:275) + at org.apache.nutch.indexer.Indexer.reduce(Indexer.java:52) + at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333) + at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:164) + 2008-04-04 10:41:49,085 FATAL indexer.Indexer - SolrIndexer: java.io.IOException: Job failed! + at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894) + at org.apache.nutch.indexer.SolrIndexer.index(SolrIndexer.java:87) + at org.apache.nutch.indexer.SolrIndexer.run(SolrIndexer.java:112) + at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) + at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:94) +
[Nutch Wiki] Update of "RunningNutchAndSolr" by uygar bayar
Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification. The following page has been changed by uygar bayar: http://wiki.apache.org/nutch/RunningNutchAndSolr -- If you watch the output from your Solr instance (logs) you should see a bunch of messages scroll by when Nutch finishes crawling and posts new documents. If not, then you've got something not configured right. I'll try to add more notes here as people have questions/issues. + --- + I did everything but i got this error any idea?? + + 2008-04-03 15:42:28,009 WARN mapred.LocalJobRunner - job_local_1 + java.io.IOException: Type mismatch in value from map: expected org.apache.hadoop.io.ObjectWritable, recieved org.apache.nutch.crawl.NutchWritable + at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:369) + at org.apache.nutch.indexer.Indexer.map(Indexer.java:344) + at org.apache.nutch.indexer.Indexer.map(Indexer.java:52) + at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) + at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208) + at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:132) + 2008-04-03 15:42:28,609 FATAL indexer.Indexer - SolrIndexer: java.io.IOException: Job failed! + at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894) + at org.apache.nutch.indexer.SolrIndexer.index(SolrIndexer.java:86) + at org.apache.nutch.indexer.SolrIndexer.run(SolrIndexer.java:111) + at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) + at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:93) +