[Nutch Wiki] Update of "RunningNutchAndSolr" by uygar bayar

2008-04-10 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change 
notification.

The following page has been changed by uygar bayar:
http://wiki.apache.org/nutch/RunningNutchAndSolr

--
  at org.apache.nutch.indexer.SolrIndexer.run(SolrIndexer.java:112)
  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
  at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:94)
+ --
  
+ It works like a charm thanks for your help.
+ (I repeated a mistake in 
nutch-trunk/src/java/org/apache/nutch/indexer/Indexer.java file 
+ It is explained here http://variogram.com/latest/?p=26
+ +++ src/java/org/apache/nutch/indexer/Indexer.java  (working copy)
+ -  private static class LuceneDocumentWrapper implements Writable {
+ +  public static class LuceneDocumentWrapper implements Writable { ).
+ 


[Nutch Wiki] Update of "RunningNutchAndSolr" by uygar bayar

2008-04-07 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change 
notification.

The following page has been changed by uygar bayar:
http://wiki.apache.org/nutch/RunningNutchAndSolr

--
  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
  at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:93)
  ---
+ Sorry but nothing change!! Same as below..
+ 
  ERROR
  I changed lines and it worked.But this time gave this error. I tried both 
private and protected scopes but nothing changed.
  I also changed this line  Document doc = (Document) ((ObjectWritable) 
value).get(); with this  Document doc = (Document) ((NutchWritable) 
value).get(); this time gave build error..


[Nutch Wiki] Update of "RunningNutchAndSolr" by uygar bayar

2008-04-04 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change 
notification.

The following page has been changed by uygar bayar:
http://wiki.apache.org/nutch/RunningNutchAndSolr

--
  '''Troubleshooting:'''
   * If you get errors about "Type mismatch in value from map:" (expected 
ObjectWritable, but received NutchWritable), then you likely are missing the 
two steps I just added in step 9 above.  Sorry about that, I forgot about 
making the change there in SolrIndexer.
  ---
+ ERROR
  I did everything but i got this error any idea??
  
  2008-04-03 15:42:28,009 WARN  mapred.LocalJobRunner - job_local_1
@@ -46, +47 @@

  at org.apache.nutch.indexer.SolrIndexer.run(SolrIndexer.java:111)
  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
  at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:93)
+ ---
+ ERROR
+ I changed lines and it worked.But this time gave this error. I tried both 
private and protected scopes but nothing changed.
+ I also changed this line  Document doc = (Document) ((ObjectWritable) 
value).get(); with this  Document doc = (Document) ((NutchWritable) 
value).get(); this time gave build error..
  
+ 2008-04-04 10:41:48,490 WARN  mapred.LocalJobRunner - job_local_1
+ 
+ java.lang.ClassCastException: 
org.apache.nutch.indexer.Indexer$LuceneDocumentWrapper
+ at 
org.apache.nutch.indexer.SolrIndexer$OutputFormat$1.write(SolrIndexer.java:135)
+ at org.apache.hadoop.mapred.ReduceTask$2.collect(ReduceTask.java:315)
+ at org.apache.nutch.indexer.Indexer.reduce(Indexer.java:275)
+ at org.apache.nutch.indexer.Indexer.reduce(Indexer.java:52)
+ at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
+ at 
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:164)
+ 2008-04-04 10:41:49,085 FATAL indexer.Indexer - SolrIndexer: 
java.io.IOException: Job failed!
+ at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
+ at org.apache.nutch.indexer.SolrIndexer.index(SolrIndexer.java:87)
+ at org.apache.nutch.indexer.SolrIndexer.run(SolrIndexer.java:112)
+ at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
+ at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:94)
+ 


[Nutch Wiki] Update of "RunningNutchAndSolr" by uygar bayar

2008-04-03 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change 
notification.

The following page has been changed by uygar bayar:
http://wiki.apache.org/nutch/RunningNutchAndSolr

--
  
  If you watch the output from your Solr instance (logs) you should see a bunch 
of messages scroll by when Nutch finishes crawling and posts new documents.  If 
not, then you've got something not configured right.  I'll try to add more 
notes here as people have questions/issues.
  
+ ---
+ I did everything but i got this error any idea??
+ 
+ 2008-04-03 15:42:28,009 WARN  mapred.LocalJobRunner - job_local_1
+ java.io.IOException: Type mismatch in value from map: expected 
org.apache.hadoop.io.ObjectWritable, recieved 
org.apache.nutch.crawl.NutchWritable
+ at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:369)
+ at org.apache.nutch.indexer.Indexer.map(Indexer.java:344)
+ at org.apache.nutch.indexer.Indexer.map(Indexer.java:52)
+ at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
+ at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
+ at 
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:132)
+ 2008-04-03 15:42:28,609 FATAL indexer.Indexer - SolrIndexer: 
java.io.IOException: Job failed!
+ at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
+ at org.apache.nutch.indexer.SolrIndexer.index(SolrIndexer.java:86)
+ at org.apache.nutch.indexer.SolrIndexer.run(SolrIndexer.java:111)
+ at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
+ at org.apache.nutch.indexer.SolrIndexer.main(SolrIndexer.java:93)
+