Hi,

Problem solved, however I don't know exactly how to reproduce/solve this. If 
you meet the exception, try to clean the folder like: E:\tmp\hadoop-ibmsz\mapred






At 2012-12-29 12:32:17,"高睿" <[email protected]> wrote:

Hi,

I'm using Nutch 2.1 (Inside Eclipse) + Solr 4.0.0 with schema-solr4.xml. The 
run configuration in eclipse is:
org.apache.nutch.crawl.Crawler
urls -solr http://localhost:8080/solr/#/collection2 -threads 1 -depth 1 -topN 3
-Dhadoop.log.dir=logs -Dhadoop.log.file=hadoop.log

Rarely, it works fine, but most time there's an exception in console:
Adding 1 documents
Exception in thread "main" java.lang.RuntimeException: job failed: 
name=solr-index, jobid=job_local_0006
    at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:54)
    at org.apache.nutch.indexer.solr.SolrIndexerJob.run(SolrIndexerJob.java:46)
    at org.apache.nutch.crawl.Crawler.runTool(Crawler.java:68)
    at org.apache.nutch.crawl.Crawler.run(Crawler.java:192)
    at org.apache.nutch.crawl.Crawler.run(Crawler.java:250)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.nutch.crawl.Crawler.main(Crawler.java:257)

In hadoop.log:
2012-12-29 12:22:53,109 INFO  solr.SolrWriter - Adding 1 documents
2012-12-29 12:22:53,187 WARN  mapred.FileOutputCommitter - Output path is null 
in cleanup
2012-12-29 12:22:53,187 WARN  mapred.LocalJobRunner - job_local_0006
java.lang.RuntimeException: Invalid version (expected 2, but 60) or the data in 
not in 'javabin' format
    at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:99)
    at 
org.apache.solr.client.solrj.impl.BinaryResponseParser.processResponse(BinaryResponseParser.java:41)
    at 
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:472)
    at 
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244)
    at 
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
    at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:49)
    at org.apache.nutch.indexer.solr.SolrWriter.close(SolrWriter.java:92)
    at 
org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat.java:53)
    at 
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:651)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)

Thanks.

Regards,
Rui



Reply via email to