Hi!gays
I run the following command in nutch2.2.1,
bin/nutch crawl urls/ -solr http://localhost:8983/solr -depth 3 -topN 20
Exception in thread "main" java.lang.NullPointerException
at java.util.Hashtable.put(Hashtable.java:394)
at java.util.Properties.setProperty(Properties.java:143)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:438)
at org.apache.nutch.indexer.IndexerJob.createIndexJob(IndexerJob.java:129)
at org.apache.nutch.indexer.solr.SolrIndexerJob.run(SolrIndexerJob.java:44)
at org.apache.nutch.crawl.Crawler.runTool(Crawler.java:69)
at org.apache.nutch.crawl.Crawler.run(Crawler.java:194)
at org.apache.nutch.crawl.Crawler.run(Crawler.java:252)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.Crawler.main(Crawler.java:261)
the nutch-site.xml file??
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>http.agent.name</name>
<value>test-nutch</value>
</property>
<property>
<name>http.robots.agents</name>
<value>test-nutch,*</value>
</property>
<property>
<name>generate.batch.id</name>
<value>1</value>
</property>
<property>
<name>http.agent.name.check</name>
<value>true</value>
</property>
<property>
<name>distributed.search.test.port</name>
<value>60000</value>
</property>
<property>
<name>http.accept.language</name>
<value>ja-jp,en-us,en-gb,en;q=0.7,*;q=0.3</value>
</property>
<property>
<name>parser.character.encoding.default</name>
<value>utf-8</value>
</property>
<property>
<name>storage.data.store.class</name>
<value>org.apache.gora.hbase.store.HBaseStore</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hduser/dirs/hdp_tmp_dir</value>
</property>
<property>
<name>plugin.folders</name>
<value>/home/hduser/apache-nutch-2.2.1/runtime/local/plugins</value>
</property>
</configuration>
I don't know how to fix it.
The source code :
protected Job createIndexJob(Configuration conf, String jobName, String batchId)
127
throws IOException, ClassNotFoundException {
128
conf.set(GeneratorJob.BATCH_ID, batchId);
BATCH_ID
public static final String BATCH_ID = "generate.batch.id";
How to fix it.I need you help!
Thank you !