I am running the system locally through Nutch. Nutch also run on top of hadoop. All I am trying to access the file through the following method:
MapFileOutputFormat.getEntry(readers, new HashPartitioner(), key, val); Nutch runs successfully and loads the Hadoop configuration files and anything needed. Can you let me know how to set reduce to a different value than 0. Thanks, Armel ------------------------------------------------- Armel T. Nene iDNA Solutions Tel: +44 (207) 257 6124 Mobile: +44 (788) 695 0483 http://blog.idna-solutions.com -----Original Message----- From: Owen O'Malley [mailto:[EMAIL PROTECTED] Sent: 23 January 2007 19:01 To: [email protected] Subject: Re: Exception java.lang.ArithmeticException On Jan 23, 2007, at 10:54 AM, Armel T. Nene wrote: > I'm new to the mailing list therefore I apologize if this posting > is not > meant to be in here. Your post is good. > My problem is when I run my program I get the following errors: > > > > 07/01/23 18:33:56 INFO conf.Configuration: parsing > jar:file:/C:/nutch-0.8.2-dev/lib/hadoop-0.4.0-patched.jar!/hadoop- > default.xm > l > > 07/01/23 18:33:56 INFO conf.Configuration: parsing > jar:file:/C:/nutch-0.8.2-dev/nutch-0.8.2-dev.jar!/nutch-default.xml > > 07/01/23 18:33:56 INFO conf.Configuration: parsing > jar:file:/C:/nutch-0.8.2-dev/nutch-0.8.2-dev.jar!/nutch-site.xml > > Exception in thread "main" java.lang.ArithmeticException: / by zero > > at > org.apache.hadoop.mapred.lib.HashPartitioner.getPartition > (HashPartitioner.ja > va:33) > > at > org.apache.hadoop.mapred.MapFileOutputFormat.getEntry > (MapFileOutputFormat.ja > va:88) > > at org.apache.nutch.crawl.CrawlDbReader.get > (CrawlDbReader.java:321) > > at > com.idna.indexer.resource.SystemMonitor.main(SystemMonitor.java:188) It looks like you are running distributed and have the number of reduces set to 0. You should probably set it to 2*numOfNodes. -- Owen
