Hi Ferdy. That patch is fantastic. I applied the change yesterday morning and everything is parsing smoothly. Thanks for your help.
On Wed, May 30, 2012 at 5:30 AM, Ferdy Galema <[email protected]>wrote: > I already stumbled upon this some time ago. I just created the following > issue with a work-around for it. (Already committed it so you can update > your workspace as an alternative to applying the patch). > > https://issues.apache.org/jira/browse/NUTCH-1379 > > > On Tue, May 29, 2012 at 3:57 PM, Lewis John Mcgibbney < > [email protected]> wrote: > > > Hi George, > > > > How were you executing parsing on this page? > > > > the toArgMap method in Tool Util can throw a runtime exception, > > however this doesn't look like the one your getting. > > > > What other kind of logging do you have around here? Specifically > > related to when the parse method kicks in? This might give us a bit > > more idea where exactly this is happening. > > > > Thanks > > > > Lewis > > > > On Fri, May 25, 2012 at 9:00 PM, George Smith <[email protected]> > > wrote: > > > I've been using the nutchgora branch for a few months so I'm very new > to > > it > > > and I've been able to find information on the user or dev list, jira, > or > > > regular web searches for most of the issues I've encountered except > one. > > > > > > > > > > > > This error occurs frequently when parsing but not always and there > > doesn't > > > seem to be a common element among the pages it is erroring out on. > > > > > > > > > > > > I have tried a number of revisions of the nutchgora branch that built > > with > > > ant/ivy fine and also with eclipse. I also tried the prebuilt copies > from > > > Jenkins. I've run them on Debian 6.0.5, ubuntu 10, and ubuntu 12 with > the > > > openjdk and the sun jdk and always receive the same error. > > > > > > > > > > > > Can someone shed some light on this or point me in the right direction. > > > Thanks. > > > > > > > > > > > > > > > > > > The error output to stdout is: > > > > > > Parsing http://www.site.com/dir/page.html > > > > > > Exception in thread "main" java.lang.RuntimeException: job failed: > > > name=parse, jobid=job_local_0001 > > > > > > at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:47) > > > > > > at org.apache.nutch.parse.ParserJob.run(ParserJob.java:242) > > > > > > at org.apache.nutch.parse.ParserJob.parse(ParserJob.java:257) > > > > > > at org.apache.nutch.parse.ParserJob.run(ParserJob.java:300) > > > > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > > > > > > at org.apache.nutch.parse.ParserJob.main(ParserJob.java:304) > > > > > > > > > > > > The error output in the hadoop.log is: > > > > > > 2012-05-25 13:50:29,635 INFO parse.ParserJob - Parsing > > > http://www.site.com/dir/page.html > > > > > > 2012-05-25 13:50:29,638 WARN mapred.FileOutputCommitter - Output path > is > > > null in cleanup > > > > > > 2012-05-25 13:50:29,639 WARN mapred.LocalJobRunner - job_local_0001 > > > > > > java.lang.NullPointerException > > > > > > at org.apache.avro.util.Utf8.<init>(Utf8.java:37) > > > > > > at org.apache.nutch.parse.ParseUtil.process(ParseUtil.java:212) > > > > > > at > org.apache.nutch.parse.ParserJob$ParserMapper.map(ParserJob.java:123) > > > > > > at org.apache.nutch.parse.ParserJob$ParserMapper.map(ParserJob.java:76) > > > > > > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) > > > > > > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) > > > > > > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) > > > > > > at > > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212) > > > > > > > > -- > > Lewis > > >
