Nicolás Lichtmaier wrote:
I've written a plugin and now nutch fails with an error:
# bin/nutch generate /var/lib/tomcat/crawl/crawldb
/var/lib/tomcat/crawl/segments -topN 100
topN: 100
Generator: starting
Generator: segment: /var/lib/tomcat/crawl/segments/20061116101759
Generator: Selecting best-scoring urls due for fetch.
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:357)
at org.apache.nutch.crawl.Generator.generate(Generator.java:319)
at org.apache.nutch.crawl.Generator.main(Generator.java:395)
But I don't know how to debug this? How do I see more debug output?
Any help would be appreciated. Thanks!
Nicolas, you could find help if you were more specific. Which plugin
point did you extend and which version of nutch/hadoop are you using?
conf/log4j.properties file determines the logging factor. Maybe setting
logging level to INFO or DEBUG may help.
