Hey
I am running the jobs by recreating the local environment on Hadoop.
While running the jobs the following errors are coming:
----DEFINE
GeneratorJob: java.lang.RuntimeException: job failed:
name=[rss_new]generate: 1484716707-832889027, jobid=job_local1136172300_0001
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:121)
at org.apache.nutch.crawl.GeneratorJob.run(GeneratorJob.java:233)
at org.apache.nutch.crawl.GeneratorJob.generate(GeneratorJob.java:262)
at org.apache.nutch.crawl.GeneratorJob.run(GeneratorJob.java:328)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.nutch.crawl.GeneratorJob.main(GeneratorJob.java:336)
----DEFINE
Exception in thread "main" java.lang.RuntimeException: job failed:
name=[rss_new]fetch, jobid=job_local1345153020_0001
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:121)
at org.apache.nutch.fetcher.FetcherJob.run(FetcherJob.java:214)
at org.apache.nutch.fetcher.FetcherJob.fetch(FetcherJob.java:258)
at org.apache.nutch.fetcher.FetcherJob.run(FetcherJob.java:318)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.nutch.fetcher.FetcherJob.main(FetcherJob.java:327)
----DEFINE
Exception in thread "main" java.lang.RuntimeException: job failed:
name=[rss_new]parse, jobid=job_local81187868_0001
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:121)
at org.apache.nutch.parse.ParserJob.run(ParserJob.java:274)
at org.apache.nutch.parse.ParserJob.parse(ParserJob.java:300)
at org.apache.nutch.parse.ParserJob.run(ParserJob.java:351)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.nutch.parse.ParserJob.main(ParserJob.java:355)
----DEFINE
Exception in thread "main" java.lang.RuntimeException: job failed:
update-table, jobid=job_local114771105_0001
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:121)
at org.apache.nutch.crawl.DbUpdaterJob.run(DbUpdaterJob.java:112)
at org.apache.nutch.crawl.DbUpdaterJob.updateTable(DbUpdaterJob.java:141)
at org.apache.nutch.crawl.DbUpdaterJob.run(DbUpdaterJob.java:175)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.nutch.crawl.DbUpdaterJob.main(DbUpdaterJob.java:179)
What changes need to be made to resolve these errors? Please revert soon.
--
Thanks and Regards,
Shubham Gupta