Hey

I am running the jobs by recreating the local environment on Hadoop.

While running the jobs the following errors are coming:

----DEFINE
GeneratorJob: java.lang.RuntimeException: job failed: name=[rss_new]generate: 1484716707-832889027, jobid=job_local1136172300_0001
    at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:121)
    at org.apache.nutch.crawl.GeneratorJob.run(GeneratorJob.java:233)
    at org.apache.nutch.crawl.GeneratorJob.generate(GeneratorJob.java:262)
    at org.apache.nutch.crawl.GeneratorJob.run(GeneratorJob.java:328)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.nutch.crawl.GeneratorJob.main(GeneratorJob.java:336)

----DEFINE
Exception in thread "main" java.lang.RuntimeException: job failed: name=[rss_new]fetch, jobid=job_local1345153020_0001
    at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:121)
    at org.apache.nutch.fetcher.FetcherJob.run(FetcherJob.java:214)
    at org.apache.nutch.fetcher.FetcherJob.fetch(FetcherJob.java:258)
    at org.apache.nutch.fetcher.FetcherJob.run(FetcherJob.java:318)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.nutch.fetcher.FetcherJob.main(FetcherJob.java:327)

----DEFINE
Exception in thread "main" java.lang.RuntimeException: job failed: name=[rss_new]parse, jobid=job_local81187868_0001
    at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:121)
    at org.apache.nutch.parse.ParserJob.run(ParserJob.java:274)
    at org.apache.nutch.parse.ParserJob.parse(ParserJob.java:300)
    at org.apache.nutch.parse.ParserJob.run(ParserJob.java:351)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.nutch.parse.ParserJob.main(ParserJob.java:355)

----DEFINE
Exception in thread "main" java.lang.RuntimeException: job failed: update-table, jobid=job_local114771105_0001
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:121)
at org.apache.nutch.crawl.DbUpdaterJob.run(DbUpdaterJob.java:112)
at org.apache.nutch.crawl.DbUpdaterJob.updateTable(DbUpdaterJob.java:141)
at org.apache.nutch.crawl.DbUpdaterJob.run(DbUpdaterJob.java:175)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.nutch.crawl.DbUpdaterJob.main(DbUpdaterJob.java:179)


What changes need to be made to resolve these errors? Please revert soon.

--
Thanks and Regards,
Shubham Gupta

Reply via email to