[
https://issues.apache.org/jira/browse/NUTCH-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593076#comment-13593076
]
Tejas Patil commented on NUTCH-1447:
------------------------------------
As per discussion over user group [0], I agree that this is something that must
be handled by Nutch community as we dont promise compatibility across the
several hadoop distributions out there. As long as Nutch runs with Apache
Hadoop distributions, we are fine.
[0] :
http://mail-archives.apache.org/mod_mbox/nutch-user/201302.mbox/%3ccagarif1qq8pzltwbfekg58qusjiydq+zfar7em8hqjuaytg...@mail.gmail.com%3E
> Nutch 2.x with Cloudera CDH 4 get Error: Found interface
> org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
> --------------------------------------------------------------------------------------------------------------------------------
>
> Key: NUTCH-1447
> URL: https://issues.apache.org/jira/browse/NUTCH-1447
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.1
> Environment: Cloudera CDH4
> Reporter: Trần Anh Tuấn
> Fix For: 2.2
>
>
> I'm trying to crawl using Nutch 2.
> I check out source from
> http://svn.apache.org/repos/asf/nutch/branches/2.x/ and config with
> mysql.
> I get error but when run nutch 1.5 everything okie :(
> mkdir urls
> echo nutch.apache.org > urls/seed.txt
> runtime/deploy/bin/nutch inject urls
> 12/08/07 11:25:38 INFO crawl.InjectorJob: InjectorJob: starting
> 12/08/07 11:25:38 INFO crawl.InjectorJob: InjectorJob: urlDir: urls
> 12/08/07 11:25:41 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the
> same.
> 12/08/07 11:25:44 INFO input.FileInputFormat: Total input paths to process :
> 1
> 12/08/07 11:25:45 INFO util.NativeCodeLoader: Loaded the native-hadoop
> library
> 12/08/07 11:25:45 WARN snappy.LoadSnappy: Snappy native library is available
> 12/08/07 11:25:45 INFO snappy.LoadSnappy: Snappy native
> 12/08/07 11:25:47 INFO mapred.JobClient: map 0% reduce 0%
> 12/08/07 11:26:01 INFO mapred.JobClient: Task Id :
> attempt_201208071123_0001_m_000000_0, Status : FAILED
> Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext,
> but class was expected
> attempt_201208071123_0001_m_000000_0: SLF4J: Class path contains
> multiple SLF4J bindings.
> attempt_201208071123_0001_m_000000_0: SLF4J: Found binding in
> [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>
> attempt_201208071123_0001_m_000000_0: SLF4J: Found binding in
> [jar:file:/var/lib/hadoop-hdfs/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201208071123_0001/jars/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>
> attempt_201208071123_0001_m_000000_0: SLF4J: See
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 12/08/07 11:26:05 INFO mapred.JobClient: Task Id :
> attempt_201208071123_0001_m_000000_1, Status : FAILED
> Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext,
> but class was expected
> attempt_201208071123_0001_m_000000_1: SLF4J: Class path contains
> multiple SLF4J bindings.
> attempt_201208071123_0001_m_000000_1: SLF4J: Found binding in
> [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>
> attempt_201208071123_0001_m_000000_1: SLF4J: Found binding in
> [jar:file:/var/lib/hadoop-hdfs/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201208071123_0001/jars/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>
> attempt_201208071123_0001_m_000000_1: SLF4J: See
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 12/08/07 11:26:10 INFO mapred.JobClient: Task Id :
> attempt_201208071123_0001_m_000000_2, Status : FAILED
> Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext,
> but class was expected
> attempt_201208071123_0001_m_000000_2: SLF4J: Class path contains
> multiple SLF4J bindings.
> attempt_201208071123_0001_m_000000_2: SLF4J: Found binding in
> [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>
> attempt_201208071123_0001_m_000000_2: SLF4J: Found binding in
> [jar:file:/var/lib/hadoop-hdfs/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201208071123_0001/jars/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>
> attempt_201208071123_0001_m_000000_2: SLF4J: See
> http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> 12/08/07 11:26:19 INFO mapred.JobClient: Job complete: job_201208071123_0001
> 12/08/07 11:26:19 INFO mapred.JobClient: Counters: 7
> 12/08/07 11:26:19 INFO mapred.JobClient: Job Counters
> 12/08/07 11:26:19 INFO mapred.JobClient: Failed map tasks=1
> 12/08/07 11:26:19 INFO mapred.JobClient: Launched map tasks=4
> 12/08/07 11:26:19 INFO mapred.JobClient: Data-local map tasks=4
> 12/08/07 11:26:19 INFO mapred.JobClient: Total time spent by all
> maps in occupied slots (ms)=18003
> 12/08/07 11:26:19 INFO mapred.JobClient: Total time spent by all
> reduces in occupied slots (ms)=0
> 12/08/07 11:26:19 INFO mapred.JobClient: Total time spent by all
> maps waiting after reserving slots (ms)=0
> 12/08/07 11:26:19 INFO mapred.JobClient: Total time spent by all
> reduces waiting after reserving slots (ms)=0
> 12/08/07 11:26:19 ERROR crawl.InjectorJob: InjectorJob:
> java.lang.RuntimeException: job failed: name=inject-p1 urls,
> jobid=job_201208071123_0001
> at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:47)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:248)
> at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:288)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:298)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
> And log
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found
> interface org.apache.hadoop.mapreduce.CounterGroup, but class was expected
> at org.apache.nutch.util.ToolUtil.recordJobStatus(ToolUtil.java:59)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:249)
> at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
> at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:288)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:298)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
> Thanks
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
