Thanks for the info. I notice that Facebook seems to go with odd release number 0.19 and 0.21. Yahoo is going with even release number. I think it is best to move to Hadoop 0.20+ to take advantage of the latest fixes. I only develop and test on Hadoop 0.18 and 0.20.2. Your milages may vary.
regards, Eric On Thu, Nov 4, 2010 at 12:36 AM, Min Zhou <[email protected]> wrote: > Hi Eric, > > Unfortunately, We assure Chukwa 0.4.0 is not compatible with Hadoop > 0.19.x now. > All agent will throw exception like below: > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/hadoop/metrics/util/MetricsRegistry > at > org.apache.hadoop.chukwa.datacollection.agent.metrics.AgentMetrics.<init>(AgentMetrics.java:32) > at > org.apache.hadoop.chukwa.datacollection.agent.metrics.AgentMetrics.<clinit>(AgentMetrics.java:30) > at > org.apache.hadoop.chukwa.datacollection.agent.ChukwaAgent.<clinit>(ChukwaAgent.java:63) > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.metrics.util.MetricsRegistry > at java.net.URLClassLoader$1.run(URLClassLoader.java:200) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:188) > at java.lang.ClassLoader.loadClass(ClassLoader.java:306) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:276) > at java.lang.ClassLoader.loadClass(ClassLoader.java:251) > at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319) > > The class "MetricsRegistry" is not defined in Hadoop 0.19.x. Actually, > it's introduced in Hadoop 0.20.0. > > There are a lot of refers to this this class in chukwa: > > AgentActivityMBean.java (2 matches) > 25: import org.apache.hadoop.metrics.util.MetricsRegistry; > 30: public AgentActivityMBean(final MetricsRegistry mr, final String > serviceName) { > AgentMetrics.java (3 matches) > 26: import org.apache.hadoop.metrics.util.MetricsRegistry; > 32: public MetricsRegistry registry = new MetricsRegistry(); > ChunkQueueActivityMBean.java (2 matches) > 25: import org.apache.hadoop.metrics.util.MetricsRegistry; > 30: public ChunkQueueActivityMBean(final MetricsRegistry mr, final > String serviceName) { > ChunkQueueMetrics.java (3 matches) > 27: import org.apache.hadoop.metrics.util.MetricsRegistry; > 32: public MetricsRegistry registry = new MetricsRegistry(); > sender > metrics > HttpSenderActivityMBean.java (2 matches) > 25: import org.apache.hadoop.metrics.util.MetricsRegistry; > 32: public HttpSenderActivityMBean(final MetricsRegistry mr, final > String serviceName) { > HttpSenderMetrics.java (3 matches) > 25: import org.apache.hadoop.metrics.util.MetricsRegistry; > 30: public MetricsRegistry registry = new MetricsRegistry(); > > Regards, > Min > > On Tue, Oct 26, 2010 at 12:43 AM, Eric Yang <[email protected]> wrote: >> Everything works. You don’t lose any function. >> >> Regards, >> Eric >> >> >> On 10/24/10 11:19 PM, "Min Zhou" <[email protected]> wrote: >> >> On Mon, Oct 25, 2010 at 1:34 AM, Eric Yang <[email protected]> wrote: >>> Hi Min, >>> >>> It works. Chukwa 0.4.0 is compatible to Hadoop 0.18.x. However, we >>> really like people to move to Hadoop 0.20 so we can remove some legacy >>> code for supporting older version of Hadoop. >> >> I know it will work. Is there any function lost if we deploy it under >> hadoop 0.19.2 rather than 0.20.2? >> >> Thanks, >> Min >> >> >>> regards, >>> Eric >>> >>> On Sun, Oct 24, 2010 at 7:08 AM, Min Zhou <[email protected]> wrote: >>>> Hi guys, >>>> >>>> From the document of Chukwa 0.4.0, it mentions that "Note that these >>>> directions require Hadoop 0.20.0+. Earlier versions of Hadoop do not >>>> have the hooks that Chukwa requires in order to grab MapReduce job >>>> logs." Can anyone tell me the reason why chukwa requires 0.20.0+, we >>>> know job logs and metrics are also supported by hadoop 0.19.x. >>>> >>>> If we deploy chukwa 0.4.0 on a hadoop cluster under the version of >>>> 0.19.2. What will happens? >>>> >>>> >>>> Thanks, >>>> Min >>>> >>>> >>>> -- >>>> My research interests are distributed systems, parallel computing and >>>> bytecode based virtual machine. >>>> >>>> My profile: >>>> http://www.linkedin.com/in/coderplay >>>> My blog: >>>> http://coderplay.javaeye.com >>>> >>> >> >> >> >> -- >> My research interests are distributed systems, parallel computing and >> bytecode based virtual machine. >> >> My profile: >> http://www.linkedin.com/in/coderplay >> My blog: >> http://coderplay.javaeye.com >> >> > > > > -- > My research interests are distributed systems, parallel computing and > bytecode based virtual machine. > > My profile: > http://www.linkedin.com/in/coderplay > My blog: > http://coderplay.javaeye.com >
