Hi Jeong-shik, Thanks for the response.
My Hadoop was using protobuf-java-2.5.0 and Flume was using protobuf-java-2.4.1. guava-x.x.x.jar versions are compatible. I downloaded protobuf-java-2.5.0.jar file and replaced it with the older file in the $FLUME_HOME/lib directory. It seems to be working now. But is this the right way to do it, or do I need to compile Flume from source? Reagrds, Sandesh On Tue, Feb 18, 2014 at 2:31 PM, Jeong-shik Jang <[email protected]> wrote: > Hi Sandesh, > > You may want to check protobuf-java-x.x.x.jar in Flume against one in > Hadoop; you should use one in Hadoop or the same version; same thing with > guava-x.x.x.jar > > Regards, > > Jeongshik > > > 2/18/14, 4:58 PM, Sandesh Hurli 쓴 글: > > Hi, > > > I have started using Flume recently. I have configured Flume to write > data into a HDFS sink running locally, but everytime I run the agent, I get > the below error: > > > 2014-02-18 13:23:40,863 (SinkRunner-PollingRunner-DefaultSinkProcessor) > [ERROR - > org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:422)] > process failed > java.lang.VerifyError: class > org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$SetOwnerRequestProto > overrides final method > getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet; > > Following are the contents of my flume.conf file: > > > agent.sources = seqGenSrc > agent.channels = memoryChannel > agent.sinks = loggerSink > > > agent.sources.seqGenSrc.type = exec > agent.sources.seqGenSrc.command = tail -F /home/hduser/sample.txt > > > agent.sources.seqGenSrc.channels = memoryChannel > > > agent.sinks.loggerSink.type = hdfs > agent.sinks.loggerSink.hdfs.path = > hdfs://localhost:54310/user/hduser/sample.txt > agent.sinks.loggerSink.hdfs.fileType = DataStream > > > agent.sinks.loggerSink.channel = memoryChannel > agent.channels.memoryChannel.type = memory > agent.channels.memoryChannel.capacity = 100 > > > Why does this happen? > > Regards, > Sandesh > > > > -- > Jeong-shik Jang / [email protected] > Gruter, Inc., Vice Presidentwww.gruter.com > Enjoy Connecting > >
