Hi Sandesh,
You may want to check protobuf-java-x.x.x.jar in Flume against one in
Hadoop; you should use one in Hadoop or the same version; same thing
with guava-x.x.x.jar
Regards,
Jeongshik
2/18/14, 4:58 PM, Sandesh Hurli ? ?:
Hi,
I have started using Flume recently. I have configured Flume to write
data into a HDFS sink running locally, but everytime I run the agent,
I get the below error:
2014-02-18 13:23:40,863
(SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR -
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:422)]
process failed
java.lang.VerifyError: class
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$SetOwnerRequestProto
overrides final method
getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
Following are the contents of my flume.conf file:
agent.sources = seqGenSrc
agent.channels = memoryChannel
agent.sinks = loggerSink
agent.sources.seqGenSrc.type = exec
agent.sources.seqGenSrc.command = tail -F /home/hduser/sample.txt
agent.sources.seqGenSrc.channels = memoryChannel
agent.sinks.loggerSink.type = hdfs
agent.sinks.loggerSink.hdfs.path =
hdfs://localhost:54310/user/hduser/sample.txt
agent.sinks.loggerSink.hdfs.fileType = DataStream
agent.sinks.loggerSink.channel = memoryChannel
agent.channels.memoryChannel.type = memory
agent.channels.memoryChannel.capacity = 100
Why does this happen?
Regards,
Sandesh
--
Jeong-shik Jang / [email protected]
Gruter, Inc., Vice President
www.gruter.com
Enjoy Connecting
