Hi all
I'm getting the following exception and as I result I lost records even
using File channel
root@test:~/flume-ng/deployment/script$ org.apache.flume.ChannelException:
Unable to put batch on required channel: FileChannel probeFileChannel2 {
dataDirs: [/home/local/flume-ng/filechannel2/data] }
at
org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:195)
at test.source.KafkaSource$PartitionManager.next(KafkaSource.java:360)
at test.source.KafkaSource.process(KafkaSource.java:228)
at
org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:137)
at java.lang.Thread.run(Thread.java:679)
Caused by: org.apache.flume.ChannelException: Cannot acquire capacity.
[channel=probeFileChannel2]
at
org.apache.flume.channel.file.FileChannel$FileBackedTransaction.doPut(FileChannel.java:343)
at
org.apache.flume.channel.BasicTransactionSemantics.put(BasicTransactionSemantics.java:93)
at
org.apache.flume.channel.BasicChannelSemantics.put(BasicChannelSemantics.java:76)
at
org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:184)
... 4 more
my file channel config below
agent.channels.probeFileChannel2.type = FILE
agent.channels.probeFileChannel2.checkpointDir =
/home/local/flume-ng/filechannel2/checkpoint
agent.channels.probeFileChannel2.dataDirs =
/home/local/flume-ng/filechannel2/data
agent.channels.probeFileChannel2.transactionCapacity = 200000
agent.channels.probeFileChannel2.checkpointInterval = 10
agent.channels.probeFileChannel2.maxFileSize = 1073741824
agent.channels.probeFileChannel2.capacity = 1000000
agent.channels.probeFileChannel2.keep-alive = 3
agent.channels.probeFileChannel2.write-timeout = 3
advice appreciated
--
Rgds
Ray
