Hi, 1) that checkpoint interval is way too low. I would leave it at the default.
2) the exception is saying file channel is full. This could be a result of the low checkpoint interval or because the sink in the channel is not keeping up. -- Brock Noland Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Wednesday, September 19, 2012 at 3:19 AM, Raymond Ng wrote: > Hi all > > I'm getting the following exception and as I result I lost records even using > File channel > root@test:~/flume-ng/deployment/script$ > (mailto:root@test:~/flume-ng/deployment/script$) > org.apache.flume.ChannelException: Unable to put batch on required channel: > FileChannel probeFileChannel2 { dataDirs: > [/home/local/flume-ng/filechannel2/data] } > at > org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:195) > at test.source.KafkaSource$PartitionManager.next(KafkaSource.java:360) > at test.source.KafkaSource.process(KafkaSource.java:228) > at > org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:137) > at java.lang.Thread.run(Thread.java:679) > Caused by: org.apache.flume.ChannelException: Cannot acquire capacity. > [channel=probeFileChannel2] > at > org.apache.flume.channel.file.FileChannel$FileBackedTransaction.doPut(FileChannel.java:343) > at > org.apache.flume.channel.BasicTransactionSemantics.put(BasicTransactionSemantics.java:93) > at > org.apache.flume.channel.BasicChannelSemantics.put(BasicChannelSemantics.java:76) > at > org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:184) > ... 4 more > > my file channel config below > > agent.channels.probeFileChannel2.type = FILE > agent.channels.probeFileChannel2.checkpointDir = > /home/local/flume-ng/filechannel2/checkpoint > agent.channels.probeFileChannel2.dataDirs = > /home/local/flume-ng/filechannel2/data > agent.channels.probeFileChannel2.transactionCapacity = 200000 > agent.channels.probeFileChannel2.checkpointInterval = 10 > agent.channels.probeFileChannel2.maxFileSize = 1073741824 > agent.channels.probeFileChannel2.capacity = 1000000 > agent.channels.probeFileChannel2.keep-alive = 3 > agent.channels.probeFileChannel2.write-timeout = 3 > > advice appreciated > -- > Rgds > Ray
