Hi, I would have your channel capacity a few times larger than your batch size. Also you batch size must match transactionCapacity for the MemoryChannel.
Brock On Mon, May 21, 2012 at 2:49 AM, shekhar sharma <[email protected]> wrote: > Hello, > I am getting following error: > 2012-05-20 16:31:55,125 ERROR sink.AvroSink: Unable to get event from > channel. Exception follows. > org.apache.flume.ChannelException: Take list for MemoryTransaction, capacity > 100 full, consider committing more frequently, increasing capacity, or > increasing thread count > at > org.apache.flume.channel.MemoryChannel$MemoryTransaction.doTake(MemoryChannel.java:61) > at > org.apache.flume.channel.BasicTransactionSemantics.take(BasicTransactionSemantics.java:113) > at > org.apache.flume.channel.BasicChannelSemantics.take(BasicChannelSemantics.java:91) > at org.apache.flume.sink.AvroSink.process(AvroSink.java:231) > at > org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68) > at > org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147) > at java.lang.Thread.run(Thread.java:662) > > I have kept java heap space as 256MB, memory channel capacity as 1000, Avro > sink batch size as 1000. > > Regards, > Som -- Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
