channel transaction is 500 and I've not set any batchsize parameter. On Wed, Jan 16, 2013 at 1:49 PM, Bhaskar V. Karambelkar <[email protected] > wrote:
> What is the channel transaction capacity and HDFS batch size ? > > > On Wed, Jan 16, 2013 at 1:52 PM, Mohit Anchlia <[email protected]>wrote: > >> I often get out of memory even when there is no load on the system. I am >> wondering what's the best way to debug this. I have heap size set to 2G and >> memory capacity is 10000 >> >> >> *13/01/16* *09:09:38* *ERROR* *hdfs.HDFSEventSink:* *process* *failed* >> >> *java.lang.OutOfMemoryError:* *Java* *heap* *space* >> *at* *java.util.Arrays.copyOf*(*Arrays.java:2786*) >> >> >> *at* >> *java.io.ByteArrayOutputStream.write*(*ByteArrayOutputStream.java:94*) >> >> *at* *java.io.DataOutputStream.write*(*DataOutputStream.java:90*) >> >> *at* *org.apache.hadoop.io.Text.write*(*Text.java:282*) >> *...* *11* *lines* *omitted* *...* >> *at* *java.lang.Thread.run*(*Thread.java:662*) >> >> *Exception* *in* *thread* "*SinkRunner-PollingRunner-DefaultSinkProcessor*" >> *java.lang.OutOfMemoryError:* *Java* *heap* *space* >> >> >> *at* *java.util.Arrays.copyOf*(*Arrays.java:2786*) >> >> *at* >> *java.io.ByteArrayOutputStream.write*(*ByteArrayOutputStream.java:94*) >> >> >
