Hi,
  No, I did not delete the checkpoint previously. That is what I did to fix the 
problem. 

Searching through the archives, it looks like 
http://mail-archives.apache.org/mod_mbox/flume-user/201211.mbox/%3cda66e7657bfbd949829f3c98d73a54cf18e...@rhv-exrda-s11.corp.ebay.com%3E
 needs the checkpoint to be deleted. Will do that in future. Do you still need 
the logs?
~Rahul.


________________________________
 From: Brock Noland <[email protected]>
To: "[email protected]" <[email protected]>; Rahul Ravindran 
<[email protected]> 
Sent: Saturday, February 2, 2013 2:32 PM
Subject: Re: FileChannel error on Flume 1.3.1
 

Hi,

That isn't a good error message. Could you share your entire log file? Post it 
on a JIRA or pastebin. 

Did you delete the checkpoint before starting the channel after changing 
capacity? Capacity is fixed for the file channel as such the checkpoint must be 
deleted to change the capacity. 

Brock

On Saturday, February 2, 2013, Rahul Ravindran  wrote:

Hi,
>  I increased the capacity and the max file size parameters of the filechannel 
>in our config and began seeing the below exception. I continue seeing the 
>below on restarting the channel. I fixed this by removing the files in the 
>checkpoint and data folders.
>
>
>02 Feb 2013 21:45:51,113 WARN  
>[SinkRunner-PollingRunner-LoadBalancingSinkProcessor] 
>(org.apache.flume.sink.LoadBalancingSinkProcessor.process:158)  - Sink failed 
>to consume event. Attempting next sink if available.
>java.lang.IllegalStateException: Channel closed [channel=ch2]. Due to 
>java.io.EOFException: null
>at 
>org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:353)
>at 
>org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:122)
>at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
>at 
>org.apache.flume.sink.LoadBalancingSinkProcessor.process(LoadBalancingSinkProcessor.java:154)
>at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
>at java.lang.Thread.run(Thread.java:662)
>Caused by: java.io.EOFException
>at java.io.RandomAccessFile.readInt(RandomAccessFile.java:759)
>at java.io.RandomAccessFile.readLong(RandomAccessFile.java:792)
>at 
>org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:71)
>at 
>org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:36)
>at org.apache.flume.channel.file.Log.replay(Log.java:365)
>at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303)
>at 
>org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
>at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
>at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
>at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
>at 
>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
>at 
>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
>at 
>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
>at 
>java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

-- 
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Reply via email to