Hi Vic, don't know I'm afraid. When OS tail worked for me I moved onto my next problem ... :-)
Liam On Sep 27, 2011 1:09 AM, "Huang, Zijian(Victor)" <zijian.hu...@etrade.com> wrote: > Thanks, Liam. This help me to move forward. do you aware of any difference than the Flume implementation of Tail? > I really want to see this https://issues.cloudera.org/browse/FLUME-533?page=com.atlassian.streams.streams-jira-plugin%3Aactivity-stream-issue-tabfix to sovle the problem > > > Vic > > ________________________________ > From: Liam Friel [mailto:liam.fr...@gmail.com] > Sent: Monday, September 26, 2011 3:04 PM > To: flume-user@incubator.apache.org > Subject: Re: Flume agent repeatedly streaming the same content forever (Version: 0.9.3, r) > > > > On Mon, Sep 26, 2011 at 10:50 PM, Huang, Zijian(Victor) < zijian.hu...@etrade.com<mailto:zijian.hu...@etrade.com>> wrote: > I think I found the cause. because one of the line is larger than the set limit, I tried to set the flume.event.max.size.bytes in the agent node and collector node but the system doesn't seem to take the values > ==== > <property> > <name>flume.event.max.size.bytes</name> > <value>2076150</value> > <description>The length of line content in byte.</description> > </property> > ===== > > am I doing anything wrong? > > Thanks > > Vic > ________________________________ > > I had a similar issue before. > I switched to using OS tail, rather than flume tail, and it made my problems go away. > > This thread: https://groups.google.com/a/cloudera.org/group/flume-user/browse_thread/thread/b2f9ba4609124311/f7a45e5a34f09f13has details. > > Liam >