Hi Otis / Flume devs, if we could tail files in near real-time reliably using this source, it would improve the availability of HBase-sink, Elasticsearch-sink and so on.
This patch have worked well in our production environment for more than 3 moths and seems to works well from the following comment, too. https://issues.apache.org/jira/browse/FLUME-2498?focusedCommentId=14323992&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14323992 If this patch can be added as a experimental source, I will work on this such as changing the docs and other as necessary. Thanks, Satoshi 2015-03-31 12:00 GMT+09:00 Otis Gospodnetic <[email protected]>: > Hi, > > Oh, how about that tail issue that seems popular? Would it be possible to > include it, mark as experimental if you think that's the right thing to do > or if that's practice in Flume, and let people use it? JIRA doesn't seem > to be working right now, but I think that's > https://issues.apache.org/jira/browse/FLUME-2498 . > > Otis > -- > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > Solr & Elasticsearch Support * http://sematext.com/ > > > On Mon, Mar 30, 2015 at 8:22 PM, Hari Shreedharan < > [email protected] > > wrote: > > > Flume devs, > > > > > > > > > > I am going to start working on the release tomorrow, as Johny mentioned > > that he is sick and is out for a week or so. I don't want to delay this > > release any further. > > > > > > > > > > If anyone else can start the work in the next day or so, please let me > > know - I will be happy to help. Else, I will do it myself. > > > > > > > > > > Any more jiras other than the S3 source that needs love? > > > > > > > > > > Thanks, Hari > > > > On Thu, Mar 19, 2015 at 12:01 PM, Ashish <[email protected]> > wrote: > > > > > Not to push on the release. Please take your time. > > > ML was so silent, it was killing me :) > > > On Thu, Mar 19, 2015 at 11:51 PM, Johny Rufus <[email protected]> > > wrote: > > >> Hari/Ashish, > > >> > > >> We can begin the release work starting from Monday. > > >> > > >> Thanks, > > >> Rufus > > >> > > >> On Thu, Mar 19, 2015 at 11:16 AM, Hari Shreedharan < > > >> [email protected]> wrote: > > >> > > >>> Johny - any update? > > >>> > > >>> > > >>> Ashish wrote: > > >>> > > >>>> > > >>>> Folks, > > >>>> > > >>>> what's the plan for the release? Just wanted to checking before > > >>>> getting back on hunting more JIRA's :) > > >>>> > > >>>> thanks > > >>>> ashish > > >>>> > > >>>> On Tue, Feb 24, 2015 at 1:29 AM, Johny Rufus<[email protected]> > > wrote: > > >>>> > > >>>>> > > >>>>> Hi Hari, > > >>>>> > > >>>>> Yes, definitely, and thanks for the opportunity to get involved in > > the > > >>>>> release process. > > >>>>> > > >>>>> Thanks, > > >>>>> Rufus > > >>>>> > > >>>>> On Mon, Feb 23, 2015 at 11:39 AM, Hari Shreedharan< > > >>>>> [email protected]> wrote: > > >>>>> > > >>>>> > > >>>>>> Hey folks, > > >>>>>> > > >>>>>> > > >>>>>> I am planning to merge as many patches into Flume 1.6 as possible > > in the > > >>>>>> next few days so we can start working on a release. > > >>>>>> > > >>>>>> > > >>>>>> Johny - You mentioned that you were interested in doing the > release > > >>>>>> management work for this. Are you still interested? It would take > > quite > > >>>>>> a > > >>>>>> bit of time and effort for this, especially considering the fact > > that a > > >>>>>> lot > > >>>>>> of new integration work has been done, pulling in a lot of a new > > >>>>>> dependencies. > > >>>>>> > > >>>>>> > > >>>>>> Due credit to the Sqoop project, where the idea of non-committers > > being > > >>>>>> RMs is pretty regular (and from where I copied the idea). > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> Thanks, Hari > > >>>>>> > > >>>>> > > >>>>> > > >>>> > > >>>> > > >>>> > > > -- > > > thanks > > > ashish > > > Blog: http://www.ashishpaliwal.com/blog > > > My Photo Galleries: http://www.pbase.com/ashishpaliwal > > >
