Re: Clean Kafka Queue

2014-10-21 Thread Eduardo Costa Alfaia
Ok guys,

Thanks by the help.

Regards
> On Oct 21, 2014, at 18:30, Joe Stein  wrote:
> 
> The concept of "truncate topic" comes up a lot.  I will add it as an item
> to https://issues.apache.org/jira/browse/KAFKA-1694
> 
> It is a scary feature though, it might be best to wait until authorizations
> are in place before we release it.
> 
> With 0.8.2 you can delete topics so at least you can start fresh easier.
> That should work in the mean time.  0.8.2-beta should be out this week :)
> 
> /***
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly
> Twitter: @allthingshadoop 
> /
> 
> On Tue, Oct 21, 2014 at 12:03 PM, Harsha  wrote:
> 
>> you can use log.retention.hours or log.retention.bytes to prune the log
>> more info on that config here
>> https://kafka.apache.org/08/configuration.html
>> if you want to delete a message after the consumer processed a message
>> there is no api for it.
>> -Harsha
>> 
>> 
>> On Tue, Oct 21, 2014, at 08:00 AM, Eduardo Costa Alfaia wrote:
>>> Hi Guys,
>>> 
>>> Is there a manner of cleaning  a kafka queue after that the consumer
>>> consume the messages?
>>> 
>>> Thanks
>>> --
>>> Informativa sulla Privacy: http://www.unibs.it/node/8155
>> 


-- 
Informativa sulla Privacy: http://www.unibs.it/node/8155


Re: Clean Kafka Queue

2014-10-21 Thread Joe Stein
The concept of "truncate topic" comes up a lot.  I will add it as an item
to https://issues.apache.org/jira/browse/KAFKA-1694

It is a scary feature though, it might be best to wait until authorizations
are in place before we release it.

With 0.8.2 you can delete topics so at least you can start fresh easier.
That should work in the mean time.  0.8.2-beta should be out this week :)

/***
 Joe Stein
 Founder, Principal Consultant
 Big Data Open Source Security LLC
 http://www.stealth.ly
 Twitter: @allthingshadoop 
/

On Tue, Oct 21, 2014 at 12:03 PM, Harsha  wrote:

> you can use log.retention.hours or log.retention.bytes to prune the log
> more info on that config here
> https://kafka.apache.org/08/configuration.html
> if you want to delete a message after the consumer processed a message
> there is no api for it.
> -Harsha
>
>
> On Tue, Oct 21, 2014, at 08:00 AM, Eduardo Costa Alfaia wrote:
> > Hi Guys,
> >
> > Is there a manner of cleaning  a kafka queue after that the consumer
> > consume the messages?
> >
> > Thanks
> > --
> > Informativa sulla Privacy: http://www.unibs.it/node/8155
>


Re: Clean Kafka Queue

2014-10-21 Thread Harsha
you can use log.retention.hours or log.retention.bytes to prune the log  
more info on that config here
https://kafka.apache.org/08/configuration.html
if you want to delete a message after the consumer processed a message
there is no api for it.
-Harsha


On Tue, Oct 21, 2014, at 08:00 AM, Eduardo Costa Alfaia wrote:
> Hi Guys,
> 
> Is there a manner of cleaning  a kafka queue after that the consumer
> consume the messages?
> 
> Thanks 
> -- 
> Informativa sulla Privacy: http://www.unibs.it/node/8155


Clean Kafka Queue

2014-10-21 Thread Eduardo Costa Alfaia
Hi Guys,

Is there a manner of cleaning  a kafka queue after that the consumer consume 
the messages?

Thanks 
-- 
Informativa sulla Privacy: http://www.unibs.it/node/8155