Re: Delete topic and logs

2016-02-20 Thread Feroze Daud
unsubscribe On Saturday, February 20, 2016 9:22 AM, Neelesh wrote: I searched for this and could not get a definitive answer- when do logs get deleted , after a topic is deleted? What happens if I delete a topic and recreate it immediately? So far I know that

Documentation for 0.8.2 kafka-client api?

2015-10-08 Thread Feroze Daud
hi! where can I find a quickstart doc for kafka-client java api version 0.8.2 ? The documentation at http://kafka.apache.org/documentation.html does not seem to sync with the 0.8.2 API in the kafka-clients artifact. Specifically, I cannot find the class ConsumerConnector that is referenced here: 

Re: Documentation for 0.8.2 kafka-client api?

2015-10-08 Thread Feroze Daud
nector is part of the old consumer API (which is what is currently released; new consumer is coming in 0.9.0). That class is not in kafka-clients, it is in the core Kafka jar, which is named with the Scala version you want to use, e.g. kafka_2.10. -Ewen On Thu, Oct 8, 2015 at 1:24 PM, Feroze Daud

Re: log compaction scaling with ~100m messages

2015-10-08 Thread Feroze Daud
management: e.g., support for compressed messages, various other bugs, but most of these have been resolved. Hope that helps, Joel On Tue, Oct 6, 2015 at 8:34 PM, Feroze Daud <khic...@yahoo.com.invalid> wrote: > hi! > We have a use case where we want to store ~100m keys in ka

log compaction scaling with ~100m messages

2015-10-06 Thread Feroze Daud
hi! We have a use case where we want to store ~100m keys in kafka. Is there any problem with this approach? I have heard from some people using kafka, that kafka has a problem when doing log compaction with those many number of keys. Another topic might have around 10 different K/V pairs for