Hi Jiefu,
The topic will stay forever. You can do delete topic operation to get rid
of the topic.
Thanks,
Mayuresh
On Mon, Jul 27, 2015 at 11:19 AM, JIEFU GONG wrote:
> Mayuresh,
>
> Yes, it seems like I misunderstood the behavior of log deletion but indeed
> my log segments were deleted afte
Mayuresh,
Yes, it seems like I misunderstood the behavior of log deletion but indeed
my log segments were deleted after a specified amount of time. I have a
small follow-up question, it seems that when the logs are deleted the topic
persists and can be republished too -- is there a configuration f
Hi Jiefu,
Any update on this? Were you able to delete those log segments?
Thanks,
Mayuresh
On Fri, Jul 24, 2015 at 7:14 PM, Mayuresh Gharat wrote:
> To add on, the main thing here is you should be using only one of these
> properties.
>
> Thanks,
>
> Mayuresh
>
> On Fri, Jul 24, 2015 at 6:47
Also this stackoverflow answer may help: http://stackoverflow.com/a/29672325
On Fri, Jul 24, 2015 at 9:36 PM, Grant Henke wrote:
> I would actually suggest only using the ms versions of the retention
> config. Be sure to check/set all the configs below and look at the
> documented explanations h
I would actually suggest only using the ms versions of the retention
config. Be sure to check/set all the configs below and look at the
documented explanations here
http://kafka.apache.org/documentation.html#brokerconfigs.
I am guessing the default log.retention.check.interval.ms of 5 minutes is
t
To add on, the main thing here is you should be using only one of these
properties.
Thanks,
Mayuresh
On Fri, Jul 24, 2015 at 6:47 PM, Mayuresh Gharat wrote:
> Yes. It should. Do not set other retention settings. Just use the "hours"
> settings.
> Let me know about this :)
>
> Thanks,
>
> Mayur
Okay, I will look into only using the hours setting, but I think that means
the minimum a log can be stored is 1 hour right? I think last time I tried
there Kafka failed to parse decimals.
ᐧ
On Fri, Jul 24, 2015 at 6:47 PM, Mayuresh Gharat wrote:
> Yes. It should. Do not set other retention sett
Yes. It should. Do not set other retention settings. Just use the "hours"
settings.
Let me know about this :)
Thanks,
Mayuresh
On Fri, Jul 24, 2015 at 6:43 PM, JIEFU GONG wrote:
> Mayuresh, thanks for your comment. I won't be able to change these settings
> until next Monday, but just so confi
Mayuresh, thanks for your comment. I won't be able to change these settings
until next Monday, but just so confirm you are saying that if I restart the
brokers my logs should delete themselves with respect to the newest
settings, correct?
ᐧ
On Fri, Jul 24, 2015 at 6:29 PM, Mayuresh Gharat wrote:
No. This should not happen. At Linkedin we just use the log retention
hours. Try using that. Chang e it and bounce the broker. It should work.
Also looking back at the config's I am not sure why we had 3 different
configs for the same property :
"log.retention.ms"
"log.retention.minutes"
"log.rete
Hi all,
I have a few broad questions on how log deletion works, specifically in
conjunction with the log.retention.time setting. Say I published some
messages to some topics when the configuration was originally set to
something like log.retention.hours=168 (default). If I publish these
messages s
11 matches
Mail list logo
