Mayuresh, Yes, it seems like I misunderstood the behavior of log deletion but indeed my log segments were deleted after a specified amount of time. I have a small follow-up question, it seems that when the logs are deleted the topic persists and can be republished too -- is there a configuration for how long a topic persists or does it stay forever until it is manually marked for deletion?
Also @Grant, thank you very much for your help as well. I ended up using the ms update configuration and understand the broker configs better. Thanks! On Mon, Jul 27, 2015 at 9:27 AM, Mayuresh Gharat <gharatmayures...@gmail.com > wrote: > Hi Jiefu, > > Any update on this? Were you able to delete those log segments? > > Thanks, > > Mayuresh > > On Fri, Jul 24, 2015 at 7:14 PM, Mayuresh Gharat < > gharatmayures...@gmail.com > > wrote: > > > To add on, the main thing here is you should be using only one of these > > properties. > > > > Thanks, > > > > Mayuresh > > > > On Fri, Jul 24, 2015 at 6:47 PM, Mayuresh Gharat < > > gharatmayures...@gmail.com> wrote: > > > >> Yes. It should. Do not set other retention settings. Just use the > "hours" > >> settings. > >> Let me know about this :) > >> > >> Thanks, > >> > >> Mayuresh > >> > >> On Fri, Jul 24, 2015 at 6:43 PM, JIEFU GONG <jg...@berkeley.edu> wrote: > >> > >>> Mayuresh, thanks for your comment. I won't be able to change these > >>> settings > >>> until next Monday, but just so confirm you are saying that if I restart > >>> the > >>> brokers my logs should delete themselves with respect to the newest > >>> settings, correct? > >>> ᐧ > >>> > >>> On Fri, Jul 24, 2015 at 6:29 PM, Mayuresh Gharat < > >>> gharatmayures...@gmail.com > >>> > wrote: > >>> > >>> > No. This should not happen. At Linkedin we just use the log retention > >>> > hours. Try using that. Chang e it and bounce the broker. It should > >>> work. > >>> > Also looking back at the config's I am not sure why we had 3 > different > >>> > configs for the same property : > >>> > > >>> > "log.retention.ms" > >>> > "log.retention.minutes" > >>> > "log.retention.hours" > >>> > > >>> > We should probably be having just the milliseconds. > >>> > > >>> > Thanks, > >>> > > >>> > Mayuresh > >>> > > >>> > On Fri, Jul 24, 2015 at 4:12 PM, JIEFU GONG <jg...@berkeley.edu> > >>> wrote: > >>> > > >>> > > Hi all, > >>> > > > >>> > > I have a few broad questions on how log deletion works, > specifically > >>> in > >>> > > conjunction with the log.retention.time setting. Say I published > some > >>> > > messages to some topics when the configuration was originally set > to > >>> > > something like log.retention.hours=168 (default). If I publish > these > >>> > > messages successfully, then later set the configuration to > something > >>> like > >>> > > log.retention.minutes=1, are those logs supposed to persist for the > >>> > newest > >>> > > settings or the old settings? Right now my logs are refusing to > >>> delete > >>> > > themselves unless I specifically mark them for deletion -- is this > >>> the > >>> > > correct/anticipated/wanted behavior? > >>> > > > >>> > > Thanks for the help! > >>> > > > >>> > > -- > >>> > > > >>> > > Jiefu Gong > >>> > > University of California, Berkeley | Class of 2017 > >>> > > B.A Computer Science | College of Letters and Sciences > >>> > > > >>> > > jg...@berkeley.edu <elise...@berkeley.edu> | (925) 400-3427 > >>> > > > >>> > > >>> > > >>> > > >>> > -- > >>> > -Regards, > >>> > Mayuresh R. Gharat > >>> > (862) 250-7125 > >>> > > >>> > >>> > >>> > >>> -- > >>> > >>> Jiefu Gong > >>> University of California, Berkeley | Class of 2017 > >>> B.A Computer Science | College of Letters and Sciences > >>> > >>> jg...@berkeley.edu <elise...@berkeley.edu> | (925) 400-3427 > >>> > >> > >> > >> > >> -- > >> -Regards, > >> Mayuresh R. Gharat > >> (862) 250-7125 > >> > > > > > > > > -- > > -Regards, > > Mayuresh R. Gharat > > (862) 250-7125 > > > > > > -- > -Regards, > Mayuresh R. Gharat > (862) 250-7125 > -- Jiefu Gong University of California, Berkeley | Class of 2017 B.A Computer Science | College of Letters and Sciences jg...@berkeley.edu <elise...@berkeley.edu> | (925) 400-3427
