Jun, will KAFKA-292 result in output like this? $ grep t00-0 log/kafka.log | head 2012-03-25 19:42:03,943 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:43:03,941 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:44:03,942 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:45:03,943 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:46:03,942 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:47:03,943 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:48:03,942 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:49:03,943 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:50:03,941 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0 2012-03-25 19:51:03,943 LogManager.scala:201 kafka-logcleaner-0 INFO | Deleting log segment 00000000000000000000.kafka from t00-0
On 03/24/2012 01:45 AM, Jun Rao wrote: > https://issues.apache.org/jira/browse/KAFKA-292 can cause this when a topic > gets new data infrequently. Is that the same problem that you have seen? > > Thanks, > > Jun > > On Fri, Mar 23, 2012 at 6:09 PM, Bateman, Matt <mabate...@ebay.com> wrote: > >> Has anyone else see the cleaner get into a continuous loop, attempting to >> delete the same log files over and over for topic partitions? We've hit >> this twice now where it never stops until we bounce the broker. >> >> I didn't see a JIRA or a mention in the mailing list archives. >> >> Thanks, >> >> Matt >> >> >