Re: log retention bytes and log segment bytes

2018-04-12 Thread Peter Bukowinski
Hi Amit, This is from the broker config section of the very good documentation on the kafka web site: https://kafka.apache.org/0100/documentation.html#brokerconfigs log.segment.bytes: The maximum size of a single log file (default 1GB) log.retention.bytes: The maximum size of the log before del

Re: log retention bytes and log segment bytes

2018-04-12 Thread Ted Yu
For log.retention.bytes : A size-based retention policy for logs. Segments are pruned from the log unless the remaining segments drop below log.retention.bytes This config is per partition. For log.segment.bytes : The maximum size of a log segment file. When this size is reached a new log segment