[ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120501#comment-15120501 ]
Jiangjie Qin commented on KAFKA-2076: ------------------------------------- [~jkreps] Good point. From consumer point of view, I cannot think of use case where people want to know the #of bytes in the log within a time duration or the last update time. But those are probably valid use cases for admin. In terms of the last update time, this method will return the largest timstamp of the messages. If the timestmap is LogAppendTime, that will be the last update time. If the timestamp is CreateTime, user may infer the last updated time if they know the max.message.time.difference.ms. I am not sure about the file last update time because when replica get reassigned file last update time of the log segment file will change. > Add an API to new consumer to allow user get high watermark of partitions. > -------------------------------------------------------------------------- > > Key: KAFKA-2076 > URL: https://issues.apache.org/jira/browse/KAFKA-2076 > Project: Kafka > Issue Type: Sub-task > Reporter: Jiangjie Qin > Assignee: Jiangjie Qin > > We have a use case that user wants to know how far it is behind a particular > partition on startup. Currently in each fetch response, we have high > watermark for each partition, we only keep a global max-lag metric. It would > be better that we keep a record of high watermark per partition and update it > on each fetch response. We can add a new API to let user query the high > watermark. -- This message was sent by Atlassian JIRA (v6.3.4#6332)