[ 
https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120501#comment-15120501
 ] 

Jiangjie Qin commented on KAFKA-2076:
-------------------------------------

[~jkreps] Good point. From consumer point of view, I cannot think of use case 
where people want to know the #of bytes in the log within a time duration or 
the last update time. But those are probably valid use cases for admin. 
In terms of the last update time, this method will return the largest timstamp 
of the messages. If the timestmap is LogAppendTime, that will be the last 
update time. If the timestamp is CreateTime, user may infer the last updated 
time if they know the max.message.time.difference.ms. I am not sure about the 
file last update time because when replica get reassigned file last update time 
of the log segment file will change.

> Add an API to new consumer to allow user get high watermark of partitions.
> --------------------------------------------------------------------------
>
>                 Key: KAFKA-2076
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2076
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Jiangjie Qin
>            Assignee: Jiangjie Qin
>
> We have a use case that user wants to know how far it is behind a particular 
> partition on startup. Currently in each fetch response, we have high 
> watermark for each partition, we only keep a global max-lag metric. It would 
> be better that we keep a record of high watermark per partition and update it 
> on each fetch response. We can add a new API to let user query the high 
> watermark.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to