[
https://issues.apache.org/jira/browse/KAFKA-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199712#comment-16199712
]
Jiangjie Qin commented on KAFKA-6028:
-------------------------------------
[~junrao] Not sure if this is going to solve the problem. The solution in
KAFKA-5871 seems to assume that the clients request timeout is greater than the
metric window which is 30 seconds by default. But if the client's request
timeout is less than that it would still timeout and reconnect, right?
> Improve the quota throttle communication.
> -----------------------------------------
>
> Key: KAFKA-6028
> URL: https://issues.apache.org/jira/browse/KAFKA-6028
> Project: Kafka
> Issue Type: Improvement
> Components: clients, core
> Affects Versions: 1.0.0
> Reporter: Jiangjie Qin
> Assignee: Jiangjie Qin
> Fix For: 1.1.0
>
>
> Currently if a client is throttled duet to quota violation, the broker will
> only send back a response to the clients after the throttle time has passed.
> In this case, the clients don't know how long the response will be throttled
> and might hit request timeout before the response is returned. As a result
> the clients will retry sending a request and results a even longer throttle
> time.
> The above scenario could happen when a large clients group sending records to
> the brokers. We saw this when a MapReduce job pushes data to the Kafka
> cluster.
> To improve this, the broker can return the response with throttle time
> immediately after processing the requests. After that, the broker will mute
> the channel for this client. A correct client implementation should back off
> for that long before sending the next request. If the client ignored the
> throttle time and send the next request immediately, the channel will be
> muted and the request won't be processed until the throttle time has passed.
> A KIP will follow with more details.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
