[
https://issues.apache.org/jira/browse/KAFKA-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310112#comment-14310112
]
Steven Zhen Wu commented on KAFKA-1919:
---------------------------------------
[~jkreps] I tried your patch, it seems to fix the issue.
I dumped the request-rate metric every minutes. you can see that there are some
requests for metadata every 5 minutes, which is the default setting for
“metadata.max.age.ms”.
results before the patch
=============================================
main 14:38:36,155 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:39:36,159 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:40:36,162 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:41:36,163 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:42:36,167 INFO EmptyTopicTest:55 - request-rate=55.55555555555556
main 14:43:36,171 INFO EmptyTopicTest:55 - request-rate=18419.406415509144
main 14:44:36,174 INFO EmptyTopicTest:55 - request-rate=18342.581182348044
main 14:45:36,177 INFO EmptyTopicTest:55 - request-rate=18233.315572132677
main 14:46:36,181 INFO EmptyTopicTest:55 - request-rate=18464.50452850293
main 14:47:36,183 INFO EmptyTopicTest:55 - request-rate=18489.045748152093
main 14:48:36,186 INFO EmptyTopicTest:55 - request-rate=18627.492758930654
main 14:49:36,190 INFO EmptyTopicTest:55 - request-rate=18563.315579227696
main 14:50:36,192 INFO EmptyTopicTest:55 - request-rate=18632.093998602006
main 14:51:36,195 INFO EmptyTopicTest:55 - request-rate=18558.976236437462
main 14:52:36,199 INFO EmptyTopicTest:55 - request-rate=18533.111480865224
results after the patch
=============================================
main 14:12:54,920 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:13:54,924 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:14:54,927 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:15:54,931 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:16:54,933 INFO EmptyTopicTest:55 - request-rate=55.55555555555556
main 14:17:54,935 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:18:54,939 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:19:54,942 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:20:54,946 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:21:54,950 INFO EmptyTopicTest:55 - request-rate=29.41176470588235
main 14:22:54,954 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:23:54,956 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:24:54,959 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:25:54,962 INFO EmptyTopicTest:55 - request-rate=NaN
main 14:26:54,964 INFO EmptyTopicTest:55 - request-rate=21.27659574468085
> Metadata request issued with no backoff in new producer if there are no topics
> ------------------------------------------------------------------------------
>
> Key: KAFKA-1919
> URL: https://issues.apache.org/jira/browse/KAFKA-1919
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.8.2
> Reporter: Jay Kreps
> Attachments: KAFKA-1919-v1.patch
>
>
> Original report:
> We have observed high cpu and high network traffic problem when
> 1) cluster (0.8.1.1) has no topic
> 2) KafkaProducer (0.8.2-beta) object is created without sending any traffic
> We have observed such problem twice. In both cases, problem went away
> immediately after one/any topic is created.
> Is this a known issue? Just want to check with the community first before I
> spend much time to reproduce it.
> I couldn't reproduce the issue with similar setup with unit test code in
> IDE. start two brokers with no topic locally on my laptop. create a
> KafkaProducer object without sending any msgs. but I only tested with
> 0.8.2-beta for both broker and producer.
> Issue exists in 0.8.2 as well:
> I have re-run my unit test with 0.8.2.0. same tight-loop problem happened
> after a few mins.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
