[jira] [Assigned] (KAFKA-5358) Consumer perf tool should count rebalance time separately

2017-06-01 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5358: --- Assignee: huxi > Consumer perf tool should count rebalance time separately >

[jira] [Assigned] (KAFKA-5327) Console Consumer should only poll for up to max messages

2017-05-25 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5327: --- Assignee: huxi > Console Consumer should only poll for up to max messages >

[jira] [Commented] (KAFKA-5296) Unable to write to some partitions of newly created topic in 10.2

2017-05-21 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019074#comment-16019074 ] huxi commented on KAFKA-5296: - With 0.10.2 client, could you try to enlarge `request.timeout.ms` a little bit

[jira] [Commented] (KAFKA-5299) MirrorMaker with New.consumer doesn't consume message from multiple topics whitelisted

2017-05-21 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019072#comment-16019072 ] huxi commented on KAFKA-5299: - How did you specify the whitelist? It should be a valid regular expression. >

[jira] [Assigned] (KAFKA-5278) kafka-console-consumer: `--value-deserializer` is not working but `--property value.deserializer` does

2017-05-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5278: --- Assignee: huxi > kafka-console-consumer: `--value-deserializer` is not working but `--property >

[jira] [Commented] (KAFKA-5200) Deleting topic when one broker is down will prevent topic to be re-creatable

2017-05-14 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009914#comment-16009914 ] huxi commented on KAFKA-5200: - [~ecomar] Seems there is no convenient tool to do this. However, you could

[jira] [Commented] (KAFKA-5222) Kafka Connection error in contoller.logs

2017-05-12 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007770#comment-16007770 ] huxi commented on KAFKA-5222: - You sure you see it when the broker is running instead of being shutdown? >

[jira] [Commented] (KAFKA-5221) Kafka Consumer Attached to partition but not consuming messages

2017-05-12 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007766#comment-16007766 ] huxi commented on KAFKA-5221: - [~manyu_aditya] How many partitions are subscribed by the consumer instance

[jira] [Commented] (KAFKA-5200) Deleting topic when one broker is down will prevent topic to be re-creatable

2017-05-12 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007757#comment-16007757 ] huxi commented on KAFKA-5200: - Alternatively, you could start up that broker before the deleting operation

[jira] [Commented] (KAFKA-5222) Kafka Connection error in contoller.logs

2017-05-12 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007742#comment-16007742 ] huxi commented on KAFKA-5222: - Did you set `broker.id` in server.properties? I wonder where the `Connection to

[jira] [Comment Edited] (KAFKA-5200) Deleting topic when one broker is down will prevent topic to be re-creatable

2017-05-09 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002107#comment-16002107 ] huxi edited comment on KAFKA-5200 at 5/9/17 6:15 AM: - Could add a parameter for

[jira] [Commented] (KAFKA-5200) Deleting topic when one broker is down will prevent topic to be re-creatable

2017-05-09 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002107#comment-16002107 ] huxi commented on KAFKA-5200: - Could add parameter for kafka-reassign-partitions script to forcibly reassign

[jira] [Commented] (KAFKA-5178) Potential Performance Degradation in Kafka Producer when using Multiple Threads

2017-05-05 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998316#comment-15998316 ] huxi commented on KAFKA-5178: - I suggest splitting the test into multiple sub-testings in order to find out

[jira] [Commented] (KAFKA-5177) Automatic creation of topic prompts warnings into console

2017-05-05 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997932#comment-15997932 ] huxi commented on KAFKA-5177: - Seems this should be a transient warning log meaning clients fails to find

[jira] [Commented] (KAFKA-5177) Default quick start config prompts warnings into console

2017-05-04 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997692#comment-15997692 ] huxi commented on KAFKA-5177: - Did you create topic `test` before issuing kafka--console-producer script? >

[jira] [Commented] (KAFKA-5153) KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting

2017-05-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994197#comment-15994197 ] huxi commented on KAFKA-5153: - Could you set `replica.lag.time.max.ms`, `replica.fetch.wait.max.ms` to larger

[jira] [Comment Edited] (KAFKA-5155) Messages can be deleted prematurely when some producers use timestamps and some not

2017-05-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994177#comment-15994177 ] huxi edited comment on KAFKA-5155 at 5/3/17 2:27 AM: - This is very similar with a jira

[jira] [Commented] (KAFKA-5155) Messages can be deleted prematurely when some producers use timestamps and some not

2017-05-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994177#comment-15994177 ] huxi commented on KAFKA-5155: - This is very similar with a jira

[jira] [Assigned] (KAFKA-5161) reassign-partitions to check if broker of ID exists in cluster

2017-05-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5161: --- Assignee: huxi > reassign-partitions to check if broker of ID exists in cluster >

[jira] [Created] (KAFKA-5143) Windows platform does not offer kafka-broker-api-versions.bat

2017-04-29 Thread huxi (JIRA)
huxi created KAFKA-5143: --- Summary: Windows platform does not offer kafka-broker-api-versions.bat Key: KAFKA-5143 URL: https://issues.apache.org/jira/browse/KAFKA-5143 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-4879) KafkaConsumer.position may hang forever when deleting a topic

2017-04-25 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982598#comment-15982598 ] huxi commented on KAFKA-4879: - [~guozhang] What about KafkaConsumer.pollOnce? Does running time of

[jira] [Assigned] (KAFKA-5118) Improve message for Kafka failed startup with non-Kafka data in data.dirs

2017-04-24 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5118: --- Assignee: huxi > Improve message for Kafka failed startup with non-Kafka data in data.dirs >

[jira] [Comment Edited] (KAFKA-5118) Improve message for Kafka failed startup with non-Kafka data in data.dirs

2017-04-24 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982092#comment-15982092 ] huxi edited comment on KAFKA-5118 at 4/25/17 1:12 AM: -- I remember 0.10.2.0 checks

[jira] [Commented] (KAFKA-5118) Improve message for Kafka failed startup with non-Kafka data in data.dirs

2017-04-24 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982092#comment-15982092 ] huxi commented on KAFKA-5118: - I remember 0.10.2.0 checks whether the directory name contains the dash before

[jira] [Commented] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

2017-04-24 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980835#comment-15980835 ] huxi commented on KAFKA-4295: - [~ijuma] Are we going to continue to fix this issue since KIP 109 is planned

[jira] [Commented] (KAFKA-4592) Kafka Producer Metrics Invalid Value

2017-04-24 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980818#comment-15980818 ] huxi commented on KAFKA-4592: - [~ijuma] What's the status for this jira after you said you need a discussion

[jira] [Assigned] (KAFKA-5091) ReassignPartitionsCommand should protect against empty replica list assignment

2017-04-23 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5091: --- Assignee: huxi > ReassignPartitionsCommand should protect against empty replica list > assignment >

[jira] [Assigned] (KAFKA-5104) DumpLogSegments should not open index files with `rw`

2017-04-23 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5104: --- Assignee: huxi > DumpLogSegments should not open index files with `rw` >

[jira] [Commented] (KAFKA-5007) Kafka Replica Fetcher Thread- Resource Leak

2017-04-18 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972314#comment-15972314 ] huxi commented on KAFKA-5007: - Maybe a complete stack trace is helpful to diagnose what action throws this

[jira] [Commented] (KAFKA-5010) Log cleaner crashed with BufferOverflowException when writing to the writeBuffer

2017-04-17 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972081#comment-15972081 ] huxi commented on KAFKA-5010: - [~ijuma] Is it due to the fact that Kafka chooses 1024 as the minimum block

[jira] [Assigned] (KAFKA-5068) Optionally print out metrics after running the perf tests

2017-04-16 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-5068: --- Assignee: huxi > Optionally print out metrics after running the perf tests >

[jira] [Commented] (KAFKA-5068) Optionally print out metrics after running the perf tests

2017-04-14 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968805#comment-15968805 ] huxi commented on KAFKA-5068: - Seems ProducerPerformance does print the final result for the test. >

[jira] [Commented] (KAFKA-5062) Kafka brokers can accept malformed requests which allocate gigabytes of memory

2017-04-12 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967026#comment-15967026 ] huxi commented on KAFKA-5062: - I am intrigued by how to reproduce the problem. > Kafka brokers can accept

[jira] [Commented] (KAFKA-5048) kafka brokers hang when one of broker node killed in the cluster and remaining broker nodes are not consuming the data.

2017-04-12 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965622#comment-15965622 ] huxi commented on KAFKA-5048: - These warnings should be transient as long as you set the replication.factor.

[jira] [Commented] (KAFKA-4987) Topic creation allows invalid config values on running brokers

2017-03-30 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950237#comment-15950237 ] huxi commented on KAFKA-4987: - Did you use a higher version of client talking to a lower version of broker? >

[jira] [Commented] (KAFKA-4952) ZkUtils get topics by consumer group not correct

2017-03-27 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944500#comment-15944500 ] huxi commented on KAFKA-4952: - [~zxylvlp] All subscribed topics' names will be created as a child znode under

[jira] [Comment Edited] (KAFKA-4949) Calling kaka-consumer-group.sh to get the consumer offset throws OOM with heap space error

2017-03-26 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942584#comment-15942584 ] huxi edited comment on KAFKA-4949 at 3/27/17 3:30 AM: -- Is it a duplicate of

[jira] [Commented] (KAFKA-4949) Calling kaka-consumer-group.sh to get the consumer offset throws OOM with heap space error

2017-03-26 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942584#comment-15942584 ] huxi commented on KAFKA-4949: - Is is a duplicate of

[jira] [Commented] (KAFKA-4908) consumer.properties logging warnings

2017-03-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932099#comment-15932099 ] huxi commented on KAFKA-4908: - `zookeeper.connection.timeout.ms` and `zookeeper.connect` are old consumer's

[jira] [Commented] (KAFKA-4879) KafkaConsumer.position may hang forever when deleting a topic

2017-03-09 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904322#comment-15904322 ] huxi commented on KAFKA-4879: - Could have KafkaConsumer#updateFetchPositions, Fetcher#updateFetchPositions,

[jira] [Assigned] (KAFKA-4866) Kafka console consumer property is ignored

2017-03-08 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4866: --- Assignee: huxi > Kafka console consumer property is ignored > -- > >

[jira] [Commented] (KAFKA-4834) Kafka cannot delete topic with ReplicaStateMachine went wrong

2017-03-06 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898790#comment-15898790 ] huxi commented on KAFKA-4834: - Did you delete the zookeeper nodes manually before issuing this delete topics?

[jira] [Commented] (KAFKA-4844) kafka is holding open file descriptors

2017-03-05 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896815#comment-15896815 ] huxi commented on KAFKA-4844: - What is your OS version? Seems it's a known behavior before NFS 4. > kafka is

[jira] [Commented] (KAFKA-4834) Kafka cannot delete topic with ReplicaStateMachine went wrong

2017-03-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893619#comment-15893619 ] huxi commented on KAFKA-4834: - How did you delete the topic? Seems the partitions' state is still Online which

[jira] [Commented] (KAFKA-4822) Kafka producer implementation without additional threads, similar to sync producer of 0.8.

2017-03-01 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889871#comment-15889871 ] huxi commented on KAFKA-4822: - For KafkaProducer, all writes are asynchronous by default. Snippets below

[jira] [Assigned] (KAFKA-4811) ReplicaFetchThread may fail to create due to existing metric

2017-02-27 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4811: --- Assignee: huxi > ReplicaFetchThread may fail to create due to existing metric >

[jira] [Commented] (KAFKA-4811) ReplicaFetchThread may fail to create due to existing metric

2017-02-27 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887308#comment-15887308 ] huxi commented on KAFKA-4811: - [~junrao] what about the port change? Do we also need to consider this

[jira] [Comment Edited] (KAFKA-4762) Consumer throwing RecordTooLargeException even when messages are not that large

2017-02-21 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877641#comment-15877641 ] huxi edited comment on KAFKA-4762 at 2/22/17 7:16 AM: -- [~huadongliu] The reason you

[jira] [Commented] (KAFKA-4762) Consumer throwing RecordTooLargeException even when messages are not that large

2017-02-21 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877641#comment-15877641 ] huxi commented on KAFKA-4762: - [~huadongliu] The reason you saw `NoCompressionCodec` in the output is because

[jira] [Assigned] (KAFKA-4767) KafkaProducer is not joining its IO thread properly

2017-02-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4767: --- Assignee: huxi > KafkaProducer is not joining its IO thread properly >

[jira] [Commented] (KAFKA-4780) ReplicaFetcherThread.fetch could not get any reponse

2017-02-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15873942#comment-15873942 ] huxi commented on KAFKA-4780: - Seems it is a duplicate of

[jira] [Commented] (KAFKA-4767) KafkaProducer is not joining its IO thread properly

2017-02-16 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15870055#comment-15870055 ] huxi commented on KAFKA-4767: - What do you mean by "leaking the IO thread"? Do you mean it could not be shut

[jira] [Commented] (KAFKA-4767) KafkaProducer is not joining its IO thread properly

2017-02-15 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869382#comment-15869382 ] huxi commented on KAFKA-4767: - I think I might get the point of what you mean. What you really concerns is

[jira] [Commented] (KAFKA-4767) KafkaProducer is not joining its IO thread properly

2017-02-15 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868943#comment-15868943 ] huxi commented on KAFKA-4767: - Seems that KafkaProducer already initiates a close to the IO thread by setting

[jira] [Comment Edited] (KAFKA-4762) Consumer throwing RecordTooLargeException even when messages are not that large

2017-02-15 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864954#comment-15864954 ] huxi edited comment on KAFKA-4762 at 2/15/17 9:17 AM: -- Logs show that you are using

[jira] [Commented] (KAFKA-4762) Consumer throwing RecordTooLargeException even when messages are not that large

2017-02-13 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864954#comment-15864954 ] huxi commented on KAFKA-4762: - Logs show that you are using 0.10.x where max.partition.fetch.bytes is a hard

[jira] [Commented] (KAFKA-4739) KafkaConsumer poll going into an infinite loop

2017-02-06 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855232#comment-15855232 ] huxi commented on KAFKA-4739: - Seems that FETCH requests time out every 40 seconds and 40 second is the

[jira] [Assigned] (KAFKA-4727) A Production server configuration needs to be updated

2017-02-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4727: --- Assignee: huxi > A Production server configuration needs to be updated >

[jira] [Commented] (KAFKA-4685) All partitions offline, no conroller znode in ZK

2017-01-23 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834169#comment-15834169 ] huxi commented on KAFKA-4685: - Server logs showed that all the brokers have come back to register in ZK again.

[jira] [Updated] (KAFKA-4684) Kafka does not offer kafka-configs.bat on Windows box

2017-01-23 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi updated KAFKA-4684: Labels: newbie (was: ) > Kafka does not offer kafka-configs.bat on Windows box >

[jira] [Comment Edited] (KAFKA-4669) KafkaProducer.flush hangs when NetworkClient.handleCompletedReceives throws exception

2017-01-23 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834053#comment-15834053 ] huxi edited comment on KAFKA-4669 at 1/23/17 8:25 AM: -- Maybe we could invoke an

[jira] [Commented] (KAFKA-4669) KafkaProducer.flush hangs when NetworkClient.handleCompletedReceives throws exception

2017-01-23 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834053#comment-15834053 ] huxi commented on KAFKA-4669: - Maybe we could invoke an alternative method `ProduceRequestResult#await(long,

[jira] [Comment Edited] (KAFKA-4675) Subsequent CreateTopic command could be lost after a DeleteTopic command

2017-01-21 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1586#comment-1586 ] huxi edited comment on KAFKA-4675 at 1/22/17 7:26 AM: -- Failed to reproduce this issue

[jira] [Commented] (KAFKA-4675) Subsequent CreateTopic command could be lost after a DeleteTopic command

2017-01-21 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1586#comment-1586 ] huxi commented on KAFKA-4675: - Failed to reproduce this issue with snippet below: {code} val zkUtils =

[jira] [Created] (KAFKA-4684) Kafka does not offer kafka-configs.bat on Windows box

2017-01-21 Thread huxi (JIRA)
huxi created KAFKA-4684: --- Summary: Kafka does not offer kafka-configs.bat on Windows box Key: KAFKA-4684 URL: https://issues.apache.org/jira/browse/KAFKA-4684 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-4680) min.insync.replicas can be set higher than replication factor

2017-01-20 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832729#comment-15832729 ] huxi commented on KAFKA-4680: - If sending records to a topic with a larger 'min.insync.replicas' than

[jira] [Commented] (KAFKA-4675) Subsequent CreateTopic command could be lost after a DeleteTopic command

2017-01-20 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15831945#comment-15831945 ] huxi commented on KAFKA-4675: - Seems deleting '/brokers/topics/' comes fourth from the bottom during the

[jira] [Updated] (KAFKA-4592) Kafka Producer Metrics Invalid Value

2017-01-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi updated KAFKA-4592: Reviewer: Ismael Juma > Kafka Producer Metrics Invalid Value > > >

[jira] [Updated] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

2017-01-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi updated KAFKA-4295: Reviewer: Ismael Juma > kafka-console-consumer.sh does not delete the temporary group in zookeeper >

[jira] [Commented] (KAFKA-4674) Frequent ISR shrinking and expanding and disconnects among brokers

2017-01-19 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829525#comment-15829525 ] huxi commented on KAFKA-4674: - Is it a duplicate of

[jira] [Comment Edited] (KAFKA-4629) Per topic MBeans leak

2017-01-16 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825545#comment-15825545 ] huxi edited comment on KAFKA-4629 at 1/17/17 6:48 AM: -- Thanks for

[jira] [Comment Edited] (KAFKA-4629) Per topic MBeans leak

2017-01-16 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825545#comment-15825545 ] huxi edited comment on KAFKA-4629 at 1/17/17 6:41 AM: -- Thanks for

[jira] [Commented] (KAFKA-4629) Per topic MBeans leak

2017-01-16 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825545#comment-15825545 ] huxi commented on KAFKA-4629: - Thanks for [~alberto.fo...@natwestmarkets.com]'s response. After some

[jira] [Comment Edited] (KAFKA-4629) Per topic MBeans leak

2017-01-16 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823329#comment-15823329 ] huxi edited comment on KAFKA-4629 at 1/16/17 9:36 AM: --

[jira] [Commented] (KAFKA-4595) Controller send thread can't stop when broker change listener event trigger for dead brokers

2017-01-16 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823594#comment-15823594 ] huxi commented on KAFKA-4595: - [~pengwei] I don't think it's doable since it would leave inconsistent states

[jira] [Commented] (KAFKA-4557) ConcurrentModificationException in KafkaProducer event loop

2017-01-15 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823399#comment-15823399 ] huxi commented on KAFKA-4557: - [~scf37] Did you create your own Sender instances in the producer code? >

[jira] [Commented] (KAFKA-4577) NPE in ControllerChannelManager.scala::addUpdateMetadataRequestForBrokers

2017-01-15 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823347#comment-15823347 ] huxi commented on KAFKA-4577: - I suspect the TopicDeletionManager instance in KafkaController is null although

[jira] [Commented] (KAFKA-4629) Per topic MBeans leak

2017-01-15 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823329#comment-15823329 ] huxi commented on KAFKA-4629: - [~alberto.fo...@natwestmarkets.com] Yes, multiple brokers DOES help reproducing

[jira] [Commented] (KAFKA-4629) Per topic MBeans leak

2017-01-14 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823029#comment-15823029 ] huxi commented on KAFKA-4629: - I tried in my kafka0.10.0.1 single-broker test environment with no luck to

[jira] [Commented] (KAFKA-4616) Message loss is seen when kafka-producer-perf-test.sh is running and any broker restarted in middle

2017-01-13 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821473#comment-15821473 ] huxi commented on KAFKA-4616: - They are not missing, but are just not delivered to Kafka successfully. bq. The

[jira] [Commented] (KAFKA-4616) Message log is seen when kafka-producer-perf-test.sh is running and any broker restarted in middle in-between

2017-01-11 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820267#comment-15820267 ] huxi commented on KAFKA-4616: - Appending acks option to the command as this: --producer-props

[jira] [Commented] (KAFKA-4616) Message log is seen when kafka-producer-perf-test.sh is running and any broker restarted in middle in-between

2017-01-11 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817886#comment-15817886 ] huxi commented on KAFKA-4616: - Could you set acks = -1 and retry the producer to see if there still exists

[jira] [Comment Edited] (KAFKA-4614) Long GC pause harming broker performance which is caused by mmap objects created for OffsetIndex

2017-01-11 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817849#comment-15817849 ] huxi edited comment on KAFKA-4614 at 1/11/17 10:00 AM: --- Great catch for the whole

[jira] [Commented] (KAFKA-4614) Long GC pause harming broker performance which is caused by mmap objects created for OffsetIndex

2017-01-11 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817849#comment-15817849 ] huxi commented on KAFKA-4614: - Great catch for the whole things. As for the unmap things, seems there is no

[jira] [Commented] (KAFKA-4603) argument error,and command parsed error

2017-01-06 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803933#comment-15803933 ] huxi commented on KAFKA-4603: - [~auroraxlh] If you exactly type '--zookeeper.connect' the command could run

[jira] [Commented] (KAFKA-4595) Controller send thread can't stop when broker change listener event trigger for dead brokers

2017-01-05 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803804#comment-15803804 ] huxi commented on KAFKA-4595: - Yes, seems that the process might look like this: 1. At some point of time,

[jira] [Commented] (KAFKA-4599) KafkaConsumer encounters SchemaException when Kafka broker stopped

2017-01-05 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803315#comment-15803315 ] huxi commented on KAFKA-4599: - What kind of Storm-supplied kafka client do you use? storm-kafka or

[jira] [Comment Edited] (KAFKA-4592) Kafka Producer Metrics Invalid Value

2017-01-05 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801348#comment-15801348 ] huxi edited comment on KAFKA-4592 at 1/5/17 2:36 PM: - Seems that

[jira] [Assigned] (KAFKA-4592) Kafka Producer Metrics Invalid Value

2017-01-05 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4592: --- Assignee: huxi > Kafka Producer Metrics Invalid Value > > >

[jira] [Comment Edited] (KAFKA-4592) Kafka Producer Metrics Invalid Value

2017-01-05 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801348#comment-15801348 ] huxi edited comment on KAFKA-4592 at 1/5/17 1:31 PM: - Seems that

[jira] [Reopened] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

2017-01-04 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reopened KAFKA-4295: - > kafka-console-consumer.sh does not delete the temporary group in zookeeper >

[jira] [Resolved] (KAFKA-4434) KafkaProducer configuration is logged twice

2017-01-04 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi resolved KAFKA-4434. - Resolution: Fixed Reviewer: Ismael Juma > KafkaProducer configuration is logged twice >

[jira] [Assigned] (KAFKA-3739) Add no-arg constructor for library provided serdes

2017-01-04 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-3739: --- Assignee: huxi > Add no-arg constructor for library provided serdes >

[jira] [Resolved] (KAFKA-4308) Inconsistent parameters between console producer and consumer

2017-01-03 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi resolved KAFKA-4308. - Resolution: Duplicate > Inconsistent parameters between console producer and consumer >

[jira] [Assigned] (KAFKA-4434) KafkaProducer configuration is logged twice

2017-01-03 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4434: --- Assignee: huxi (was: kevin.chen) > KafkaProducer configuration is logged twice >

[jira] [Commented] (KAFKA-4576) Log segments close to max size break on fetch

2017-01-03 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15795040#comment-15795040 ] huxi commented on KAFKA-4576: - If we use a loop structure to collect all the 12 bytes, there is a possibility

[jira] [Commented] (KAFKA-4576) Log segments close to max size break on fetch

2017-01-02 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794042#comment-15794042 ] huxi commented on KAFKA-4576: - Seems FileChannel.read does not fill up the 12-byte buffer although there are

[jira] [Commented] (KAFKA-4577) NPE in ControllerChannelManager.scala::addUpdateMetadataRequestForBrokers

2016-12-31 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15790517#comment-15790517 ] huxi commented on KAFKA-4577: - Could you elaborate on the steps you ran into this problem? > NPE in

[jira] [Comment Edited] (KAFKA-4577) NPE in ControllerChannelManager.scala::addUpdateMetadataRequestForBrokers

2016-12-31 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15790517#comment-15790517 ] huxi edited comment on KAFKA-4577 at 1/1/17 4:26 AM: - Could you elaborate on the steps

[jira] [Commented] (KAFKA-4573) Producer sporadic timeout

2016-12-28 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784692#comment-15784692 ] huxi commented on KAFKA-4573: - Is it possible it's caused by a transient network error? > Producer sporadic

  1   2   >