[jira] [Created] (KAFKA-3145) CPU Usage Spike to 100% when network connection is error

zhiwei created KAFKA-3145: - Summary: CPU Usage Spike to 100% when network connection is error Key: KAFKA-3145 URL: https://issues.apache.org/jira/browse/KAFKA-3145 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-1332) Add functionality to the offsetsBeforeTime() API

[ https://issues.apache.org/jira/browse/KAFKA-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115030#comment-15115030 ] Robert Metzger commented on KAFKA-1332: --- A Flink user recently requested support for

[jira] [Updated] (KAFKA-3145) CPU Usage Spike to 100% when network connection is to error port

[ https://issues.apache.org/jira/browse/KAFKA-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhiwei updated KAFKA-3145: -- Description: CPU spike to 100% when network connection is to error port. It seems network IO thread are very bu

[jira] [Commented] (KAFKA-3076) BrokerChangeListener should log the brokers in order

[ https://issues.apache.org/jira/browse/KAFKA-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115060#comment-15115060 ] ASF GitHub Bot commented on KAFKA-3076: --- Github user konradkalita closed the pull re

[GitHub] kafka pull request: KAFKA-3076: BrokerChangeListener should log th...

Github user konradkalita closed the pull request at: https://github.com/apache/kafka/pull/749 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3076) BrokerChangeListener should log the brokers in order

[ https://issues.apache.org/jira/browse/KAFKA-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115061#comment-15115061 ] ASF GitHub Bot commented on KAFKA-3076: --- GitHub user konradkalita reopened a pull re

[GitHub] kafka pull request: KAFKA-3076: BrokerChangeListener should log th...

GitHub user konradkalita reopened a pull request: https://github.com/apache/kafka/pull/749 KAFKA-3076: BrokerChangeListener should log the brokers in order You can merge this pull request into a Git repository by running: $ git pull https://github.com/konradkalita/kafka kafka-

[jira] [Assigned] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konrad Kalita reassigned KAFKA-3144: Assignee: Konrad Kalita > report members with no assigned partitions in ConsumerGroupComman

[jira] [Created] (KAFKA-3146) Stuck consumer with new consumer API in 0.9

Han JU created KAFKA-3146: - Summary: Stuck consumer with new consumer API in 0.9 Key: KAFKA-3146 URL: https://issues.apache.org/jira/browse/KAFKA-3146 Project: Kafka Issue Type: Bug Compone

[jira] [Updated] (KAFKA-3146) Stuck consumer with new consumer API in 0.9

[ https://issues.apache.org/jira/browse/KAFKA-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3146: --- Assignee: Jason Gustafson (was: Neha Narkhede) > Stuck consumer with new consumer API in 0.9 > --

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115594#comment-15115594 ] Jun Rao commented on KAFKA-3144: Also, currently, when using the --new-consumer option, if

Re: [VOTE] KIP-36 - Rack aware replica assignment

There are 4 binding +1 and 4 non-binding +1. Shall we consider the proposal accepted? On Tue, Jan 19, 2016 at 11:33 AM, Joel Koshy wrote: > +1 (binding) > > On Tue, Jan 19, 2016 at 10:31 AM, Aditya Auradkar < > aaurad...@linkedin.com.invalid> wrote: > > > +1 (non-binding) > > > > On Tue, Ja

Re: [VOTE] KIP-36 - Rack aware replica assignment

Yes. Thanks for driving this. On Mon, Jan 25, 2016 at 9:42 AM, Allen Wang wrote: > There are 4 binding +1 and 4 non-binding +1. Shall we consider the proposal > accepted? > > > > > > > On Tue, Jan 19, 2016 at 11:33 AM, Joel Koshy wrote: > > > +1 (binding) > > > > On Tue, Jan 19, 2016 at 10:31 A

Re: [VOTE] KIP-36 - Rack aware replica assignment

Cool. Thank you all for comments and participation. On Mon, Jan 25, 2016 at 9:43 AM, Neha Narkhede wrote: > Yes. Thanks for driving this. > > On Mon, Jan 25, 2016 at 9:42 AM, Allen Wang wrote: > > > There are 4 binding +1 and 4 non-binding +1. Shall we consider the > proposal > > accepted? > >

[jira] [Commented] (KAFKA-3068) NetworkClient may connect to a different Kafka cluster than originally configured

[ https://issues.apache.org/jira/browse/KAFKA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115702#comment-15115702 ] Jun Rao commented on KAFKA-3068: [~ewencp], having a pluggable discovery service may be re

[jira] [Commented] (KAFKA-3146) Stuck consumer with new consumer API in 0.9

[ https://issues.apache.org/jira/browse/KAFKA-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115708#comment-15115708 ] Jason Gustafson commented on KAFKA-3146: [~darkjh] You need to commit offsets regu

[jira] [Commented] (KAFKA-1332) Add functionality to the offsetsBeforeTime() API

[ https://issues.apache.org/jira/browse/KAFKA-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115744#comment-15115744 ] Jiangjie Qin commented on KAFKA-1332: - This ticket seems a subset of KAFKA-2076, where

[jira] [Updated] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.

[ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-2076: Issue Type: Sub-task (was: Improvement) Parent: KAFKA-1326 > Add an API to new consumer to

[jira] [Commented] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.

[ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115762#comment-15115762 ] Jay Kreps commented on KAFKA-2076: -- I think that makes sense. Is there other per-partitio

[jira] [Updated] (KAFKA-3129) Potential Console Producer/Consumer Issue

[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-3129: --- Attachment: kafka-3129.mov The observed behavior is different between when the producer is run

[jira] [Comment Edited] (KAFKA-3129) Potential Console Producer/Consumer Issue

[ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115773#comment-15115773 ] Vahid Hashemian edited comment on KAFKA-3129 at 1/25/16 7:02 PM: ---

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Hey Becket, Yeah this is really similar to the callback. The difference is really in who sets the behavior. The idea of the interceptor is that it doesn't require any code change in apps so you can globally add behavior to your Kafka usage without changing app code. Whereas the callback is added b

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Great idea. I’ve been talking about this for 2 years, and I’m glad someone is finally picking it up. Will take a look at the KIP at some point shortly. -Todd On Mon, Jan 25, 2016 at 11:24 AM, Jay Kreps wrote: > Hey Becket, > > Yeah this is really similar to the callback. The difference is real

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Nice KIP. Excellent idea. Was just thinking if we can add onDequed() to the ProducerIterceptor interface. Since we have the onEnqueued(), it will help the client or the tools to know how much time the message spent in the RecordAccumulator. Also an API to check if there are any messages left for a

[jira] [Created] (KAFKA-3147) Memory records is not writable in MirrorMaker

Meghana Narasimhan created KAFKA-3147: - Summary: Memory records is not writable in MirrorMaker Key: KAFKA-3147 URL: https://issues.apache.org/jira/browse/KAFKA-3147 Project: Kafka Issue T

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115971#comment-15115971 ] Federico Fissore commented on KAFKA-2985: - [~hachikuji] I've just run my test agai

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

I'm definitely in favor of having such hooks in the produce/consume life-cycle. Not sure if people remember this but in Kafka 0.7 this was pretty much how it was: https://github.com/apache/kafka/blob/0.7/core/src/main/scala/kafka/producer/async/CallbackHandler.scala i.e., we had something similar t

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115988#comment-15115988 ] Jason Gustafson commented on KAFKA-2985: [~fridrik] Thanks for the update. The 20

[jira] [Created] (KAFKA-3148) SslSelectorTest.testRenegotiation can hang on slow boxes

Robert Joseph Evans created KAFKA-3148: -- Summary: SslSelectorTest.testRenegotiation can hang on slow boxes Key: KAFKA-3148 URL: https://issues.apache.org/jira/browse/KAFKA-3148 Project: Kafka

[jira] [Updated] (KAFKA-3148) SslSelectorTest.testRenegotiation can hang on slow boxes

[ https://issues.apache.org/jira/browse/KAFKA-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated KAFKA-3148: --- Component/s: clients > SslSelectorTest.testRenegotiation can hang on slow boxes >

[jira] [Updated] (KAFKA-3148) SslSelectorTest.testRenegotiation can hang on slow boxes

[ https://issues.apache.org/jira/browse/KAFKA-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated KAFKA-3148: --- Affects Version/s: 0.9.0.0 > SslSelectorTest.testRenegotiation can hang on slow boxes

[jira] [Commented] (KAFKA-3148) SslSelectorTest.testRenegotiation can hang on slow boxes

[ https://issues.apache.org/jira/browse/KAFKA-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116072#comment-15116072 ] Robert Joseph Evans commented on KAFKA-3148: I created some code that can show

[GitHub] kafka pull request: MINOR: add equals and hashCode to Windowed

GitHub user ymatsuda opened a pull request: https://github.com/apache/kafka/pull/808 MINOR: add equals and hashCode to Windowed @guozhangwang You can merge this pull request into a Git repository by running: $ git pull https://github.com/ymatsuda/kafka windowed_key Alternati

[jira] [Created] (KAFKA-3149) Extend SASL implementation to support more mechanisms

Rajini Sivaram created KAFKA-3149: - Summary: Extend SASL implementation to support more mechanisms Key: KAFKA-3149 URL: https://issues.apache.org/jira/browse/KAFKA-3149 Project: Kafka Issue T

[jira] [Updated] (KAFKA-2658) Implement SASL/PLAIN

[ https://issues.apache.org/jira/browse/KAFKA-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2658: -- Status: Open (was: Patch Available) This will be rebased on the changes from KAFKA-3149 after K

kafka-consumer-groups.sh doesn't work when consumers are off

I'm running into a few challenges trying to evaluate offsets and lag (pending message count) in the new Java KafkaConsumer. The old ConsumerOffsetChecker doesn't work anymore since the offsets aren't stored in zookeeper after switching from the old consumer. This would be fine, but the kafka-cons

[DISCUSS] KIP-43: Kafka SASL enhancements

I have just created KIP-43 to extend the SASL implementation in Kafka to support new SASL mechanisms. https://cwiki.apache.org/confluence/display/KAFKA/KIP-43%3A+Kafka+SASL+enhancements Comments and suggestions are appreciated. Thank you... Regards, Rajini

[jira] [Commented] (KAFKA-3006) Make collection default container type for sequences in the consumer API

[ https://issues.apache.org/jira/browse/KAFKA-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116177#comment-15116177 ] Pierre-Yves Ritschard commented on KAFKA-3006: -- Can anyone help with the conf

[jira] [Updated] (KAFKA-3076) BrokerChangeListener should log the brokers in order

[ https://issues.apache.org/jira/browse/KAFKA-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-3076: --- Resolution: Fixed Fix Version/s: 0.9.1.0 Status: Resolved (was: Patch Available) Issue reso

[GitHub] kafka pull request: KAFKA-3076: BrokerChangeListener should log th...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/749 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-3076) BrokerChangeListener should log the brokers in order

[ https://issues.apache.org/jira/browse/KAFKA-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116228#comment-15116228 ] ASF GitHub Bot commented on KAFKA-3076: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-3123) Follower Broker cannot start if offsets are already out of range

[ https://issues.apache.org/jira/browse/KAFKA-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116239#comment-15116239 ] Grant Henke commented on KAFKA-3123: [~soumyajitsahu] Would you be willing to submit t

Kafka KIP meeting Jan 26 at 11:00am PST

Hi, Everyone, We will have a Kafka KIP meeting tomorrow at 11:00am PST. If you plan to attend but haven't received an invite, please let me know. The following is the agenda. Agenda: KIP-42: Add Producer and Consumer Interceptors Thanks, Jun

[jira] [Commented] (KAFKA-2772) Stabilize replication hard bounce test

[ https://issues.apache.org/jira/browse/KAFKA-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116245#comment-15116245 ] Grant Henke commented on KAFKA-2772: [~geoffra] Was this ever resolved? Or was the roo

[jira] [Commented] (KAFKA-2704) SimpleConsumer should throw InterruptedException when interrupted

[ https://issues.apache.org/jira/browse/KAFKA-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116249#comment-15116249 ] Grant Henke commented on KAFKA-2704: [~htshozawa] Would you be willing to submit the p

[jira] [Updated] (KAFKA-2676) AclCommandTest has wrong package name

[ https://issues.apache.org/jira/browse/KAFKA-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2676: --- Labels: newbie (was: ) There are a few other classes like that. It would be good to have them all fixed in t

[GitHub] kafka pull request: KAFKA-3100; Broker.createBroker should work if...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/773 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-3100) Broker.createBroker should work if json is version > 2, but still compatible

[ https://issues.apache.org/jira/browse/KAFKA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-3100: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 773 [https:/

[jira] [Commented] (KAFKA-3100) Broker.createBroker should work if json is version > 2, but still compatible

[ https://issues.apache.org/jira/browse/KAFKA-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116257#comment-15116257 ] ASF GitHub Bot commented on KAFKA-3100: --- Github user asfgit closed the pull request

[jira] [Assigned] (KAFKA-3132) URI scheme in "listeners" property should not be case-sensitive

[ https://issues.apache.org/jira/browse/KAFKA-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reassigned KAFKA-3132: -- Assignee: Grant Henke > URI scheme in "listeners" property should not be case-sensitive > -

Build failed in Jenkins: kafka-trunk-jdk7 #987

See Changes: [junrao] KAFKA-3076; BrokerChangeListener should log the brokers in order [junrao] KAFKA-3100; Broker.createBroker should work if json is version > 2 and -- Started by an SCM change

Jenkins build is back to normal : kafka-trunk-jdk8 #313

See

Build failed in Jenkins: kafka-trunk-jdk8 #314

See Changes: [junrao] KAFKA-3100; Broker.createBroker should work if json is version > 2 and -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11

[GitHub] kafka pull request: MINOR: add equals and hashCode to Windowed

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/808 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] kafka pull request: KAFKA-3125: Add Kafka Streams Exceptions

GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/809 KAFKA-3125: Add Kafka Streams Exceptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka K3125 Alternatively you can rev

[jira] [Commented] (KAFKA-3125) Exception Hierarchy for Streams

[ https://issues.apache.org/jira/browse/KAFKA-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116358#comment-15116358 ] ASF GitHub Bot commented on KAFKA-3125: --- GitHub user guozhangwang opened a pull requ

Build failed in Jenkins: kafka-trunk-jdk7 #988

See Changes: [wangguoz] MINOR: add equals and hashCode to Windowed -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (docker Ubuntu ubuntu yah

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Hi Mayuresh, I agree that onDequeue() callback in ProducerInterceptor would be useful. The API of this callback needs discussion. I propose the following API: public void onDequeued(TopicPartition tp, long appendTime, int attempts, bool moreQueued); This callback will be called for every record

[jira] [Updated] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat updated KAFKA-3126: --- Assignee: (was: Mayuresh Gharat) > Weird behavior in kafkaController on Controlled shutdow

[jira] [Commented] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116427#comment-15116427 ] Ismael Juma commented on KAFKA-3126: What was the conclusion here, is it an actual pro

[jira] [Commented] (KAFKA-3126) Weird behavior in kafkaController on Controlled shutdowns. The leaderAndIsr in zookeeper is not updated during controlled shutdown.

[ https://issues.apache.org/jira/browse/KAFKA-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116436#comment-15116436 ] Mayuresh Gharat commented on KAFKA-3126: It does look like a problem with consiste

[jira] [Commented] (KAFKA-3068) NetworkClient may connect to a different Kafka cluster than originally configured

[ https://issues.apache.org/jira/browse/KAFKA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116465#comment-15116465 ] Ewen Cheslack-Postava commented on KAFKA-3068: -- [~junrao] Right, for people u

[jira] [Commented] (KAFKA-2704) SimpleConsumer should throw InterruptedException when interrupted

[ https://issues.apache.org/jira/browse/KAFKA-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116492#comment-15116492 ] Hitoshi Ozawa commented on KAFKA-2704: -- Just looked at the current source and it alre

[jira] [Commented] (KAFKA-3006) Make collection default container type for sequences in the consumer API

[ https://issues.apache.org/jira/browse/KAFKA-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116493#comment-15116493 ] Gwen Shapira commented on KAFKA-3006: - [~pyritschard] - gave you privileges to add pag

[jira] [Commented] (KAFKA-2704) SimpleConsumer should throw InterruptedException when interrupted

[ https://issues.apache.org/jira/browse/KAFKA-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116494#comment-15116494 ] Hitoshi Ozawa commented on KAFKA-2704: -- My mistake - source was not fixed. Will creat

Build failed in Jenkins: kafka-trunk-jdk8 #315

See Changes: [wangguoz] MINOR: add equals and hashCode to Windowed -- [...truncated 1480 lines...] at hudson.scm.SCM.poll(SCM.java:397) at hudson.model.AbstractProject._poll(Abstr

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Hi anna, Agreed, its difficult to match which call of onDequeued() corresponds to onEnqueued(), since ProducerRecord object is not available anymore at the time the batch is dequeued. We currently always update the lastAppendTime whenever we append a record to a batch. We can use that and include

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Hi Mayuresh, Could you please describe a use-case for checking if there are messages in RecordAccumulator for a particular topic? In this KIP, we are proposing interceptor callbacks that will notify things about the message, no query API. It is possible to add certain info in callback API, like 'm

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

I think there is some tension here between exposing lots of hooks that you can implement and giving a simple, supportable interface. Personally I would actually argue for not adding an onDequeued but actually removing both the onEnqueued() and onReceived(). My argument is that onSend and onAcknow

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Hi Joel, Yes, we considered interceptors on broker side -- they make a lot of sense and will add more detail to monitoring. We propose to do it later in a separate KIP because: 1) broker interceptors are more risky, since brokers are more sensitive to overheads; 2) Just producer and consumer inter

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Hey Joel, What is the interface you are thinking of? Something like this: onAppend(String topic, int partition, Records records, long time) ? One challenge right now is that we are still using the old Message/MessageSet classes on the broker which I'm not sure if we'd want to support over the

[jira] [Commented] (KAFKA-3135) Unexpected delay before fetch response transmission

[ https://issues.apache.org/jira/browse/KAFKA-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116561#comment-15116561 ] Jason Gustafson commented on KAFKA-3135: Interestingly, I can reproduce this pause

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116568#comment-15116568 ] Grant Henke commented on KAFKA-3088: [~aauradkar] Are you working on this? > 0.9.0.0

[jira] [Assigned] (KAFKA-3037) Number of alive brokers not known after single node cluster startup

[ https://issues.apache.org/jira/browse/KAFKA-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reassigned KAFKA-3037: -- Assignee: Grant Henke > Number of alive brokers not known after single node cluster startup > -

[jira] [Assigned] (KAFKA-2953) Kafka documentation is really wide

[ https://issues.apache.org/jira/browse/KAFKA-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reassigned KAFKA-2953: -- Assignee: Grant Henke > Kafka documentation is really wide > --

[jira] [Resolved] (KAFKA-2708) 29.10.2015 последний охотник на ведьм 2015 смотреть онлайн полный фильм hd 720

[ https://issues.apache.org/jira/browse/KAFKA-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2708. Resolution: Invalid > 29.10.2015 последний охотник на ведьм 2015 смотреть онлайн полный фильм hd 720

[jira] [Resolved] (KAFKA-2709) марсианин 2015 смотреть онлайн полный фильм hd 720 на !АЙПАД!

[ https://issues.apache.org/jira/browse/KAFKA-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2709. Resolution: Invalid > марсианин 2015 смотреть онлайн полный фильм hd 720 на !АЙПАД! > --

[jira] [Assigned] (KAFKA-2583) Log compaction documentation incorrect

[ https://issues.apache.org/jira/browse/KAFKA-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reassigned KAFKA-2583: -- Assignee: Grant Henke > Log compaction documentation incorrect > --

[GitHub] kafka pull request: KAFKA-2704:Make SimpleConsumer threadsafe

GitHub user ozawa-hi opened a pull request: https://github.com/apache/kafka/pull/810 KAFKA-2704:Make SimpleConsumer threadsafe You can merge this pull request into a Git repository by running: $ git pull https://github.com/ozawa-hi/kafka trunk Alternatively you can review and

[jira] [Resolved] (KAFKA-2583) Log compaction documentation incorrect

[ https://issues.apache.org/jira/browse/KAFKA-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2583. Resolution: Fixed Updated the wiki to match the official docs. > Log compaction documentation inco

[jira] [Commented] (KAFKA-2704) SimpleConsumer should throw InterruptedException when interrupted

[ https://issues.apache.org/jira/browse/KAFKA-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116617#comment-15116617 ] ASF GitHub Bot commented on KAFKA-2704: --- GitHub user ozawa-hi opened a pull request:

[jira] [Resolved] (KAFKA-2520) log.cleaner.min.cleanable.ratio 1 The number of background threads to use for log cleaning.

[ https://issues.apache.org/jira/browse/KAFKA-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2520. Resolution: Not A Problem Assignee: Grant Henke Looks like this was fixed somewhere along the

[jira] [Resolved] (KAFKA-2268) New producer logs WARN if serializer supplied directly to constructor

[ https://issues.apache.org/jira/browse/KAFKA-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2268. Resolution: Duplicate > New producer logs WARN if serializer supplied directly to constructor >

[jira] [Resolved] (KAFKA-2004) Write Kafka messages directly to HDFS

[ https://issues.apache.org/jira/browse/KAFKA-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2004. Resolution: Not A Problem > Write Kafka messages directly to HDFS >

[jira] [Resolved] (KAFKA-1909) VerifiableProperties does not "see" default properties of the wrapped Properties instance

[ https://issues.apache.org/jira/browse/KAFKA-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1909. Resolution: Duplicate > VerifiableProperties does not "see" default properties of the wrapped > Pro

[jira] [Resolved] (KAFKA-2184) ConsumerConfig does not honor default java.util.Properties

[ https://issues.apache.org/jira/browse/KAFKA-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2184. Resolution: Duplicate > ConsumerConfig does not honor default java.util.Properties > ---

[jira] [Assigned] (KAFKA-1909) VerifiableProperties does not "see" default properties of the wrapped Properties instance

[ https://issues.apache.org/jira/browse/KAFKA-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reassigned KAFKA-1909: -- Assignee: Grant Henke > VerifiableProperties does not "see" default properties of the wrapped

[jira] [Assigned] (KAFKA-2184) ConsumerConfig does not honor default java.util.Properties

[ https://issues.apache.org/jira/browse/KAFKA-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reassigned KAFKA-2184: -- Assignee: Grant Henke (was: Neha Narkhede) > ConsumerConfig does not honor default java.util.P

[jira] [Resolved] (KAFKA-1435) Patch review tools sometimes fails to attach a diff

[ https://issues.apache.org/jira/browse/KAFKA-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1435. Resolution: Won't Fix > Patch review tools sometimes fails to attach a diff > --

[jira] [Resolved] (KAFKA-2780) kafka-server-start.sh globbing issue

[ https://issues.apache.org/jira/browse/KAFKA-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2780. Resolution: Duplicate > kafka-server-start.sh globbing issue >

[jira] [Resolved] (KAFKA-426) Hadoop suppor, error in building class path.

[ https://issues.apache.org/jira/browse/KAFKA-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-426. --- Resolution: Won't Fix > Hadoop suppor, error in building class path. >

[jira] [Resolved] (KAFKA-1085) run-class.sh and other shell scripts are copy pasted all over the place

[ https://issues.apache.org/jira/browse/KAFKA-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1085. Resolution: Fixed Assignee: Grant Henke Looks like this was resolved through contrib and syste

[jira] [Resolved] (KAFKA-1340) hadoop-consumer not working with hadoop 2.2.0

[ https://issues.apache.org/jira/browse/KAFKA-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1340. Resolution: Won't Fix Assignee: Grant Henke This code has been removed from the project. > ha

[jira] [Resolved] (KAFKA-934) kafka hadoop consumer and producer use older 0.19.2 hadoop api's

[ https://issues.apache.org/jira/browse/KAFKA-934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-934. --- Resolution: Won't Fix Assignee: Grant Henke (was: Sriharsha Chintalapani) This code has been rem

[GitHub] kafka pull request: KAFKA-3054: Connect Herder fail if sent a wron...

Github user ZoneMayor closed the pull request at: https://github.com/apache/kafka/pull/782 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (KAFKA-3054) Connect Herder fail forever if sent a wrong connector config or task config

[ https://issues.apache.org/jira/browse/KAFKA-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116669#comment-15116669 ] ASF GitHub Bot commented on KAFKA-3054: --- GitHub user ZoneMayor reopened a pull reque

[GitHub] kafka pull request: KAFKA-3054: Connect Herder fail if sent a wron...

GitHub user ZoneMayor reopened a pull request: https://github.com/apache/kafka/pull/782 KAFKA-3054: Connect Herder fail if sent a wrong connector config or task config, catch exceptions to guard The exceptions may propagate to DistributedHerder when start or stop connectors or task

[jira] [Commented] (KAFKA-3054) Connect Herder fail forever if sent a wrong connector config or task config

[ https://issues.apache.org/jira/browse/KAFKA-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116668#comment-15116668 ] ASF GitHub Bot commented on KAFKA-3054: --- Github user ZoneMayor closed the pull reque

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

Anna, I'm also in favor of including just the APIs for which we have a clear use case. If more use cases for finer monitoring show up in the future, we can always update the interface. Would you please highlight in the KIP the APIs that you think we have an immediate use for? Joel, Broker-side m

Request to be added to contributor list

Hi, I am a CS major student. My jira username is chenzhu, can someone please add me to the contributor list? Thank you, Chen Zhu

  1   2   >