Re: Consumption on a explicitly (dynamically) created topic has a 5 minute delay

2017-02-26 Thread Jaikiran Pai
An update on one of the workaround I tried - I added some logic in our consumption part to wait for the KafkaConsumer.partitionsFor() to return the topic name in the list, before actually considering the KafkaConsumer ready to consume/poll the messages. Something like this[1]. This does

[jira] [Updated] (KAFKA-4807) Kafka broker fail over bug in zookeeper

2017-02-26 Thread Mingzhou Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingzhou Zhuang updated KAFKA-4807: --- Description:

[jira] [Created] (KAFKA-4807) Kafka broker fail over bug in zookeeper

2017-02-26 Thread Mingzhou Zhuang (JIRA)
Mingzhou Zhuang created KAFKA-4807: -- Summary: Kafka broker fail over bug in zookeeper Key: KAFKA-4807 URL: https://issues.apache.org/jira/browse/KAFKA-4807 Project: Kafka Issue Type: Bug

[jira] [Work started] (KAFKA-4791) Kafka Streams - unable to add state stores when using wildcard topics on the source

2017-02-26 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4791 started by Bill Bejeck. -- > Kafka Streams - unable to add state stores when using wildcard topics on the >

[jira] [Commented] (KAFKA-4744) Streams_bounce test failing occassionally

2017-02-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884877#comment-15884877 ] ASF GitHub Bot commented on KAFKA-4744: --- GitHub user enothereska opened a pull request:

[GitHub] kafka pull request #2601: KAFKA-4744: Increased timeout for bounce test

2017-02-26 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2601 KAFKA-4744: Increased timeout for bounce test You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka KAFKA-4744-bounce

[jira] [Updated] (KAFKA-4806) KafkaConsumer: ConsumerConfig gets logged twice.

2017-02-26 Thread Marco Ebert (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Ebert updated KAFKA-4806: --- Labels: easyfix github-import newbie patch (was: ) > KafkaConsumer: ConsumerConfig gets logged

[jira] [Updated] (KAFKA-4806) KafkaConsumer: ConsumerConfig gets logged twice.

2017-02-26 Thread Marco Ebert (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Ebert updated KAFKA-4806: --- Affects Version/s: 0.10.0.0 0.10.1.0 0.10.1.1

[jira] [Updated] (KAFKA-4806) KafkaConsumer: ConsumerConfig gets logged twice.

2017-02-26 Thread Marco Ebert (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Ebert updated KAFKA-4806: --- Component/s: log consumer clients > KafkaConsumer: ConsumerConfig

[jira] [Commented] (KAFKA-4806) KafkaConsumer: ConsumerConfig gets logged twice.

2017-02-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884872#comment-15884872 ] ASF GitHub Bot commented on KAFKA-4806: --- GitHub user Gacko opened a pull request:

[GitHub] kafka pull request #2600: KAFKA-4806: Prevent double logging of ConsumerConf...

2017-02-26 Thread Gacko
GitHub user Gacko opened a pull request: https://github.com/apache/kafka/pull/2600 KAFKA-4806: Prevent double logging of ConsumerConfig. The consumer properties get logged twice since two instances of ConsumerConfig are created during creation of KafkaConsumer. I added a

[jira] [Created] (KAFKA-4806) KafkaConsumer: ConsumerConfig gets logged twice.

2017-02-26 Thread Marco Ebert (JIRA)
Marco Ebert created KAFKA-4806: -- Summary: KafkaConsumer: ConsumerConfig gets logged twice. Key: KAFKA-4806 URL: https://issues.apache.org/jira/browse/KAFKA-4806 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-4434) KafkaProducer configuration is logged twice

2017-02-26 Thread Marco Ebert (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884863#comment-15884863 ] Marco Ebert commented on KAFKA-4434: This problem also exists for KafkaKonsumer and ConsumerConfig.

[jira] [Updated] (KAFKA-4778) OOM on kafka-streams instances with high numbers of unreaped Record classes

2017-02-26 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska updated KAFKA-4778: Component/s: streams > OOM on kafka-streams instances with high numbers of unreaped Record classes

Re: [DISCUSS] KIP-127: Pluggable JAAS LoginModule configuration for SSL

2017-02-26 Thread Christopher Shannon
Ismael, I took a closer look at SslTransportLayer and did verify everything will work for me. SSLSession is already exposed through a public method on SslTransportLayer through the sslSession() method so that is perfect as I can access what I need with that. Mostly I just need the X509 chain out

[jira] [Resolved] (KAFKA-4784) Pluggable JAAS LoginModule configuration for SSL (KIP-127)

2017-02-26 Thread Christopher L. Shannon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher L. Shannon resolved KAFKA-4784. --- Resolution: Won't Fix Per feedback, a custom PrincipalBuilder can be

Re: [DISCUSS] KIP-82 - Add Record Headers

2017-02-26 Thread Michael Pearce
Hi Becket, On 1) Yes truly we wanted mutable headers also. Alas we couldn't think of a solution would address Jason's point around, once a record is sent it shouldn't be possible to mutate it, for cases where you send twice the same record. Thank you so much for your solution i think this

[jira] [Resolved] (KAFKA-4805) e9qgi

2017-02-26 Thread Vamsi Jakkula (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vamsi Jakkula resolved KAFKA-4805. -- Resolution: Invalid > e9qgi > - > > Key: KAFKA-4805 > URL:

[jira] [Created] (KAFKA-4805) e9qgi

2017-02-26 Thread Vamsi Jakkula (JIRA)
Vamsi Jakkula created KAFKA-4805: Summary: e9qgi Key: KAFKA-4805 URL: https://issues.apache.org/jira/browse/KAFKA-4805 Project: Kafka Issue Type: Bug Reporter: Vamsi Jakkula

[jira] [Created] (KAFKA-4804) TdOZY

2017-02-26 Thread Vamsi Jakkula (JIRA)
Vamsi Jakkula created KAFKA-4804: Summary: TdOZY Key: KAFKA-4804 URL: https://issues.apache.org/jira/browse/KAFKA-4804 Project: Kafka Issue Type: Bug Reporter: Vamsi Jakkula

[jira] [Created] (KAFKA-4803) OT6Y1

2017-02-26 Thread Vamsi Jakkula (JIRA)
Vamsi Jakkula created KAFKA-4803: Summary: OT6Y1 Key: KAFKA-4803 URL: https://issues.apache.org/jira/browse/KAFKA-4803 Project: Kafka Issue Type: Bug Reporter: Vamsi Jakkula