[jira] [Commented] (KAFKA-3667) Improve Section 7.2 Encryption and Authentication using SSL to include proper hostname verification configuration

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405638#comment-15405638 ] ASF GitHub Bot commented on KAFKA-3667: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1699: MINOR: rename StateStoreProvider.getStores() -> St...

2016-08-03 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1699 MINOR: rename StateStoreProvider.getStores() -> StateStoreProvider.stores() Rename StateStoreProvider.getStores(...) to StateStoreProvider.stores(...) as this is consistent with the naming of other

[jira] [Commented] (KAFKA-3817) KTableRepartitionMap should handle null inputs

2016-08-03 Thread Jan Filipiak (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405568#comment-15405568 ] Jan Filipiak commented on KAFKA-3817: - [~guozhang] So the ability to handle null values in the

[jira] [Updated] (KAFKA-3667) Improve Section 7.2 Encryption and Authentication using SSL to include proper hostname verification configuration

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3667: --- Assignee: Ryan P > Improve Section 7.2 Encryption and Authentication using SSL to include proper >

[GitHub] kafka pull request #1384: KAFKA-3667:Improve Section 7.2 Encryption and Auth...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1384 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3945: --- Fix Version/s: 0.10.1.0 > kafka-console-producer.sh does not accept request-required-acks=all >

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2016-08-03 Thread Harald Kirsch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405810#comment-15405810 ] Harald Kirsch commented on KAFKA-1194: -- Just stumbled over yet another problem instance. During

[jira] [Updated] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3945: --- Resolution: Fixed Reviewer: Ismael Juma Status: Resolved (was: Patch Available) >

[GitHub] kafka pull request #1618: KAFKA-3945: Change the type of 'acks' config in co...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1618 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405654#comment-15405654 ] ASF GitHub Bot commented on KAFKA-3945: --- Github user asfgit closed the pull request at:

[jira] [Commented] (KAFKA-3665) Default ssl.endpoint.identification.algorithm should be https

2016-08-03 Thread Ryan P (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405659#comment-15405659 ] Ryan P commented on KAFKA-3665: --- RFC-6066 describes an extension to the TLS protocol to handle the VIP case.

Build failed in Jenkins: kafka-0.10.0-jdk7 #180

2016-08-03 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3667; Improve Section 7.2 Encryption and Authentication using SSL -- [...truncated 5715 lines...] org.apache.kafka.streams.kstream.TimeWindowsTest >

[jira] [Commented] (KAFKA-3817) KTableRepartitionMap should handle null inputs

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405982#comment-15405982 ] Guozhang Wang commented on KAFKA-3817: -- Good point, mind filing a minor PR? > KTableRepartitionMap

[jira] [Commented] (KAFKA-3916) Connection from controller to broker disconnects

2016-08-03 Thread Michal Turek (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406027#comment-15406027 ] Michal Turek commented on KAFKA-3916: - We saw this issue yesterday, I don't know if this helps, but it

[jira] [Commented] (KAFKA-3042) updateIsr should stop after failed several times due to zkVersion issue

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406121#comment-15406121 ] Guozhang Wang commented on KAFKA-3042: -- I agree that we should consider improving the controller

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

2016-08-03 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406063#comment-15406063 ] Flavio Junqueira commented on KAFKA-1211: - Thanks for the clarification, [~junrao]. There are a

Re: [kafka-clients] [VOTE] 0.10.0.1 RC1

2016-08-03 Thread Manikumar Reddy
Hi, There are two versions of slf4j-log4j jar in the build. (1.6.1, 1.7.21). slf4j-log4j12-1.6.1.jar is coming from streams:examples module. Thanks, Manikumar On Tue, Aug 2, 2016 at 8:31 PM, Ismael Juma wrote: > Hello Kafka users, developers and client-developers, > > This

[jira] [Comment Edited] (KAFKA-3989) Add JMH module for Benchmarks

2016-08-03 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407054#comment-15407054 ] Bill Bejeck edited comment on KAFKA-3989 at 8/4/16 3:03 AM: I opted to try the

[jira] [Assigned] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-4018: -- Assignee: Ismael Juma > Streams causing older slf4j-log4j library to be packaged along with

Build failed in Jenkins: kafka-trunk-jdk8 #798

2016-08-03 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: rename StateStoreProvider.getStores() -> -- [...truncated 8287 lines...] org.apache.kafka.common.metrics.MetricsTest > testPercentiles STARTED

Jenkins build is back to normal : kafka-trunk-jdk8 #799

2016-08-03 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-4017) Return more helpful responses when misconfigured connectors are submitted

2016-08-03 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407224#comment-15407224 ] Ewen Cheslack-Postava commented on KAFKA-4017: -- [~cotedm] Have the config that caused the

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

2016-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406915#comment-15406915 ] Jun Rao commented on KAFKA-1211: [~fpj], very good questions. 1. Yes, the idea is for the follower to

[jira] [Commented] (KAFKA-3894) Log Cleaner thread crashes and never restarts

2016-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406970#comment-15406970 ] Jun Rao commented on KAFKA-3894: [~tcrayford-heroku], I chatted with [~jkreps] on this a bit. There are a

Reg: SSL setup

2016-08-03 Thread BigData dev
Hi, Can you please provide information on Self signed certificate setup in Kafka. As in Kafka documentation only CA signed setup is provided. http://kafka.apache.org/documentation.html#security_ssl As because, we need to provide parameters trustore, keystore during configuration. Or to work

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406235#comment-15406235 ] ASF GitHub Bot commented on KAFKA-3999: --- GitHub user vahidhashemian reopened a pull request:

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses as ...

2016-08-03 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1698 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses as ...

2016-08-03 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1698 KAFKA-3999: Record raw size of fetch responses as part of consumer metrics Currently, only the decompressed size of fetch responses is recorded. This PR adds a sensor to keep track of the

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406234#comment-15406234 ] ASF GitHub Bot commented on KAFKA-3999: --- Github user vahidhashemian closed the pull request at:

[jira] [Resolved] (KAFKA-1143) Consumer should cache topic partition info

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-1143. -- Resolution: Duplicate Fix Version/s: (was: 0.10.1.0) This ticket was proposed for

Re: Kafka Streams for Remote Server

2016-08-03 Thread Guozhang Wang
Hi Misha, If it works locally, then I would still suspect that it is due to a transient timing issue: note that the create-topic script is non-blocking, i.e. even when it returns it does not necessarily guarantee that the leader metadata information has been completed propagating to brokers.

[jira] [Commented] (KAFKA-2063) Bound fetch response size

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406623#comment-15406623 ] Guozhang Wang commented on KAFKA-2063: -- Re 1) Currently we use pause / resume per partition to avoid

[GitHub] kafka pull request #1692: MINOR: Fixed documentation for KStream left join K...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1692 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1700: KAFKA-4016: Added join benchmarks

2016-08-03 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/1700 KAFKA-4016: Added join benchmarks You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka join-benchmarks Alternatively you can

[GitHub] kafka pull request #1701: MINOR: increase usability of shell-scripts

2016-08-03 Thread igalic
GitHub user igalic opened a pull request: https://github.com/apache/kafka/pull/1701 MINOR: increase usability of shell-scripts we do this by ensuring that the --zookeeper parameter consistently defaults to localhost:2181 — as it already does in some places. You can merge this

[jira] [Commented] (KAFKA-4016) Kafka Streams join benchmark

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405894#comment-15405894 ] ASF GitHub Bot commented on KAFKA-4016: --- GitHub user enothereska opened a pull request:

[jira] [Work started] (KAFKA-4016) Kafka Streams join benchmark

2016-08-03 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4016 started by Eno Thereska. --- > Kafka Streams join benchmark > > >

Re: Preserve offset in Mirror Maker

2016-08-03 Thread Gwen Shapira
MirrorMaker actually doesn't have a default - it uses what you configured in the consumer.properties file you use. Either: auto.offset.reset = latest (biggest in old versions) or auto.offset.reset = earliest (smallest in old versions) So you can choose whether when MirrorMaker first comes up, if

Jenkins build is back to normal : kafka-trunk-jdk7 #1459

2016-08-03 Thread Apache Jenkins Server
See

Preserve offset in Mirror Maker

2016-08-03 Thread Sunil Parmar
We're using mirror maker to mirror data from one data center to another data center ( 1 to 1 ). We noticed that by default the mirror maker by default start from latest offset. How to change mirror maker producer config to start from last check pointed offset in case of crash without losing

Build failed in Jenkins: kafka-trunk-jdk8 #797

2016-08-03 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fixed documentation for KStream left join KStream-KTable -- [...truncated 1648 lines...] kafka.api.PlaintextConsumerTest > testPauseStateNotPreservedByRebalance

[GitHub] kafka pull request #1699: MINOR: rename StateStoreProvider.getStores() -> St...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1699 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is back to normal : kafka-0.10.0-jdk7 #181

2016-08-03 Thread Apache Jenkins Server
See

Re: [kafka-clients] [VOTE] 0.10.0.1 RC1

2016-08-03 Thread Ismael Juma
Thanks Manikumar. I filed KAFKA-4018 with the details of when we regressed as well as a fix. Ismael On Wed, Aug 3, 2016 at 4:18 PM, Manikumar Reddy wrote: > Hi, > > There are two versions of slf4j-log4j jar in the build. (1.6.1, 1.7.21). > slf4j-log4j12-1.6.1.jar is

[jira] [Assigned] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

2016-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-3875: -- Assignee: Jun Rao > Transient test failure: >

[jira] [Commented] (KAFKA-2063) Bound fetch response size

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406730#comment-15406730 ] Guozhang Wang commented on KAFKA-2063: -- Another note from Streams is that in situations where

[jira] [Commented] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406740#comment-15406740 ] ASF GitHub Bot commented on KAFKA-3875: --- GitHub user junrao opened a pull request:

[jira] [Created] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-4018: -- Summary: Streams causing older slf4j-log4j library to be packaged along with newer version Key: KAFKA-4018 URL: https://issues.apache.org/jira/browse/KAFKA-4018 Project:

[jira] [Commented] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

2016-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406737#comment-15406737 ] Jun Rao commented on KAFKA-3875: I took a look at this and found a few things. 1. The

[GitHub] kafka pull request #1703: KAFKA-3875: Transient test failure: kafka.api.SslP...

2016-08-03 Thread junrao
GitHub user junrao opened a pull request: https://github.com/apache/kafka/pull/1703 KAFKA-3875: Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime 1. The IllegalStateException is actually thrown from

[GitHub] kafka pull request #1704: KAFKA-4018: Streams causing older slf4j-log4j libr...

2016-08-03 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1704 KAFKA-4018: Streams causing older slf4j-log4j library to be packaged along with newer version This is a regression caused by 0bb1d3ae. After that commit, Streams no longer has a direct

[jira] [Commented] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406855#comment-15406855 ] ASF GitHub Bot commented on KAFKA-4018: --- GitHub user ijuma opened a pull request:

[jira] [Commented] (KAFKA-3752) Provide a way for KStreams to recover from unclean shutdown

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406893#comment-15406893 ] Guozhang Wang commented on KAFKA-3752: -- [~theduderog] Do you still have the logs on the server side?

[jira] [Created] (KAFKA-4016) Kafka Streams join benchmark

2016-08-03 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-4016: --- Summary: Kafka Streams join benchmark Key: KAFKA-4016 URL: https://issues.apache.org/jira/browse/KAFKA-4016 Project: Kafka Issue Type: Improvement

[GitHub] kafka pull request #1704: KAFKA-4018: Streams causing older slf4j-log4j libr...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1704 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406936#comment-15406936 ] ASF GitHub Bot commented on KAFKA-4018: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4018. Resolution: Fixed Issue resolved by pull request 1704 [https://github.com/apache/kafka/pull/1704]

[jira] [Commented] (KAFKA-3989) Add JMH module for Benchmarks

2016-08-03 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407054#comment-15407054 ] Bill Bejeck commented on KAFKA-3989: I opted to try the gradle shadow plugin first

[jira] [Comment Edited] (KAFKA-3989) Add JMH module for Benchmarks

2016-08-03 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407054#comment-15407054 ] Bill Bejeck edited comment on KAFKA-3989 at 8/4/16 3:03 AM: I opted to try the