[jira] [Commented] (KAFKA-4017) Return more helpful responses when misconfigured connectors are submitted

2016-08-03 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407224#comment-15407224 ] Ewen Cheslack-Postava commented on KAFKA-4017: -- [~cotedm] Have the config that caused the

Jenkins build is back to normal : kafka-trunk-jdk8 #799

2016-08-03 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #798

2016-08-03 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: rename StateStoreProvider.getStores() -> -- [...truncated 8287 lines...] org.apache.kafka.common.metrics.MetricsTest > testPercentiles STARTED

[jira] [Comment Edited] (KAFKA-3989) Add JMH module for Benchmarks

2016-08-03 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407054#comment-15407054 ] Bill Bejeck edited comment on KAFKA-3989 at 8/4/16 3:03 AM: I opted to try the

[jira] [Commented] (KAFKA-3989) Add JMH module for Benchmarks

2016-08-03 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407054#comment-15407054 ] Bill Bejeck commented on KAFKA-3989: I opted to try the gradle shadow plugin first

[jira] [Comment Edited] (KAFKA-3989) Add JMH module for Benchmarks

2016-08-03 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407054#comment-15407054 ] Bill Bejeck edited comment on KAFKA-3989 at 8/4/16 3:03 AM: I opted to try the

[jira] [Commented] (KAFKA-3894) Log Cleaner thread crashes and never restarts

2016-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406970#comment-15406970 ] Jun Rao commented on KAFKA-3894: [~tcrayford-heroku], I chatted with [~jkreps] on this a bit. There are a

[jira] [Assigned] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-4018: -- Assignee: Ismael Juma > Streams causing older slf4j-log4j library to be packaged along with

[jira] [Resolved] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4018. Resolution: Fixed Issue resolved by pull request 1704 [https://github.com/apache/kafka/pull/1704]

[GitHub] kafka pull request #1704: KAFKA-4018: Streams causing older slf4j-log4j libr...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1704 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406936#comment-15406936 ] ASF GitHub Bot commented on KAFKA-4018: --- Github user asfgit closed the pull request at:

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

2016-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406915#comment-15406915 ] Jun Rao commented on KAFKA-1211: [~fpj], very good questions. 1. Yes, the idea is for the follower to

[jira] [Commented] (KAFKA-3752) Provide a way for KStreams to recover from unclean shutdown

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406893#comment-15406893 ] Guozhang Wang commented on KAFKA-3752: -- [~theduderog] Do you still have the logs on the server side?

Re: [kafka-clients] [VOTE] 0.10.0.1 RC1

2016-08-03 Thread Ismael Juma
Thanks Manikumar. I filed KAFKA-4018 with the details of when we regressed as well as a fix. Ismael On Wed, Aug 3, 2016 at 4:18 PM, Manikumar Reddy wrote: > Hi, > > There are two versions of slf4j-log4j jar in the build. (1.6.1, 1.7.21). > slf4j-log4j12-1.6.1.jar is

[jira] [Commented] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406855#comment-15406855 ] ASF GitHub Bot commented on KAFKA-4018: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #1704: KAFKA-4018: Streams causing older slf4j-log4j libr...

2016-08-03 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1704 KAFKA-4018: Streams causing older slf4j-log4j library to be packaged along with newer version This is a regression caused by 0bb1d3ae. After that commit, Streams no longer has a direct

[jira] [Created] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

2016-08-03 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-4018: -- Summary: Streams causing older slf4j-log4j library to be packaged along with newer version Key: KAFKA-4018 URL: https://issues.apache.org/jira/browse/KAFKA-4018 Project:

Jenkins build is back to normal : kafka-0.10.0-jdk7 #181

2016-08-03 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-trunk-jdk7 #1459

2016-08-03 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406740#comment-15406740 ] ASF GitHub Bot commented on KAFKA-3875: --- GitHub user junrao opened a pull request:

[GitHub] kafka pull request #1703: KAFKA-3875: Transient test failure: kafka.api.SslP...

2016-08-03 Thread junrao
GitHub user junrao opened a pull request: https://github.com/apache/kafka/pull/1703 KAFKA-3875: Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime 1. The IllegalStateException is actually thrown from

[jira] [Commented] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

2016-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406737#comment-15406737 ] Jun Rao commented on KAFKA-3875: I took a look at this and found a few things. 1. The

Build failed in Jenkins: kafka-trunk-jdk8 #797

2016-08-03 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fixed documentation for KStream left join KStream-KTable -- [...truncated 1648 lines...] kafka.api.PlaintextConsumerTest > testPauseStateNotPreservedByRebalance

[GitHub] kafka pull request #1699: MINOR: rename StateStoreProvider.getStores() -> St...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1699 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2063) Bound fetch response size

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406730#comment-15406730 ] Guozhang Wang commented on KAFKA-2063: -- Another note from Streams is that in situations where

Re: Preserve offset in Mirror Maker

2016-08-03 Thread Gwen Shapira
MirrorMaker actually doesn't have a default - it uses what you configured in the consumer.properties file you use. Either: auto.offset.reset = latest (biggest in old versions) or auto.offset.reset = earliest (smallest in old versions) So you can choose whether when MirrorMaker first comes up, if

[jira] [Assigned] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

2016-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-3875: -- Assignee: Jun Rao > Transient test failure: >

Preserve offset in Mirror Maker

2016-08-03 Thread Sunil Parmar
We're using mirror maker to mirror data from one data center to another data center ( 1 to 1 ). We noticed that by default the mirror maker by default start from latest offset. How to change mirror maker producer config to start from last check pointed offset in case of crash without losing

[jira] [Commented] (KAFKA-2063) Bound fetch response size

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406623#comment-15406623 ] Guozhang Wang commented on KAFKA-2063: -- Re 1) Currently we use pause / resume per partition to avoid

[GitHub] kafka pull request #1692: MINOR: Fixed documentation for KStream left join K...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1692 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-1143) Consumer should cache topic partition info

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-1143. -- Resolution: Duplicate Fix Version/s: (was: 0.10.1.0) This ticket was proposed for

Re: Kafka Streams for Remote Server

2016-08-03 Thread Guozhang Wang
Hi Misha, If it works locally, then I would still suspect that it is due to a transient timing issue: note that the create-topic script is non-blocking, i.e. even when it returns it does not necessarily guarantee that the leader metadata information has been completed propagating to brokers.

Reg: SSL setup

2016-08-03 Thread BigData dev
Hi, Can you please provide information on Self signed certificate setup in Kafka. As in Kafka documentation only CA signed setup is provided. http://kafka.apache.org/documentation.html#security_ssl As because, we need to provide parameters trustore, keystore during configuration. Or to work

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406234#comment-15406234 ] ASF GitHub Bot commented on KAFKA-3999: --- Github user vahidhashemian closed the pull request at:

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406235#comment-15406235 ] ASF GitHub Bot commented on KAFKA-3999: --- GitHub user vahidhashemian reopened a pull request:

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses as ...

2016-08-03 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1698 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses as ...

2016-08-03 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1698 KAFKA-3999: Record raw size of fetch responses as part of consumer metrics Currently, only the decompressed size of fetch responses is recorded. This PR adds a sensor to keep track of the

[jira] [Commented] (KAFKA-3042) updateIsr should stop after failed several times due to zkVersion issue

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406121#comment-15406121 ] Guozhang Wang commented on KAFKA-3042: -- I agree that we should consider improving the controller

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

2016-08-03 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406063#comment-15406063 ] Flavio Junqueira commented on KAFKA-1211: - Thanks for the clarification, [~junrao]. There are a

Re: [kafka-clients] [VOTE] 0.10.0.1 RC1

2016-08-03 Thread Manikumar Reddy
Hi, There are two versions of slf4j-log4j jar in the build. (1.6.1, 1.7.21). slf4j-log4j12-1.6.1.jar is coming from streams:examples module. Thanks, Manikumar On Tue, Aug 2, 2016 at 8:31 PM, Ismael Juma wrote: > Hello Kafka users, developers and client-developers, > > This

[jira] [Commented] (KAFKA-3916) Connection from controller to broker disconnects

2016-08-03 Thread Michal Turek (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406027#comment-15406027 ] Michal Turek commented on KAFKA-3916: - We saw this issue yesterday, I don't know if this helps, but it

[jira] [Commented] (KAFKA-3817) KTableRepartitionMap should handle null inputs

2016-08-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405982#comment-15405982 ] Guozhang Wang commented on KAFKA-3817: -- Good point, mind filing a minor PR? > KTableRepartitionMap

[GitHub] kafka pull request #1701: MINOR: increase usability of shell-scripts

2016-08-03 Thread igalic
GitHub user igalic opened a pull request: https://github.com/apache/kafka/pull/1701 MINOR: increase usability of shell-scripts we do this by ensuring that the --zookeeper parameter consistently defaults to localhost:2181 — as it already does in some places. You can merge this

[jira] [Work started] (KAFKA-4016) Kafka Streams join benchmark

2016-08-03 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4016 started by Eno Thereska. --- > Kafka Streams join benchmark > > >

[jira] [Commented] (KAFKA-4016) Kafka Streams join benchmark

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405894#comment-15405894 ] ASF GitHub Bot commented on KAFKA-4016: --- GitHub user enothereska opened a pull request:

[GitHub] kafka pull request #1700: KAFKA-4016: Added join benchmarks

2016-08-03 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/1700 KAFKA-4016: Added join benchmarks You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka join-benchmarks Alternatively you can

[jira] [Created] (KAFKA-4016) Kafka Streams join benchmark

2016-08-03 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-4016: --- Summary: Kafka Streams join benchmark Key: KAFKA-4016 URL: https://issues.apache.org/jira/browse/KAFKA-4016 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: kafka-0.10.0-jdk7 #180

2016-08-03 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3667; Improve Section 7.2 Encryption and Authentication using SSL -- [...truncated 5715 lines...] org.apache.kafka.streams.kstream.TimeWindowsTest >

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2016-08-03 Thread Harald Kirsch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405810#comment-15405810 ] Harald Kirsch commented on KAFKA-1194: -- Just stumbled over yet another problem instance. During

[jira] [Commented] (KAFKA-3665) Default ssl.endpoint.identification.algorithm should be https

2016-08-03 Thread Ryan P (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405659#comment-15405659 ] Ryan P commented on KAFKA-3665: --- RFC-6066 describes an extension to the TLS protocol to handle the VIP case.

[jira] [Updated] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3945: --- Fix Version/s: 0.10.1.0 > kafka-console-producer.sh does not accept request-required-acks=all >

[jira] [Updated] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3945: --- Resolution: Fixed Reviewer: Ismael Juma Status: Resolved (was: Patch Available) >

[jira] [Commented] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405654#comment-15405654 ] ASF GitHub Bot commented on KAFKA-3945: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1618: KAFKA-3945: Change the type of 'acks' config in co...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1618 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-3667) Improve Section 7.2 Encryption and Authentication using SSL to include proper hostname verification configuration

2016-08-03 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3667: --- Assignee: Ryan P > Improve Section 7.2 Encryption and Authentication using SSL to include proper >

[jira] [Commented] (KAFKA-3667) Improve Section 7.2 Encryption and Authentication using SSL to include proper hostname verification configuration

2016-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405638#comment-15405638 ] ASF GitHub Bot commented on KAFKA-3667: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1384: KAFKA-3667:Improve Section 7.2 Encryption and Auth...

2016-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1384 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3817) KTableRepartitionMap should handle null inputs

2016-08-03 Thread Jan Filipiak (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405568#comment-15405568 ] Jan Filipiak commented on KAFKA-3817: - [~guozhang] So the ability to handle null values in the

[GitHub] kafka pull request #1699: MINOR: rename StateStoreProvider.getStores() -> St...

2016-08-03 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1699 MINOR: rename StateStoreProvider.getStores() -> StateStoreProvider.stores() Rename StateStoreProvider.getStores(...) to StateStoreProvider.stores(...) as this is consistent with the naming of other