[jira] [Commented] (KAFKA-4362) Consumer can fail after reassignment of the offsets topic partition

[ https://issues.apache.org/jira/browse/KAFKA-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627824#comment-15627824 ] Jason Gustafson commented on KAFKA-4362: [~jjkoshy] Good find. Can you clarify what you mean when

[GitHub] kafka pull request #2050: Replaced unnecessary isDefined and get on option v...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2050 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk8 #1015

See Changes: [cshapi] MINOR: Fix documentation of compaction -- [...truncated 7976 lines...] kafka.producer.ProducerTest > testSendToNewTopic STARTED kafka.producer.ProducerTest >

Jenkins build is back to normal : kafka-trunk-jdk7 #1666

See

Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag

On a side note just a use case that came to my mind, if we ever plan to add headers to kafka, we can provide this functionality of compaction based on headers and make the compaction policy pluggable on the broker side. This might give flexibility for doing compaction in future. Thanks, Mayuresh

[GitHub] kafka pull request #2089: MINOR: Fix documentation of compaction

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2089 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4362) Consumer can fail after reassignment of the offsets topic partition

[ https://issues.apache.org/jira/browse/KAFKA-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-4362: Assignee: Mayuresh Gharat (was: Jiangjie Qin) > Consumer can fail after reassignment of the

[GitHub] kafka pull request #2090: KAFKA-4269: Follow up for 0.10.1 branch -update to...

GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/2090 KAFKA-4269: Follow up for 0.10.1 branch -update topic subscriptions for regex You can merge this pull request into a Git repository by running: $ git pull https://github.com/bbejeck/kafka

[jira] [Commented] (KAFKA-4269) Multiple KStream instances with at least one Regex source causes NPE when using multiple consumers

[ https://issues.apache.org/jira/browse/KAFKA-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627157#comment-15627157 ] ASF GitHub Bot commented on KAFKA-4269: --- GitHub user bbejeck opened a pull request:

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627097#comment-15627097 ] Greg Fodor commented on KAFKA-4113: --- Hey [~guozhang], I have been able to reproduce a bootstrapping

Build failed in Jenkins: kafka-trunk-jdk7 #1665

See Changes: [jason] KAFKA-4357; Fix consumer group describe output when there is no active -- [...truncated 7983 lines...] kafka.api.AuthorizerIntegrationTest >

[jira] [Issue Comment Deleted] (KAFKA-3554) Generate actual data with specific compression ratio and add multi-thread support in the ProducerPerformance tool.

[ https://issues.apache.org/jira/browse/KAFKA-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David updated KAFKA-3554: - Comment: was deleted (was: Hey guys, Is there any ConsumerPerformance code in Java instead of Scala? I looked at

[jira] [Updated] (KAFKA-4362) Consumer can fail after reassignment of the offsets topic partition

[ https://issues.apache.org/jira/browse/KAFKA-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-4362: -- Summary: Consumer can fail after reassignment of the offsets topic partition (was: Offset commits fail

[GitHub] kafka pull request #2089: Fix documentation of compaction

GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/2089 Fix documentation of compaction Also cleaned up some of the language around compaction guarantees. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-4360) Controller may deadLock when autoLeaderRebalance encounter zk expired

[ https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626869#comment-15626869 ] Guozhang Wang commented on KAFKA-4360: -- Thanks for the find [~Json Tu]. And I agree with Jiangjie

[GitHub] kafka pull request #2088: Cross compile to Scala 2.12.0-RC2

GitHub user leachbj opened a pull request: https://github.com/apache/kafka/pull/2088 Cross compile to Scala 2.12.0-RC2 You can merge this pull request into a Git repository by running: $ git pull https://github.com/leachbj/kafka scala-2.12.0-RC2-build Alternatively you can

[GitHub] kafka pull request #2062: Expose name of processor on KStream

Github user thijsc closed the pull request at: https://github.com/apache/kafka/pull/2062 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4302) Simplify KTableSource

[ https://issues.apache.org/jira/browse/KAFKA-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626727#comment-15626727 ] ASF GitHub Bot commented on KAFKA-4302: --- Github user mjsax closed the pull request at:

[GitHub] kafka pull request #2079: HOTFIX: improve error message on invalid input rec...

Github user mjsax closed the pull request at: https://github.com/apache/kafka/pull/2079 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2080: KAFKA-4302: Simplify KTableSource

Github user mjsax closed the pull request at: https://github.com/apache/kafka/pull/2080 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4307) Inconsistent parameters between console producer and consumer

[ https://issues.apache.org/jira/browse/KAFKA-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626723#comment-15626723 ] Ishita Mandhan commented on KAFKA-4307: --- Sure, take your time! Was just checking to see if it was up

Re: [DISCUSS] KIP-84: Support SASL/SCRAM mechanisms

Gwen, I had thought the same too and hence I am assuming that Java clients could simply use SaslHandshakeRequest. SaslHandshakeRequest returns the list of mechanisms enabled in the broker. I think Jun's point was that by incrementing the version of SaslHandshakeRequest, clients can use

[jira] [Created] (KAFKA-4364) Sink tasks expose secrets in DEBUG logging

Ryan P created KAFKA-4364: - Summary: Sink tasks expose secrets in DEBUG logging Key: KAFKA-4364 URL: https://issues.apache.org/jira/browse/KAFKA-4364 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-trunk-jdk8 #1013

See Changes: [wangguoz] KAFKA-4361: Streams does not respect user configs for "default" params [wangguoz] KAFKA-4352: instable ResetTool integration test -- [...truncated 14363 lines...]

Re: [DISCUSS] KIP-84: Support SASL/SCRAM mechanisms

Wait, I thought SaslHandshakeResponse includes a list of mechanisms supported, so I'm not sure why we need to bump the version? I expect clients will send SaslHandshakeRequest_V0, see which mechanisms are supported and make a call based on that? Which means KIP-35 is not required in that case? Am

[jira] [Commented] (KAFKA-4307) Inconsistent parameters between console producer and consumer

[ https://issues.apache.org/jira/browse/KAFKA-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626544#comment-15626544 ] Manasvi Gupta commented on KAFKA-4307: -- Yes. Sorry, I was on holiday for Diwali. Will have patch by

Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag

My two cents on the magic value bumping. Although the broker can infer from the request version to determine whether it should read the new attribute bit or not, currently the request version is not propagated to the replica manager. Bumping up the magic value does not seem a big overhead in this

Re: [DISCUSS] KIP-84: Support SASL/SCRAM mechanisms

Jun, I have added the following text to the KIP. Does this match your expectation? *SaslHandshakeRequest version will be increased from 0 to 1 so that clients can determine if the broker is capable of supporting SCRAM mechanisms using ApiVersionsRequest. Java clients will not be updated to use

[jira] [Commented] (KAFKA-4357) Consumer group describe exception when there is no active member (old consumer)

[ https://issues.apache.org/jira/browse/KAFKA-4357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626438#comment-15626438 ] ASF GitHub Bot commented on KAFKA-4357: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2075: KAFKA-4357: Fix consumer group describe output whe...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2075 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4357) Consumer group describe exception when there is no active member (old consumer)

[ https://issues.apache.org/jira/browse/KAFKA-4357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4357: --- Resolution: Fixed Fix Version/s: 0.10.2.0 Status: Resolved (was: Patch

[jira] [Assigned] (KAFKA-2544) Replication tools wiki page needs to be updated

[ https://issues.apache.org/jira/browse/KAFKA-2544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishita Mandhan reassigned KAFKA-2544: - Assignee: Ishita Mandhan > Replication tools wiki page needs to be updated >

Build failed in Jenkins: kafka-trunk-jdk7 #1664

See Changes: [wangguoz] KAFKA-4361: Streams does not respect user configs for "default" params [wangguoz] KAFKA-4352: instable ResetTool integration test -- [...truncated 14306 lines...]

[jira] [Commented] (KAFKA-4307) Inconsistent parameters between console producer and consumer

[ https://issues.apache.org/jira/browse/KAFKA-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626328#comment-15626328 ] Ishita Mandhan commented on KAFKA-4307: --- Are you working on this, [~manasvigupta]? > Inconsistent

[jira] [Assigned] (KAFKA-4320) Log compaction docs update

[ https://issues.apache.org/jira/browse/KAFKA-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishita Mandhan reassigned KAFKA-4320: - Assignee: Ishita Mandhan > Log compaction docs update > -- > >

[DISCUSS] KAFKA-4345: Run decktape test for each pull request

Hi, I want to start a discussion about running ducktape tests for each pull request. I have been working on KAFKA-4345 to enable this using docker on travis-ci. Pull request: https://github.com/apache/kafka/pull/2064 Working POC:

[jira] [Resolved] (KAFKA-4352) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

[ https://issues.apache.org/jira/browse/KAFKA-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4352. -- Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request 2082

Build failed in Jenkins: kafka-trunk-jdk8 #1012

See Changes: [jason] MINOR: Fix issue in `AsyncProducerTest` where it expects the `port` -- [...truncated 14592 lines...] org.apache.kafka.streams.processor.internals.AbstractTaskTest >

[GitHub] kafka pull request #2082: KAFKA-4352: instable ResetTool integration test

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2082 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4352) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

[ https://issues.apache.org/jira/browse/KAFKA-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626081#comment-15626081 ] ASF GitHub Bot commented on KAFKA-4352: --- Github user asfgit closed the pull request at:

Build failed in Jenkins: kafka-trunk-jdk7 #1663

See Changes: [jason] MINOR: Fix issue in `AsyncProducerTest` where it expects the `port` -- [...truncated 4123 lines...] kafka.log.LogCleanerTest > testBuildPartialOffsetMap STARTED

[jira] [Commented] (KAFKA-4361) Streams does not respect user configs for "default" params

[ https://issues.apache.org/jira/browse/KAFKA-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626028#comment-15626028 ] ASF GitHub Bot commented on KAFKA-4361: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2084: KAFKA-4361: Streams does not respect user configs ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2084 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-4361) Streams does not respect user configs for "default" params

[ https://issues.apache.org/jira/browse/KAFKA-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4361. -- Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request 2084

Re: [DISCUSS] KIP-84: Support SASL/SCRAM mechanisms

Hi, Rajini, One more thing. It seems that we should bump up the version of SaslHandshakeRequest? This way, the client can figure out which SASL mechanisms the broker is capable of supporting through ApiVersionRequest. We discussed this briefly as part of KIP-43. Thanks, Jun On Tue, Nov 1,

[jira] [Updated] (KAFKA-4360) Controller may deadLock when autoLeaderRebalance encounter zk expired

[ https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Json Tu updated KAFKA-4360: --- Reviewer: Jiangjie Qin (was: Json Tu) > Controller may deadLock when autoLeaderRebalance encounter zk

[GitHub] kafka pull request #2073: MINOR: Fix issue in `AsyncProducerTest` where it e...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2073 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-84: Support SASL/SCRAM mechanisms

If there are no more comments, I will start vote on this KIP later this week. In the meantime, please feel free to post any feedback or suggestions. Initial implementation is here: https://github.com/apache/kafka/pull/2086. Thank you, Rajini On Thu, Oct 27, 2016 at 11:18 AM, Rajini Sivaram <

[jira] [Created] (KAFKA-4363) Add document for dynamic JAAS configuration property sasl.jaas.config

Rajini Sivaram created KAFKA-4363: - Summary: Add document for dynamic JAAS configuration property sasl.jaas.config Key: KAFKA-4363 URL: https://issues.apache.org/jira/browse/KAFKA-4363 Project:

Re: [VOTE] KIP-85: Dynamic JAAS configuration for Kafka clients

KIP-85 vote has passed with 4 binding (Harsha, Gwen, Jason, Jun) and 4 non-binding (Mickael, Jim, Edo, me) votes. Thank you all for your votes and comments. I will update the KIP page and rebase the PR. Many thanks, Rajini On Mon, Oct 31, 2016 at 11:29 AM, Edoardo Comar

[GitHub] kafka pull request #2087: MINOR: Fix NPE when Connect offset contains non-pr...

GitHub user mfenniak opened a pull request: https://github.com/apache/kafka/pull/2087 MINOR: Fix NPE when Connect offset contains non-primitive type When storing a non-primitive type in a Connect offset, the following NullPointerException will occur: ``` 07:18:23.702

[jira] [Updated] (KAFKA-3751) Add support for SASL/SCRAM mechanisms

[ https://issues.apache.org/jira/browse/KAFKA-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-3751: -- Description: Salted Challenge Response Authentication Mechanism (SCRAM) provides secure

[jira] [Updated] (KAFKA-3751) Add support for SASL mechanism SCRAM-SHA-256

[ https://issues.apache.org/jira/browse/KAFKA-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-3751: -- Fix Version/s: 0.10.2.0 Status: Patch Available (was: Open) KIP corresponding to

[jira] [Commented] (KAFKA-3751) Add support for SASL mechanism SCRAM-SHA-256

[ https://issues.apache.org/jira/browse/KAFKA-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625436#comment-15625436 ] ASF GitHub Bot commented on KAFKA-3751: --- GitHub user rajinisivaram opened a pull request:

[GitHub] kafka pull request #2086: KAFKA-3751: SASL/SCRAM implementation

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/2086 KAFKA-3751: SASL/SCRAM implementation Implementation of KIP-84: https://cwiki.apache.org/confluence/display/KAFKA/KIP-84%3A+Support+SASL+SCRAM+mechanisms You can merge this pull request into

[jira] [Comment Edited] (KAFKA-4360) Controller may deadLock when autoLeaderRebalance encounter zk expired

[ https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625317#comment-15625317 ] Json Tu edited comment on KAFKA-4360 at 11/1/16 12:38 PM: -- I put a pull

[jira] [Commented] (KAFKA-4360) Controller may deadLock when autoLeaderRebalance encounter zk expired

[ https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625317#comment-15625317 ] Json Tu commented on KAFKA-4360: I put a pull request：https://github.com/apache/kafka/pull/2085，can

[jira] [Commented] (KAFKA-4348) On Mac OS, KafkaConsumer.poll returns 0 when there are still messages on Kafka server

[ https://issues.apache.org/jira/browse/KAFKA-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625312#comment-15625312 ] Yiquan Zhou commented on KAFKA-4348: I think I get the issue with the console consumer as well... Here

[GitHub] kafka pull request #2085: KAFKA-4360：Controller may deadLock when autoLead...

GitHub user xiguantiaozhan opened a pull request: https://github.com/apache/kafka/pull/2085 KAFKA-4360：Controller may deadLock when autoLeaderRebalance encounter zk expired You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-4361) Streams does not respect user configs for "default" params

[ https://issues.apache.org/jira/browse/KAFKA-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625026#comment-15625026 ] ASF GitHub Bot commented on KAFKA-4361: --- GitHub user dguy opened a pull request:

[GitHub] kafka pull request #2084: KAFKA-4361: Streams does not respect user configs ...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2084 KAFKA-4361: Streams does not respect user configs for "default" params Enable user provided consumer and producer configs to override the streams default configs. You can merge this pull request

[GitHub] kafka pull request #2083: KAFKA-4318 Migrate ProducerSendTest to the new con...

GitHub user baluchicken opened a pull request: https://github.com/apache/kafka/pull/2083 KAFKA-4318 Migrate ProducerSendTest to the new consumer You can merge this pull request into a Git repository by running: $ git pull https://github.com/baluchicken/kafka-1 KAFKA-4318

[jira] [Commented] (KAFKA-4318) Migrate ProducerSendTest to the new consumer

[ https://issues.apache.org/jira/browse/KAFKA-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624934#comment-15624934 ] ASF GitHub Bot commented on KAFKA-4318: --- GitHub user baluchicken opened a pull request:

[jira] [Commented] (KAFKA-4362) Offset commits fail after a partition reassignment

[ https://issues.apache.org/jira/browse/KAFKA-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624520#comment-15624520 ] Joel Koshy commented on KAFKA-4362: --- Btw, the summary doesn't make it clear that this also affects

[jira] [Comment Edited] (KAFKA-4360) Controller may deadLock when autoLeaderRebalance encounter zk expired

[ https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624461#comment-15624461 ] Json Tu edited comment on KAFKA-4360 at 11/1/16 6:22 AM: - it is wonderful，I search

[jira] [Updated] (KAFKA-4360) Controller may deadLock when autoLeaderRebalance encounter zk expired

[ https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Json Tu updated KAFKA-4360: --- Reviewer: Json Tu > Controller may deadLock when autoLeaderRebalance encounter zk expired >