[jira] [Created] (KAFKA-7210) Add system test for log compaction

2018-07-26 Thread Manikumar (JIRA)
Manikumar created KAFKA-7210: Summary: Add system test for log compaction Key: KAFKA-7210 URL: https://issues.apache.org/jira/browse/KAFKA-7210 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: kafka-trunk-jdk10 #318

2018-07-26 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H23 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-1.1-jdk7 #168

2018-07-26 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H24 (ubuntu xenial) in workspace

Re: Discussion: New components in JIRA?

2018-07-26 Thread Ray Chiang
Thanks Guozhang.  I'm good with the way the documentation is now. Is there any other procedure to follow to get "logging" and "mirrormaker" added as components or can we just request a JIRA admin to do that on this list? -Ray On 7/23/18 4:56 PM, Guozhang Wang wrote: I've just updated the

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

2018-07-26 Thread Stanislav Kozlovski
Hey guys, @Colin - good point. I added some sentences mentioning recent improvements in the introductory section. *Disk Failure* - I tend to agree with what Colin said - once a disk fails, you don't want to work with it again. As such, I've changed my mind and believe that we should mark the

[jira] [Created] (KAFKA-7209) Kafka stream does not rebalance when one node gets down

2018-07-26 Thread Yogesh BG (JIRA)
Yogesh BG created KAFKA-7209: Summary: Kafka stream does not rebalance when one node gets down Key: KAFKA-7209 URL: https://issues.apache.org/jira/browse/KAFKA-7209 Project: Kafka Issue Type:

Re: Processor API StateStore and Recovery with State Machines question.

2018-07-26 Thread Adam Bellemare
Thanks Guozhang, I appreciate the explanation. That cleared up a lot for me and confirmed what I thought. Based on the above, in my scenario, the state machine could get into an incorrect state. (Just for whoever may be watching this thread). On Tue, Jul 24, 2018 at 6:20 PM, Guozhang Wang

Re: [DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer

2018-07-26 Thread Vahid S Hashemian
Hi Jason, That makes sense. I have updated the KIP based on the recent feedback. Thanks! --Vahid From: Jason Gustafson To: dev Date: 07/25/2018 02:23 PM Subject:Re: [DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer Hi Vahid, I was thinking we'd

[jira] [Resolved] (KAFKA-7126) Reduce number of rebalance for large consumer groups after a topic is created

2018-07-26 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7126. - Resolution: Fixed > Reduce number of rebalance for large consumer groups after a topic is created >

Re: [DISCUSS] KIP-320: Allow fetchers to detect and handle log truncation

2018-07-26 Thread Anna Povzner
Hi Jason, Thanks for the update. I agree with the current proposal. Two minor comments: 1) In “API Changes” section, first paragraph says that “users can catch the more specific exception type and use the new `seekToNearest()` API defined below.”. Since LogTruncationException “will include the

[jira] [Resolved] (KAFKA-4690) IllegalStateException using DeleteTopicsRequest when delete.topic.enable=false

2018-07-26 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-4690. -- Resolution: Duplicate Resolving as duplicate of KAFKA-5975. > IllegalStateException using

[jira] [Created] (KAFKA-7211) MM should handle timeouts in commitSync

2018-07-26 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-7211: -- Summary: MM should handle timeouts in commitSync Key: KAFKA-7211 URL: https://issues.apache.org/jira/browse/KAFKA-7211 Project: Kafka Issue Type:

Jenkins build is back to normal : kafka-trunk-jdk8 #2840

2018-07-26 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk10 #319

2018-07-26 Thread Apache Jenkins Server
See Changes: [lindong28] KAFKA-7126; Reduce number of rebalance for large consumer group after a -- [...truncated 1.54 MB...]

Build failed in Jenkins: kafka-1.1-jdk7 #169

2018-07-26 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H24 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #2842

2018-07-26 Thread Apache Jenkins Server
See Changes: [github] KAFKA-7192: Wipe out if EOS is turned on and checkpoint file does not -- [...truncated 428.79 KB...] kafka.utils.SchedulerTest >

Jenkins build is back to normal : kafka-trunk-jdk10 #322

2018-07-26 Thread Apache Jenkins Server
See

[DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-07-26 Thread Boyang Chen
Hey friends, I would like to open a discussion thread on KIP-345: https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Reduce+multiple+consumer+rebalances+by+specifying+member+id This KIP is trying to resolve multiple rebalances by maintaining the consumer member id across rebalance

Jenkins build is back to normal : kafka-2.0-jdk8 #92

2018-07-26 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk10 #321

2018-07-26 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H31 (ubuntu xenial) in workspace

Re: [VOTE] 2.0.0 RC3

2018-07-26 Thread Guozhang Wang
+1. Validated the following: 1. quick start on binary (2.12) 2. unit test on source 3. javadoc 4. web doc 5. included jars (2.12). Thanks Rajini! Guozhang On Wed, Jul 25, 2018 at 8:10 AM, Ron Dagostino wrote: > +1 (non-binding) > > Built from source and exercised the new SASL/OAUTHBEARER

Re: [Vote] KIP-321: Update TopologyDescription to better represent Source and Sink Nodes

2018-07-26 Thread Matthias J. Sax
+1 (binding) -Matthias On 7/25/18 7:47 PM, Ted Yu wrote: > +1 > > On Wed, Jul 25, 2018 at 7:24 PM Nishanth Pradeep > wrote: > >> Hello, >> >> I'm calling a vote for KIP-321: >> >> >>

Re: [Vote] KIP-321: Update TopologyDescription to better represent Source and Sink Nodes

2018-07-26 Thread Guozhang Wang
+1 On Wed, Jul 25, 2018 at 11:13 PM, Matthias J. Sax wrote: > +1 (binding) > > -Matthias > > On 7/25/18 7:47 PM, Ted Yu wrote: > > +1 > > > > On Wed, Jul 25, 2018 at 7:24 PM Nishanth Pradeep > > wrote: > > > >> Hello, > >> > >> I'm calling a vote for KIP-321: > >> > >> > >>

[jira] [Created] (KAFKA-7208) AlterConfigsRequest with null config value throws NullPointerException

2018-07-26 Thread Sean Policarpio (JIRA)
Sean Policarpio created KAFKA-7208: -- Summary: AlterConfigsRequest with null config value throws NullPointerException Key: KAFKA-7208 URL: https://issues.apache.org/jira/browse/KAFKA-7208 Project:

[jira] [Resolved] (KAFKA-7192) State-store can desynchronise with changelog

2018-07-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7192. -- Resolution: Fixed > State-store can desynchronise with changelog >

Jenkins build is back to normal : kafka-1.1-jdk7 #170

2018-07-26 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk10 #317

2018-07-26 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H23 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #316

2018-07-26 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5886; Introduce delivery.timeout.ms producer config (KIP-91) [github] MINOR: Caching layer should forward record timestamp (#5423) --

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

2018-07-26 Thread Ray Chiang
Thanks for creating this KIP Stanislav.  My observations: 1) I agree with Colin that threads automatically re-launching threads generally isn't a great idea.  Metrics and/or monitoring threads are generally much safer.  And there's always the issue of what happens if the re-launcher dies?

Build failed in Jenkins: kafka-trunk-jdk8 #2841

2018-07-26 Thread Apache Jenkins Server
See Changes: [lindong28] KAFKA-7126; Reduce number of rebalance for large consumer group after a -- [...truncated 885.29 KB...] kafka.utils.SchedulerTest >

Build failed in Jenkins: kafka-trunk-jdk10 #320

2018-07-26 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H23 (ubuntu xenial) in workspace

CVE-2017-12610: Authenticated Kafka clients may impersonate other users

2018-07-26 Thread Rajini Sivaram
CVE-2017-12610: Authenticated Kafka clients may impersonate other users Severity: Moderate Vendor: The Apache Software Foundation Versions Affected: Apache Kafka 0.10.0.0 to 0.10.2.1, 0.11.0.0 to 0.11.0.1 Description: Authenticated Kafka clients may use impersonation via a manually

CVE-2018-1288: Authenticated Kafka clients may interfere with data replication

2018-07-26 Thread Rajini Sivaram
CVE-2018-1288: Authenticated Kafka clients may interfere with data replication Severity: Moderate Vendor: The Apache Software Foundation Versions Affected: Apache Kafka 0.9.0.0 to 0.9.0.1, 0.10.0.0 to 0.10.2.1, 0.11.0.0 to 0.11.0.2, 1.0.0 Description: Authenticated Kafka users may

Re: [DISCUSS] KIP-342 Add Customizable SASL extensions to OAuthBearer authentication

2018-07-26 Thread Rajini Sivaram
Looks good. Thanks, Stanislav. On Wed, Jul 25, 2018 at 7:46 PM, Stanislav Kozlovski wrote: > Hi Rajini, > > I updated the KIP. Please check if the clarification is okay > > On Wed, Jul 25, 2018 at 10:49 AM Rajini Sivaram > wrote: > > > Hi Stanislav, > > > > 1. Can you clarify the following

Re: [VOTE] KIP-342 - Add support for custom SASL extensions in OAuthBearer authentication

2018-07-26 Thread Rajini Sivaram
Hi Stanislav, Thanks for the KIP. +1 (binding) Regards, Rajini On Wed, Jul 25, 2018 at 6:41 PM, Ron Dagostino wrote: > +1 (Non-binding). Thanks for the KIP and the PR, Stanislav. > > Ron > > On Wed, Jul 25, 2018 at 1:04 PM Stanislav Kozlovski < > stanis...@confluent.io> > wrote: > > > Hey

[jira] [Resolved] (KAFKA-7208) AlterConfigsRequest with null config value throws NullPointerException

2018-07-26 Thread Sean Policarpio (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Policarpio resolved KAFKA-7208. Resolution: Not A Problem Oops, realised I misunderstood how this API request works;