[jira] [Created] (KAFKA-7028) super.users doesn't work with custom principals

2018-06-08 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-7028: -- Summary: super.users doesn't work with custom principals Key: KAFKA-7028 URL: https://issues.apache.org/jira/browse/KAFKA-7028 Project: Kafka Issue Type: Bug

The purpose of ProducerRecord Headers

2018-06-08 Thread ????????????
Hi team: When I reading KafkaProducer doSend() and I found each record have a Header[] headers . But I don't know why we should use the headers ? Someone could help me ? thanks a lot ~

Re: [DISCUSS] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-08 Thread Ted Yu
Since there're only two values for the optional optimization config introduced by KAFKA-6935, I wonder the overloaded build method (with Properties instance) would make the config unnecessary. nit: * @return @return the {@link Topology} that represents the specified processing logic Double

[DISCUSS] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-08 Thread Bill Bejeck
All, I'd like to start the discussion for adding an overloaded method to StreamsBuilder taking a java.util.Properties instance. The KIP is located here : https://cwiki.apache.org/confluence/display/KAFKA/KIP-312%3A+Add+Overloaded+StreamsBuilder+Build+Method+to+Accept+java.util.Properties I look

[jira] [Created] (KAFKA-7027) Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-08 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7027: -- Summary: Overloaded StreamsBuilder Build Method to Accept java.util.Properties Key: KAFKA-7027 URL: https://issues.apache.org/jira/browse/KAFKA-7027 Project: Kafka

Jenkins build is back to normal : kafka-2.0-jdk8 #8

2018-06-08 Thread Apache Jenkins Server
See

[DISCUSS] KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

2018-06-08 Thread Bruno Cadonna
Hi list, I created KIP-313 [1] for JIRA issue KAFKA-4217 [2] and I would like to put the KIP up for discussion. Best regards, Bruno [1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-313%3A+Add+KStream.flatTransform+and+KStream.flatTransformValues [2]

[jira] [Created] (KAFKA-7026) Sticky assignor could assign a partition to multiple consumers

2018-06-08 Thread Vahid Hashemian (JIRA)
Vahid Hashemian created KAFKA-7026: -- Summary: Sticky assignor could assign a partition to multiple consumers Key: KAFKA-7026 URL: https://issues.apache.org/jira/browse/KAFKA-7026 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #2717

2018-06-08 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5697: Use nonblocking poll in Streams (#5107) -- [...truncated 975.87 KB...] kafka.admin.ResetConsumerGroupOffsetTest >

Build failed in Jenkins: kafka-2.0-jdk8 #7

2018-06-08 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-7006 - remove duplicate Scala ResourceNameType in preference to… -- [...truncated 969.18 KB...]

Build failed in Jenkins: kafka-trunk-jdk8 #2716

2018-06-08 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-7006 - remove duplicate Scala ResourceNameType in preference to… [jason] KAFKA-6264; Split log segments as needed if offsets overflow the indexes

Re: kafka ack=all and min-isr

2018-06-08 Thread James Cheng
I wrote a blog post on min.isr that explains it in more detail: https://logallthethings.com/2016/07/11/min-insync-replicas-what-does-it-actually-do/ The post is 2 years old, but I think it's still correct. -James > On Jun 7, 2018, at 10:31 PM, Carl Samuelson wrote: > > Hi > > Hopefully this

[jira] [Resolved] (KAFKA-5697) StreamThread.shutdown() need to interrupt the stream threads to break the loop

2018-06-08 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5697. -- Resolution: Fixed Fix Version/s: (was: 2.1.0) 2.0.0 >

Re: Need Access to Create KIP - Second Time Requesting

2018-06-08 Thread Matthias J. Sax
Your request was already granted. Same day when you sent the first email. Did you not see my reply on the dev list? (cc'ed you this time to make sure you get the email). -Matthias On 6/8/18 5:05 AM, Adam Bellemare wrote: > Hello > > Sending a second request to get access to make a KIP. > >

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-06-08 Thread Colin McCabe
On Wed, Jun 6, 2018, at 13:10, Guozhang Wang wrote: > The reason that I'm hesitant to use the term "timeout" is that it's being > over-used for multiple semantics: request RPC timeout, consumer session > heartbeat liveness "timeout", and API blocking timeout. We can argue that > in English both of

[jira] [Resolved] (KAFKA-7006) Remove duplicate Scala ResourceNameType class

2018-06-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-7006. Resolution: Fixed merged the PR to trunk and 2.0 branch. > Remove duplicate Scala ResourceNameType class

[jira] [Created] (KAFKA-7025) Android client support

2018-06-08 Thread Martin Vysny (JIRA)
Martin Vysny created KAFKA-7025: --- Summary: Android client support Key: KAFKA-7025 URL: https://issues.apache.org/jira/browse/KAFKA-7025 Project: Kafka Issue Type: Bug Components:

[jira] [Created] (KAFKA-7024) Rocksdb state directory should be created before opening the DB

2018-06-08 Thread Abhishek Agarwal (JIRA)
Abhishek Agarwal created KAFKA-7024: --- Summary: Rocksdb state directory should be created before opening the DB Key: KAFKA-7024 URL: https://issues.apache.org/jira/browse/KAFKA-7024 Project: Kafka

Need Access to Create KIP - Second Time Requesting

2018-06-08 Thread Adam Bellemare
Hello Sending a second request to get access to make a KIP. As per: https://cwiki.apache.org/confluence/display/KAFKA/ Kafka+Improvement+Proposals I request access to be able to create a KIP for https://issues.apache.org/ jira/browse/KAFKA-4628. Wiki username: adam.bellemare Thanks, Adam

Re: [DISCUSS] 0.10.2.2 bug fix release

2018-06-08 Thread Rajini Sivaram
+1 Thanks, Matthias! On Fri, Jun 8, 2018 at 1:58 AM, Ismael Juma wrote: > One more thing, I suggest we go with what we have for all 3 releases you > are doing. We should aim to make the big fix release process as smooth as > possible and we should strive to avoid last minute additions to

Re: [DISCUSS] 0.11.0.3 bug fix release

2018-06-08 Thread Rajini Sivaram
+1 Thanks, Matthias! On Fri, Jun 8, 2018 at 1:54 AM, Ismael Juma wrote: > +1, thanks! > > On Thu, 7 Jun 2018, 11:16 Matthias J. Sax, wrote: > > > Dear all, > > > > I want to propose a 0.11.0.3 bug fix release. 0.11.0.2 is 6 months old > > and a couple of critical fixes are available for

Re: [DISCUSS] 1.0.2 bug fix release

2018-06-08 Thread Rajini Sivaram
+1 Thank you, Matthias! On Fri, Jun 8, 2018 at 1:53 AM, Ismael Juma wrote: > +1, thanks! > > On Thu, 7 Jun 2018, 11:16 Matthias J. Sax, wrote: > > > Dear all, > > > > I want to propose a 1.0.2 bug fix release. 1.0.1 is 3 months old and a > > couple of critical fixes are available for 1.0.2. >

Jenkins build is back to normal : kafka-trunk-jdk8 #2715

2018-06-08 Thread Apache Jenkins Server
See

Re: kafka ack=all and min-isr

2018-06-08 Thread Ismael Juma
The key point is: if (leaderReplica.highWatermark.messageOffset >= requiredOffset) { The high watermark only moves when all the replicas in ISR have that particular offset. Does that clarify it? Ismael On Thu, Jun 7, 2018 at 10:31 PM Carl Samuelson wrote: > Hi > > Hopefully this is the