[jira] [Resolved] (KAFKA-7338) Fix SASL Kerberos tests with Java 11

2018-08-30 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-7338. Resolution: Fixed > Fix SASL Kerberos tests with Java 11 > >

Re: [DISCUSS] KIP-362: Dynamic Session Window Support

2018-08-30 Thread Lei Chen
Hi Guozhang, Thanks for reviewing the proposal. I didn't think of out of order events and glad that you brought it up. In the example you gave, (10, 10), (19, 5), (15, 3) ... my understanding is that the correct result window should be the same as in order events (10, 10), (15, 3), (19, 5)

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-30 Thread Bill Bejeck
Sorry for chiming in late, there was a lot of detail to catch up on. Overall I'm +1 in the KIP. But I do have one question about the KIP in regards to Matthias's comments about defining dual use. In the "Proposed Changes" section, there is "Try to reduce the visibility of methods in next

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-30 Thread John Roesler
Oh! I missed one minor thing: UnlimitedWindows doesn't need to set grace (it currently does not either). Otherwise, it looks good to me! Thanks so much, -John On Thu, Aug 30, 2018 at 5:30 AM Nikolay Izhikov wrote: > Hello, John. > > I've updated KIP according on your comments. > Please, take

[VOTE] KIP-359: Verify leader epoch in produce requests

2018-08-30 Thread Jason Gustafson
Hi All, I'd like to start the vote on KIP-359: https://cwiki.apache.org/ confluence/display/KAFKA/KIP-359%3A+Verify+leader+epoch+in+produce+requests. Thanks in advance for reviewing. -Jason

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread Satish Duggana
+including both dev and user mailing lists. Hi, Thanks for the KIP. "* For us, the message keys represent some metadata which we use to either ignore messages (if a loop-back to the sender), or log some information.*" Above statement was mentioned in the KIP about how key value is used. I guess

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-30 Thread Nikolay Izhikov
John, thank you. I've updated KIP. Dear commiters, please take a look and share your opinion. В Чт, 30/08/2018 в 14:58 -0500, John Roesler пишет: > Oh! I missed one minor thing: UnlimitedWindows doesn't need to set grace > (it currently does not either). > > Otherwise, it looks good to me! >

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread Bill Bejeck
Hi, NOTE: I sent this earlier, but that message just went to the dev list. I'm including both users and dev now. Thanks for the KIP. Have you considered using the overloaded ProducerRecord constructor where you can specify the partition? I mention this as an option as I encountered the same

Re: [VOTE] KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer

2018-08-30 Thread Harsha
+1. Thanks, Harsha On Thu, Aug 30, 2018, at 4:19 AM, Attila Sasvári wrote: > Thanks for the KIP and the updates Viktor! > > +1 (non-binding) > > > > On Wed, Aug 29, 2018 at 10:44 AM Manikumar > wrote: > > > +1 (non-binding) > > > > Thanks for the KIP. > > > > On Wed, Aug 29, 2018 at 1:41 AM

Re: [DISCUSS] KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread Bill Bejeck
Hi, Thanks for the KIP. Have you considered using the overloaded ProducerRecord constructor where you can specify the partition? I mention this as an option as I encountered the same issue on a previous project and that is how we handled round-robin distribution with non-null keys. Would that

[jira] [Created] (KAFKA-7361) Kafka wont reconnect after NoRouteToHostException

2018-08-30 Thread C Schabert (JIRA)
C Schabert created KAFKA-7361: - Summary: Kafka wont reconnect after NoRouteToHostException Key: KAFKA-7361 URL: https://issues.apache.org/jira/browse/KAFKA-7361 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread M. Manna
Hey Bill, Thanks for reading the KIP, much appreciated. The reason we want it to be a separate Partitioner is because: a) We don’t want to specify partition anywhere. b) we want to be able to reuse what’s been done for NULL key in DefaultPartitioner. Using the constructor means we need to

Re: [VOTE] KIP-359: Verify leader epoch in produce requests

2018-08-30 Thread Dongjin Lee
Thanks for the KIP. I'm +1 (non-binding). Best, Dongjin On Fri, Aug 31, 2018 at 9:25 AM Dong Lin wrote: > Thanks for the KIP! > > +1 (binding) > > On Thu, Aug 30, 2018 at 3:56 PM, Jason Gustafson > wrote: > > > Hi All, > > > > I'd like to start the vote on KIP-359: https://cwiki.apache.org/ >

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread Magesh Nandakumar
+1 for this. The only small suggestion would be to possibly call this RondRobinPartitioner which makes the intent obvious. On Thu, Aug 30, 2018 at 5:31 PM Stephen Powis wrote: > Neat, this would be super helpful! I submitted this ages ago: > https://issues.apache.org/jira/browse/KAFKA- > >

[jira] [Created] (KAFKA-7362) enable kafka broker to remove orphan partitions automatically

2018-08-30 Thread xiongqi wu (JIRA)
xiongqi wu created KAFKA-7362: - Summary: enable kafka broker to remove orphan partitions automatically Key: KAFKA-7362 URL: https://issues.apache.org/jira/browse/KAFKA-7362 Project: Kafka

Re: [VOTE] KIP-359: Verify leader epoch in produce requests

2018-08-30 Thread Dong Lin
Thanks for the KIP! +1 (binding) On Thu, Aug 30, 2018 at 3:56 PM, Jason Gustafson wrote: > Hi All, > > I'd like to start the vote on KIP-359: https://cwiki.apache.org/ > confluence/display/KAFKA/KIP-359%3A+Verify+leader+epoch+in+ > produce+requests. > Thanks in advance for reviewing. > >

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread Stephen Powis
Neat, this would be super helpful! I submitted this ages ago: https://issues.apache.org/jira/browse/KAFKA- On Fri, Aug 31, 2018 at 5:04 AM, Satish Duggana wrote: > +including both dev and user mailing lists. > > Hi, > Thanks for the KIP. > > "* For us, the message keys represent some

[DISCUSS] KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread M. Manna
Hello, I opened a very simple KIP and there exists a JIRA for it. I have already sent it to users' list - but the mail thread doesn't seem to get updated. I would be grateful if any comments are available for action. Regards,

[jira] [Created] (KAFKA-7358) Extended Partitioner to Support "Always Round Robin" Selection

2018-08-30 Thread M. Manna (JIRA)
M. Manna created KAFKA-7358: --- Summary: Extended Partitioner to Support "Always Round Robin" Selection Key: KAFKA-7358 URL: https://issues.apache.org/jira/browse/KAFKA-7358 Project: Kafka Issue

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-30 Thread Nikolay Izhikov
Hello, John. I've updated KIP according on your comments. Please, take a look. Are we ready to vot now? В Ср, 29/08/2018 в 14:51 -0500, John Roesler пишет: > Hey Nikolay, sorry for the silence. I'm taking another look at the KIP > before voting... > > >1. I think the Window constructor

Re: [DISCUSS] KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread Eno Thereska
Hi there, I can't see this KIP on the KIP wiki, could you double check? Thanks Eno On Thu, Aug 30, 2018 at 9:56 AM, M. Manna wrote: > Hello, > > I opened a very simple KIP and there exists a JIRA for it. > > I have already sent it to users' list - but the mail thread doesn't seem to > get

Re: [DISCUSS] KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread M. Manna
I just added you as a "Watcher". I can see the page via this link - https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=89070828 1) visited cwiki.apache.org 2) Opened "Apache Kafka" from Space Directory 3) Browsed to Kafka Improvement Proposals (or Design Proposals). 4) From the side

[jira] [Created] (KAFKA-7359) How to align kafka partition

2018-08-30 Thread Dmitry (JIRA)
Dmitry created KAFKA-7359: - Summary: How to align kafka partition Key: KAFKA-7359 URL: https://issues.apache.org/jira/browse/KAFKA-7359 Project: Kafka Issue Type: Task Components:

Re: [VOTE] KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer

2018-08-30 Thread Attila Sasvári
Thanks for the KIP and the updates Viktor! +1 (non-binding) On Wed, Aug 29, 2018 at 10:44 AM Manikumar wrote: > +1 (non-binding) > > Thanks for the KIP. > > On Wed, Aug 29, 2018 at 1:41 AM Jason Gustafson > wrote: > > > +1 Thanks for the updates. > > > > On Tue, Aug 28, 2018 at 1:15 AM,

[jira] [Created] (KAFKA-7360) Code example in "Accessing Processor Context" misses a closing parenthesis

2018-08-30 Thread Sven Erik Knop (JIRA)
Sven Erik Knop created KAFKA-7360: - Summary: Code example in "Accessing Processor Context" misses a closing parenthesis Key: KAFKA-7360 URL: https://issues.apache.org/jira/browse/KAFKA-7360 Project:

[DISCUSS] KIP-349 Priorities for Source Topics

2018-08-30 Thread nick
Changing subject back to DISCUSS. > On Aug 20, 2018, at 6:52 AM, Jan Filipiak wrote: > > Just saying that we should peek at the Samza approach, it's a much more > powerful abstraction. We can ship a default MessageChooser > that looks at the topics priority. Thanks Jan for your input.

Re: [DISCUSS] KIP-349 Priorities for Source Topics

2018-08-30 Thread Matthias J. Sax
Nick, Would be good to understand the difference between the current approach and what Jan suggested. If we believe that the current proposal is too limited in functionality and also hard to extend later on, it might make sense to work on a more generic solution from the beginning on. On the

Re: [DISCUSS] KIP-349 Priorities for Source Topics

2018-08-30 Thread nick
Just clarifying that the API below would be in addition to the API specified in KIP-349 https://cwiki.apache.org/confluence/display/KAFKA/KIP-349%3A+Priorities+for+Source+Topics -- Nick > On Aug 30, 2018, at 9:57 AM, n...@afshartous.com wrote: > > Here’s an attempt at