Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-03-24 Thread Maulin Vasavada
JSSE >>>> spec >>>> > for >>>> > > SSL Connection. >>>> > > >>>> > > I will try to respond to code comments in couple of weeks since I >>>> am out >>>> > > for few weeks. Will

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-03-23 Thread Maulin Vasavada
;> > > for few weeks. Will keep you guys posted. >>> > > >>> > > Thanks >>> > > Maulin >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> > > >>&g

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-03-23 Thread Maulin Vasavada
gt; > > wrote: >> > > >> > >> Many of these points came up before. >> > >> >> > >> I had great hope when Maulin suggested the custom factory could >> > >> return an SSLContext instead of SSLEngine. SSLContext factories a

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-03-11 Thread Maulin Vasavada
Context factories are > > >> common, > > >> whereas I have never seen an SSLEngine factory being used before. > > >> He must have hit the same problem I had with the Mode. > > >> > > >> If the Mode can be removed, can we find a way to r

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-03-11 Thread Rajini Sivaram
factories are > >> common, > >> whereas I have never seen an SSLEngine factory being used before. > >> He must have hit the same problem I had with the Mode. > >> > >> If the Mode can be removed, can we find a way to return an SSLContext > now? >

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-03-04 Thread Maulin Vasavada
; If the Mode can be removed, can we find a way to return an SSLContext now? >> What is so special about Kafka that it needs to hardcode the Mode when >> everyone >> else works with the SSLContext and ignores the other mode they don't use. >> >> -Original Message- >>

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-02-05 Thread Maulin Vasavada
:rajinisiva...@gmail.com] > Sent: Wednesday, February 5, 2020 10:03 AM > To: dev > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration > extensible > > One more point: > 5) We should also add a method to SslEngineFactory that returns > `Set > reconfigura

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-02-05 Thread Pellerin, Clement
...@gmail.com] Sent: Wednesday, February 5, 2020 10:03 AM To: dev Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible One more point: 5) We should also add a method to SslEngineFactory that returns `Set reconfigurableConfigs()` On Wed, Feb 5, 2020 at 1:50 PM Rajini

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-02-05 Thread Rajini Sivaram
;> SSLContext >> >>>>> object instead and keep SslFactory more-or-less as it is today with >> some >> >>>>> additional responsibility of createEngine() method. >> >>>>> >> >>>>> Thanks >> >>>>> M

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-02-05 Thread Rajini Sivaram
ion/building pluggable and that's it! > >>>>>> > > >>>>>> > Thanks > >>>>>> > Maulin > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>>

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-01-26 Thread Maulin Vasavada
gt;>>> > >>>>>> > >>>>>> > >>>>>> > On Mon, Oct 7, 2019 at 5:47 AM Pellerin, Clement < >>>>>> clement_pelle...@ibi.com> >>>>>> > wrote: >>>>>> > >>>&

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-01-23 Thread Maulin Vasavada
we have are: >>>>> 1) reuse of the validation code in the existing SslFactory >>>>> 2) the client/server mode on the SSLEngine >>>>> >>>>> How do you deal with those issues in your new proposal? >>>>> >>>>>

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-01-22 Thread Maulin Vasavada
Changing the order of the JCE providers in the java.security file >>>> affects >>>> >> all java applications so you probably don't want to do it there. >>>> Changing >>>> >> the order of the JCE providers in the JVM instance affects all code >>

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-23 Thread Maulin Vasavada
SslFactory that returns an >>> SSLContext previously created elsewhere in the application. Can your new >>> proposal handle this use case? >>> >>> -Original Message- >>> From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] >>> Sent: F

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-16 Thread Maulin Vasavada
xt >> previously created elsewhere in the application. Can your new proposal >> handle this use case? >> >> -----Original Message- >> From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] >> Sent: Friday, October 11, 2019 2:13 AM >> To: dev@kafka.apache.org >>

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-14 Thread Maulin Vasavada
>> signed by Oracle's JCE Code Signing Certification Authority. > >> > >> > https://www.oracle.com/technetwork/java/javase/tech/getcodesigningcertificate-361306.html > >> JCE will refuse to load your provider if it is not signed. Getting the > >> certificate

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-11 Thread Pellerin, Clement
te is a pain and it takes time. You also have to worry about the >> certificate expiration date. There are JVMs that don't require signed JCE >> providers, but you cannot limit Kafka to just those JVMs. >> >> -Original Message- >> From: Maulin Vasavada [mailto

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-11 Thread Maulin Vasavada
also have to worry about the >> certificate expiration date. There are JVMs that don't require signed JCE >> providers, but you cannot limit Kafka to just those JVMs. >> >> -Original Message- >> From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] >&

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-11 Thread Maulin Vasavada
s, but you cannot limit Kafka to just those JVMs. > > -Original Message- > From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] > Sent: Friday, October 4, 2019 5:31 PM > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuratio

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-07 Thread Pellerin, Clement
[mailto:maulin.vasav...@gmail.com] Sent: Friday, October 4, 2019 5:31 PM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible In other words, Kafka doesn't necessarily need to derive another interface/mechanism to make SSLEngine pluggable. That interface

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-04 Thread Maulin Vasavada
ise >> on the reusability of the reconfiguration checks. On the other hand, we >> really have to learn more about the client/server mode customization >> because that's unavoidable at the moment. >> >> -Original Message- >> From: Maulin Vasavada [mailto:maulin.v

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-04 Thread Maulin Vasavada
tion > because that's unavoidable at the moment. > > -Original Message- > From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] > Sent: Friday, October 4, 2019 4:13 AM > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configur

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-04 Thread Pellerin, Clement
t the client/server mode customization because that's unavoidable at the moment. -Original Message- From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] Sent: Friday, October 4, 2019 4:13 AM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-10-04 Thread Maulin Vasavada
Hi all I've been having more thoughts on SSLEngine vs SSLContext pluggability (reasons for hiatus from my side until now). Based on my further research and understanding, various TLS implementations https://en.wikipedia.org/wiki/Comparison_of_TLS_implementations , makes it clear that there are

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-25 Thread Maulin Vasavada
Ack. I should be able to get back to this on Friday. On Mon, Sep 23, 2019 at 10:35 AM Pellerin, Clement wrote: > When I worked on KIP-383 I was told the way to pass extra arguments to an > instance is to add extra arguments to configure. I would now suggest we do > like the KeySerializer. If

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-23 Thread Pellerin, Clement
When I worked on KIP-383 I was told the way to pass extra arguments to an instance is to add extra arguments to configure. I would now suggest we do like the KeySerializer. If you look in KafkaProducer, it creates a KeySerializer using AbstractConfig. getConfiguredInstance(). Since

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-23 Thread Maulin Vasavada
ning what you were saying? > Do we make the checks mandatory or not? > Do we support all the use cases we want? > > -Original Message- > From: Pellerin, Clement > Sent: Friday, September 20, 2019 5:24 PM > To: dev@kafka.apache.org > Subject: RE: [DISCUSS] KIP-519: Make SSL co

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-21 Thread Pellerin, Clement
To: dev@kafka.apache.org Subject: RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible The KIP now says: We believe that making SSLEngine creation pluggable is worth to allow SSL experts to write their own implementation having the SSL domain knowledge and keep them free of knowing

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-20 Thread Pellerin, Clement
To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Thanks Clement for your thoughts. According to my current experience rewriting the code twice I would say I did what you suggest in the last point - " We must make an attempt, if

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-20 Thread Maulin Vasavada
From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] > Sent: Friday, September 20, 2019 2:40 AM > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration > extensible > > Overall my thinking is - When somebody wants to customize creation of >

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-20 Thread Pellerin, Clement
: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Overall my thinking is - When somebody wants to customize creation of SSLEngine, most likely they are more expert in dealing with SSL domain related stuff than "Kafka's reconfigurability" aspect. As a custom impl

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-20 Thread Maulin Vasavada
. You had a question on getConfiguredInstance(). >> >> >> >> The method getConfiguredInstance(key, Class) implemented in >> >> AbstractConfig is how the MetricsReporter and other extension points >> are >> >> intantiated. Creating the extension poi

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-19 Thread Maulin Vasavada
this proposal address all the reasons you had not to do exactly what > other extension points are doing? > > -Original Message- > From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] > Sent: Thursday, September 19, 2019 10:21 PM > To: dev@kafka.apache.org > Subject: Re: [D

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-19 Thread Pellerin, Clement
not to do exactly what other extension points are doing? -Original Message- From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] Sent: Thursday, September 19, 2019 10:21 PM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Hi C

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-19 Thread Maulin Vasavada
om: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] >> Sent: Wednesday, September 18, 2019 4:37 PM >> To: dev@kafka.apache.org >> Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration >> extensible >> >> Hi Clement >> >> Here are

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-19 Thread Maulin Vasavada
in Vasavada [mailto:maulin.vasav...@gmail.com] > Sent: Wednesday, September 18, 2019 4:37 PM > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration > extensible > > Hi Clement > > Here are my thoughts based on my latest re-writ

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-19 Thread Pellerin, Clement
Message- From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] Sent: Wednesday, September 18, 2019 4:37 PM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Hi Clement Here are my thoughts based on my latest re-write attempt

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-18 Thread Maulin Vasavada
gt; need to fuss about its API. > > -Original Message- > From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] > Sent: Tuesday, September 17, 2019 2:28 AM > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration > extensible

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-17 Thread Pellerin, Clement
Vasavada [mailto:maulin.vasav...@gmail.com] Sent: Tuesday, September 17, 2019 2:28 AM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Hi Clement/Rajini When I read your responses - I swing between both of your suggestions :) I see both

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-17 Thread Maulin Vasavada
gt; reconfigurableConfigs()). Non-validated configs might be of the wrong > type, > > be out of range, or missing since the default value is not applied. This > is > > a burden to the extension point developer and Kafka should provide > > utilities for this. > > > > Can you

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-16 Thread Pellerin, Clement
known configs have > changed. > > > -----Original Message----- > From: Rajini Sivaram [mailto:rajinisiva...@gmail.com] > Sent: Monday, September 16, 2019 5:29 AM > To: dev > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration > extensible > > Hi Ma

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-16 Thread Rajini Sivaram
ou suggest not to augment ConfigDef with custom configs, so that > takes > > >> care of the recursive dependency. > > >> I just noticed reconfigurableConfigs() returns Set and that > does > > >> not force the creation of a ConfigKey for custom configs. >

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-16 Thread Pellerin, Clement
implementation should decide all the reconfigurable properties. By the > way, > >> my original use case for KIP-383 was to replace all SSL configs with a > >> single name. > >> > >> It is still not clear in your email if the keystore/truststore exception >

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-16 Thread Rajini Sivaram
> clement_pelle...@ibi.com> > >> wrote: > >> > >> > I'm confused. Can you launch a reconfiguration without a config change > >> or > >> > not? > >> > > >> > If I understand the test case correctly, the des

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-14 Thread Maulin Vasavada
t;> It is still not clear in your email if the keystore/truststore exception >> is handled locally in SslFactory or by the initiator of the whole >> AlterConfig. That determines whether "AlterConfig without config changes" >> always goes through or is usually

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-13 Thread Maulin Vasavada
ove > the > > need to specify the keystore and truststore locations. The special > handling > > to detect changes in keystore/truststore should be pushed to > > DefaultSslEngineFactory and all calls to reconfigure should reach the > > SslEngineFactory instan

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-12 Thread Pellerin, Clement
terConfig without config changes" always goes through or is usually blocked early by the initiator. -Original Message- From: Rajini Sivaram [mailto:rajinisiva...@gmail.com] Sent: Thursday, September 12, 2019 2:05 PM To: dev Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine co

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-12 Thread Rajini Sivaram
reach the > SslEngineFactory instance. Am I missing something? > > -Original Message- > From: Rajini Sivaram [mailto:rajinisiva...@gmail.com] > Sent: Thursday, September 12, 2019 12:01 PM > To: dev > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration >

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-12 Thread Pellerin, Clement
>> From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] >> Sent: Thursday, September 12, 2019 2:24 AM >> To: dev@kafka.apache.org >> Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration >> extensible >> >> Thanks Clement and Rajin

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-12 Thread Rajini Sivaram
>> From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] >> Sent: Thursday, September 12, 2019 2:24 AM >> To: dev@kafka.apache.org >> Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration >> extensible >> >> Thanks Clement and Rajin

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-12 Thread Rajini Sivaram
describes that design pattern. > > -Original Message- > From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] > Sent: Thursday, September 12, 2019 2:24 AM > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration > extensible >

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-12 Thread Pellerin, Clement
. -Original Message- From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] Sent: Thursday, September 12, 2019 2:24 AM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Thanks Clement and Rajini. Let me digest what both of you said. Clearly I

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-12 Thread Maulin Vasavada
> From: Rajini Sivaram [mailto:rajinisiva...@gmail.com] > Sent: Wednesday, September 11, 2019 4:25 PM > To: dev > Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration > extensible > > Kafka already has the notion of custom configs. And we support > reconfigu

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-11 Thread Pellerin, Clement
> > > > > > > > > > > > > > > > > > > > On Tue, Sep 10, 2019 at 9:06 PM Pellerin, Clement < > clement_pelle...@ibi.com> > wrote: > > > Regarding what I labeled the simplest solution below, SslConfigs could > >

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-11 Thread Rajini Sivaram
Factory > would no longer be immutable, so maybe it is worth reconsidering how > reconfigure works for it. > > -Original Message- > From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] > Sent: Wednesday, September 11, 2019 3:29 AM > To: dev@kafka.apache.org > Subje

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-11 Thread Pellerin, Clement
Message- From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] Sent: Wednesday, September 11, 2019 3:29 AM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Hi all, Since the "custom config" seems the main topic of interest l

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-11 Thread Maulin Vasavada
--Original Message- > From: Pellerin, Clement > Sent: Tuesday, September 10, 2019 11:36 AM > To: dev@kafka.apache.org > Subject: [EXTERNAL]RE: [DISCUSS] KIP-519: Make SSL context/engine > configuration extensible > > Another solution could be a new standard ssl config that hol

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-10 Thread Pellerin, Clement
11:36 AM To: dev@kafka.apache.org Subject: [EXTERNAL]RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Another solution could be a new standard ssl config that holds a list of extra custom configs to accept. Using a custom SslEngineFactory with custom configs would require

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-10 Thread Pellerin, Clement
: Tuesday, September 10, 2019 9:35 AM To: dev@kafka.apache.org Subject: [EXTERNAL]RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible Custom config is a term I invented to mean a config that does not exist in Kafka but is specified by a custom implementation of SslEngineFactory

RE: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-10 Thread Pellerin, Clement
to say it exists. When I wrote KIP-383, I felt I needed a prototype before I could solidify the proposal. That's part of the reason why there was never a third iteration. -Original Message- From: Maulin Vasavada [mailto:maulin.vasav...@gmail.com] Sent: Tuesday, September 10, 2019 2:26

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2019-09-10 Thread Maulin Vasavada
Hi Clement/Rajini/Colin Please review our latest updates on the KIP and let me know your thoughts. Clement, please let me know if my understanding about the "custom configs" is correct based on what I wrote in the KIP. Thanks Maulin On Mon, Sep 9, 2019 at 3:28 PM Maulin Vasavada wrote: > Hi