Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Rajini Sivaram
PlainLoginModule required >> >> username="someuser" >> >> user_kafka="somePassword" >> >> password="kafka-password"; >> >> }; >> >> >> The fact that I can no longer even consume from a topic over P

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Rajini Sivaram
t; (which is a regression of where I was before we started trying to add SSL) > tells me there is something wrong in either server.properties or jaas.conf. > I've checked the Kafka broker logs (server.log) each time I try connecting > and this is the only line that gets printed: > > >

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
rajinisiva...@googlemail.com> Sent: Monday, November 21, 2016 11:03:14 AM To: users@kafka.apache.org Subject: Re: Can Kafka/SSL be terminated at a load balancer? Rule #1 and Rule #2 cannot co-exist. You are basically configuring your LB to point to a Kafka broker and you are pointing eac

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Rajini Sivaram
I was really asking was: does that exception > (ClosedChannelException) indicate bad configs on the Kafka broker? > > > From: Zac Harvey <zac.har...@welltok.com> > Sent: Thursday, November 17, 2016 4:44:06 PM > To: users@kafka.apache.org > Subjec

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
configs on the Kafka broker? From: Zac Harvey <zac.har...@welltok.com> Sent: Thursday, November 17, 2016 4:44:06 PM To: users@kafka.apache.org Subject: Can Kafka/SSL be terminated at a load balancer? We have two Kafka nodes and for reasons outside of this qu

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
ubleshoot it? Thanks again! Best, Zac From: Rajini Sivaram <rajinisiva...@googlemail.com> Sent: Monday, November 21, 2016 10:11:00 AM To: users@kafka.apache.org Subject: Re: Can Kafka/SSL be terminated at a load balancer? A load balancer that balances the load a

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Rajini Sivaram
<mgai...@hotmail.com> > wrote: > > > > > > > > > > > > > From: Zac Harvey <zac.har...@welltok.com> > > Sent: Monday, November 21, 2016 8:59 AM > > To: users@kafka.apache.org > > Subject: Re: C

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Rajini Sivaram
u've already helped me more > > than you know! > > > > > > Zac > > > > ____ > > From: Rajini Sivaram <rajinisiva...@googlemail.com> > > Sent: Monday, November 21, 2016 3:53:47 AM > > To: users@kafka.apache.org

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread tao xiao
<mgai...@hotmail.com> wrote: > > > > > > From: Zac Harvey <zac.har...@welltok.com> > Sent: Monday, November 21, 2016 8:59 AM > To: users@kafka.apache.org > Subject: Re: Can Kafka/SSL be terminated at a load balancer? > > T

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Martin Gainty
From: Zac Harvey <zac.har...@welltok.com> Sent: Monday, November 21, 2016 8:59 AM To: users@kafka.apache.org Subject: Re: Can Kafka/SSL be terminated at a load balancer? Thanks again Rajini, Using these configs, would clients connect to the load ba

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
balancer! Best, Zac From: Rajini Sivaram <rajinisiva...@googlemail.com> Sent: Monday, November 21, 2016 8:48:41 AM To: users@kafka.apache.org Subject: Re: Can Kafka/SSL be terminated at a load balancer? Zac, Yes, that is correct. Ruby c

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Rajini Sivaram
t like so: > > > > listeners=plaintext://:9092 > > advertised.listeners=plaintext://mybalancer01.example.com:9092 > > > > Or could it just be: > > > > listeners=plaintext://:9092 > > advertised.listeners=plaintext://mykafka01.exampl

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
text://:9092 > advertised.listeners=plaintext://mykafka01.example.com:9092 > > Thanks again! > Zac > > > > > > ________ > From: Rajini Sivaram <rajinisiva...@googlemail.com> > Sent: Friday, November 18, 2016 9:57:22 AM > To: users@kafka.apa

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Rajini Sivaram
ykafka01.example.com:9092 > > Thanks again! > Zac > > > > > > ________ > From: Rajini Sivaram <rajinisiva...@googlemail.com> > Sent: Friday, November 18, 2016 9:57:22 AM > To: users@kafka.apache.org > Subject: Re: Can Kafka/SSL be

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-18 Thread Zac Harvey
<rajinisiva...@googlemail.com> Sent: Friday, November 18, 2016 9:57:22 AM To: users@kafka.apache.org Subject: Re: Can Kafka/SSL be terminated at a load balancer? You should set advertised.listeners rather than the older advertised.host.name property in server.properties: - lis

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-18 Thread Rajini Sivaram
figs that will need to be made for the Ruby > clients to connect over SSL? > > > Thank you enormously here! > > > Best, > > Zac > > > > From: Rajini Sivaram <rajinisiva...@googlemail.com> > Sent: Friday, November 18,

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-18 Thread Zac Harvey
, Zac From: Rajini Sivaram <rajinisiva...@googlemail.com> Sent: Friday, November 18, 2016 5:15:13 AM To: users@kafka.apache.org Subject: Re: Can Kafka/SSL be terminated at a load balancer? Zac, Kafka has its own built-in load-balancing mechanism based on partition assignment. Requests a

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-18 Thread Rajini Sivaram
Zac, Kafka has its own built-in load-balancing mechanism based on partition assignment. Requests are processed by partition leaders, distributing load across the brokers in the cluster. If you want to put a proxy like HAProxy with SSL termination in front of your brokers for added security, you

Can Kafka/SSL be terminated at a load balancer?

2016-11-17 Thread Zac Harvey
We have two Kafka nodes and for reasons outside of this question, would like to set up a load balancer to terminate SSL with producers (clients). The SSL cert hosted by the load balancer will be signed by trusted/root CA that clients should natively trust. Is this possible to do, or does