UNSUBSCIBE ME

2017-04-10 Thread Zac Harvey
UNSUBSCRIBE ME (BTW this doesn't work)

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Hi how do I unsubscribe from this mailist list, the details in the docs are not the correct set of steps. From: Zac Harvey <zac.har...@welltok.com> Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misl

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Hi, how do I unsubscribe from this mailing list. From: Zac Harvey <zac.har...@welltok.com> Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misleading/broken/outdated I am trying to unsubscribe to this m

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Any ideas? From: Zac Harvey <zac.har...@welltok.com> Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misleading/broken/outdated I am trying to unsubscribe to this mailing list. When I go to:

Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
I am trying to unsubscribe to this mailing list. When I go to: https://kafka.apache.org/contact Apache Kafka kafka.apache.org Contact Mailing Lists. We have a few mailing lists hosted by Apache: users@kafka.apache.org: A list for general user questions about

Console producer can connect locally but not locally

2017-01-25 Thread Zac Harvey
I have a single Kafka node at, say, IP address 1.2.3.4. If I SSH into that node from 2 different terminal windows, and run the console consumer from 1 terminal, and the console producer from another terminal, everything works great: # Run the consumer from terminal 1

Re: Kafka Streams: how can I get the name of the Processor when calling `KStream.process`

2017-01-18 Thread Zac Harvey
Sorry that last response was for a different thread - please ignore (and sorry!) From: Michael Noll Sent: Wednesday, January 18, 2017 9:56:35 AM To: users@kafka.apache.org Subject: Re: Kafka Streams: how can I get the name of the Processor

Re: Correlation Id errors for both console producer and consumer

2017-01-18 Thread Zac Harvey
Anybody ever seen this before? Anybody have any ideas as to where I can start troubleshooting? From: Zac Harvey <zac.har...@welltok.com> Sent: Tuesday, January 17, 2017 4:40:35 PM To: users@kafka.apache.org Subject: Re: Correlation Id errors for both c

Re: Kafka Streams: how can I get the name of the Processor when calling `KStream.process`

2017-01-18 Thread Zac Harvey
Anybody ever seen this before? Anybody have any ideas as to where I can start troubleshooting? From: Michael Noll Sent: Wednesday, January 18, 2017 9:56:35 AM To: users@kafka.apache.org Subject: Re: Kafka Streams: how can I get the name of

Re: Correlation Id errors for both console producer and consumer

2017-01-17 Thread Zac Harvey
lation Id errors for both console producer and consumer What versions of Kafka and Zookeeper are you using? On Tue, Jan 17, 2017 at 11:57 AM, Zac Harvey <zac.har...@welltok.com> wrote: > I have 2 Kafkas backed by 3 ZK nodes. I want to test the Kafka nodes by > running the kafk

Correlation Id errors for both console producer and consumer

2017-01-17 Thread Zac Harvey
I have 2 Kafkas backed by 3 ZK nodes. I want to test the Kafka nodes by running the kafka-console-producer and -consumer locally on each node. So I SSH into one of my Kafka brokers using 2 different terminals. In terminal #1 I run the consumer like so:

Re: Writing a customized principal builder for authorization

2016-11-30 Thread Zac Harvey
How do you then modify Kafka's searchable classpath to pick up this new principal.builder.class classfile from a JAR somewhere on the filesystem? In other words, I change my server.properties to: principal.builder.class=com.example.kafkautils.MyCustomKafkaPrincipalBuilder How will Kafka be

Re: Messages intermittently get lost

2016-11-30 Thread Zac Harvey
ble results from zookeeper feeds Thanks Martin __ ________ From: Zac Harvey <zac.har...@welltok.com> Sent: Tuesday, November 29, 2016 10:46 AM To: users@kafka.apache.org Subject: Re: Messages intermittently get lost D

Re: Messages intermittently get lost

2016-11-29 Thread Zac Harvey
Does anybody have any idea why ZK might be to blame if messages sent by a Kafka producer fail to be received by a Kafka consumer? From: Zac Harvey <zac.har...@welltok.com> Sent: Monday, November 28, 2016 9:07:41 AM To: users@kafka.apache.org Subject: Re: Me

Re: Messages intermittently get lost

2016-11-28 Thread Zac Harvey
gai...@hotmail.com> Sent: Friday, November 25, 2016 1:46:28 PM To: users@kafka.apache.org Subject: Re: Messages intermittently get lost From: Zac Harvey <zac.har...@welltok.com> Sent: Friday, November 25, 2016 6:17 AM To: users@kafka.apache.org Subject:

Re: Messages intermittently get lost

2016-11-25 Thread Zac Harvey
Martin __ From: Zac Harvey <zac.har...@welltok.com> Sent: Thursday, November 24, 2016 7:05 AM To: users@kafka.apache.org Subject: Re: Messages intermittently get lost Anybody?!? This is very disconcerting! _

Re: Messages intermittently get lost

2016-11-24 Thread Zac Harvey
Anybody?!? This is very disconcerting! From: Zac Harvey <zac.har...@welltok.com> Sent: Wednesday, November 23, 2016 5:07:45 AM To: users@kafka.apache.org Subject: Messages intermittently get lost I am playing around with Kafka and have a simple setup: *

Messages intermittently get lost

2016-11-23 Thread Zac Harvey
I am playing around with Kafka and have a simple setup: * 1-node Kafka (Ubuntu) server * 3-node ZK cluster (each on their own Ubuntu server) I have a consumer written in Scala and am using the kafka-console-producer (v0.10) that ships with the distribution. I'd say about 20% of the

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
#1 and change Rule #2 to use port 9093, you should be able to test PLAINTEXT without changing Kafka config. On Mon, Nov 21, 2016 at 3:32 PM, Zac Harvey <zac.har...@welltok.com> wrote: > In the last email I should have mentioned: don't pay too much attention to > the code snippet, and

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
configs on the Kafka broker? From: Zac Harvey <zac.har...@welltok.com> Sent: Thursday, November 17, 2016 4:44:06 PM To: users@kafka.apache.org Subject: Can Kafka/SSL be terminated at a load balancer? We have two Kafka nodes and for reasons outside of this qu

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
connect to the > leader of a partition to produce/consume messages. If we put a LB in front > of all brokers which means all brokers share the same LB how does the LB > figure out the leader? > On Mon, Nov 21, 2016 at 10:26 PM Martin Gainty <mgai...@hotmail.com> > wrote: > &

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
lients will not be authenticated by Kafka. They talk SSL to the load balancer and the load balancer uses PLAINTEXT without authentication to talk to Kafka. On Mon, Nov 21, 2016 at 1:29 PM, Zac Harvey <zac.har...@welltok.com> wrote: > *Awesome* explanation Rajini - thank you! > > > Just to confirm: the

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
ke: KafkaServer { org.apache.kafka.common.security.plain.PlainLoginModule required username="kafka" user_kafka="kafka-password" password="kafka-password"; }; Hope that helps. On Fri, Nov 18, 2016 at 6:39 PM, Zac Harvey <zac.har...@welltok.com> wr

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-18 Thread Zac Harvey
ducer and consumer that are shipped with Kafka to make sure it is working before you run with Ruby clients. On Fri, Nov 18, 2016 at 1:23 PM, Zac Harvey <zac.har...@welltok.com> wrote: > > Thanks Rajini, > > > So currently one of our Kafka nodes is 'mykafka01.example.com', and

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-18 Thread Zac Harvey
t;broker. You need to configure Kafka brokers with the proxy host as the host in the advertised listeners for the security protocol used by clients. On Thu, Nov 17, 2016 at 9:44 PM, Zac Harvey <zac.har...@welltok.com> wrote: > We have two Kafka nodes and for reasons outside of this question, wo

Can Kafka/SSL be terminated at a load balancer?

2016-11-17 Thread Zac Harvey
We have two Kafka nodes and for reasons outside of this question, would like to set up a load balancer to terminate SSL with producers (clients). The SSL cert hosted by the load balancer will be signed by trusted/root CA that clients should natively trust. Is this possible to do, or does