Re: Proxying the Kafka protocol

mg>that depends on the underlying protocol you are attempting to proxy (see below) From: James Grant Sent: Monday, March 25, 2019 1:21 PM To: users@kafka.apache.org Subject: Re: Proxying the Kafka protocol Thank you all. We have in the past exposed mess

Re: Proxying the Kafka protocol

Thank you all. We have in the past exposed message streams backed by Kafka via a HTTP/POST and Websocket service which worked very well. We were able to filter messages based on schema compliance and it was very simple for the teams that generate the data to use. It also had no trouble scaling to

Re: Proxying the Kafka protocol

You might want to take a look at kafka-proxy ( see https://github.com/grepplabs/kafka-proxy ). It’s a true kafka protocol proxy and modified the metadata like advertized listeners so it works when there is no ip routing between the client and the

Re: Proxying the Kafka protocol

You might follow along with the Envoy proxy team and the work they are doing to support the Kafka binary protocol: https://github.com/envoyproxy/envoy/issues/2852 On Tue, Mar 19, 2019 at 11:46 AM Peter Bukowinski wrote: > https://docs.confluent.io/3.0.0/kafka-rest/docs/intro.html > > The Kafka

Re: Proxying the Kafka protocol

https://docs.confluent.io/3.0.0/kafka-rest/docs/intro.html The Kafka REST proxy may be what you need. You can put multiple instances behind a load balancer to scale to your needs. -- Peter (from phone) > On Mar 19, 2019, at 8:30 AM, Ryanne Dolan wrote: > > Hello James, I'm not aware of

Re: Proxying the Kafka protocol

Hello James, I'm not aware of anything like that for Kafka, but you can use MirrorMaker for network segmentation. With this approach you have one Kafka cluster in each segment and a MM cluster in the more privileged segment. You don't need to expose the privileged segment at all -- you just need

Proxying the Kafka protocol

Hello, We would like to expose a Kafka cluster running on one network to clients that are running on other networks without having to have full routing between the two networks. In this case these networks are in different AWS accounts but the concept applies more widely. We would like to access