RE: WELCOME

2016-02-05 Thread Martin Gainty
for > ; > Fri, 5 Feb 2016 18:18:18 + (UTC) > Received: from BLU004-OMC2S25.hotmail.com (blu004-omc2s25.hotmail.com > [65.55.111.100]) > by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) > with ESMTPS id BB07743F1D > for >

RE: WELCOME

2016-02-08 Thread Martin Gainty
Spam-Level: > > X-Spam-Status: No, score=0.85 tagged_above=-999 required=6.31 > > tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, > > RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, > > RP_MATCHES_RCVD=-0.429, SPF_PASS=-0.001] autolearn=disabled > >

RE: gradle

2016-02-08 Thread Martin Gainty
SF Mail Server at > > > spamd2-us-west.apache.org) with ESMTP id 61BC81A06E2 > > > for > > > ; > > > Fri, 5 Feb 2016 18:18:18 + (UTC) > > > X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org > > > X-Spam-Flag: NO >

RE: gradle

2016-02-08 Thread Martin Gainty
> > --- Enclosed is a copy of the request I received. > > > > > > > > Return-Path: > > > > Received: (qmail 68068 invoked by uid 99); 5 Feb 2016 18:18:18 - > > > > Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) > &g

RE: WELCOME

2016-02-08 Thread Martin Gainty
gradle going fubar as it recurses thru core folder as soon as I replaced with maven 3.3 pom.xml's everything started to work Thanks/ Martin G

RE: WELCOME

2016-02-10 Thread Martin Gainty
drop attached pom.xml into >kafka/connect/runtime mvn compile mvn package you *should* package runtime-0.9.0.0.jar artifact in >kafka/connect/runtime/target folder Let me know if you have any problems Best Regards Martin Gainty __ > F

RE: Rest Proxy Question

2016-02-16 Thread Martin Gainty
pathping on the contacted proxy during slack periods | tee slack.lst pathping on the contacted proxy during busy periods | tee busy.lst Please Post Results here What i am suggesting is once a packet is transmitted outside your firewall the packet is beyond reach of locally hosted software such

RE: Kerberized Kafka setup issues

2016-02-23 Thread Martin Gainty
one more thing to check: specifically are the /etc/krb5.conf credentials the same you use to authenticate to ubuntu.oleg.com ? Martin __ > Subject: Re: Kerberized Kafka setup

RE: Kerberized Kafka setup issues

2016-02-24 Thread Martin Gainty
> [domain_realm] > .oleg.com = OLEG.COM > oleg.com = OLEG.COM > > Once I changed it all went fine! > > Cheers > Oleg > > On Feb 23, 2016, at 6:09 PM, Oleg Zhurakousky > > wrote: > > > > Well, I am running on the same machine, so I say ye

RE: producer SSL issue - fails with ssl.trustore location/password is not valid

2016-03-02 Thread Martin Gainty
> From: aravindan.ramachand...@gmail.com > Date: Wed, 2 Mar 2016 12:28:41 -0800 > Subject: producer SSL issue - fails with ssl.trustore location/password is > not valid > To: users@kafka.apache.org > > INFO Registered broker 10 at path /brokers/ids/10 with addresses: PLAINTEXT > -> EndPoint(ka

RE: Kafka Security

2016-03-04 Thread Martin Gainty
Although authors suggest using existing Cloud security products such as Sentry (Cloudera) or Argus (Hortonworks) once Zookeeper adopted SASL integration ..kafka folk agreed SASL would be the best way to implement securing the following Kafka features : Authentication via SSL & Kerberos through

Re: [ANNOUNCE] New committer: Damian Guy

2017-06-09 Thread Martin Gainty
congratulations damian! Martin From: Gwen Shapira Sent: Friday, June 9, 2017 4:55 PM To: users@kafka.apache.org Cc: d...@kafka.apache.org; priv...@kafka.apache.org Subject: Re: [ANNOUNCE] New committer: Damian Guy Congratulations :) On Fri, Jun 9, 2017 at 1:4

Re: [ERICSSON] - Trade Compliance: ECCN code for Apache Items

2017-06-28 Thread Martin Gainty
MG>am requesting clarification below From: Axelle Margot Sent: Tuesday, June 27, 2017 8:48 AM To: users@kafka.apache.org Cc: Celine Heerdt; Wassila BenJelloul.ext; Florent Poulain Subject: [ERICSSON] - Trade Compliance: ECCN code for Apache Items Hello, You wer

Re: Socks proxy

2017-07-31 Thread Martin Gainty
From: Jay Allen Sent: Friday, July 28, 2017 12:09 PM To: users@kafka.apache.org Subject: Socks proxy Hey guys, We're trying to use the Java Kafka client but it turns out it's not socks proxy aware - the connect uses a SocketChannel that does not work with prox

Re: How to debug - NETWORK_EXCEPTION

2017-08-12 Thread Martin Gainty
From: Raghav Sent: Thursday, August 10, 2017 12:51 AM To: Users; confluent-platf...@googlegroups.com Subject: How to debug - NETWORK_EXCEPTION Hi I am sending very small 32 byte message to Kafka broker in a tight loop with 250ms sleep. I have one broker, 1 part

Re: Federated Alerting for Prometheus, Elasticsearch and Apache Kafka systems

2017-08-17 Thread Martin Gainty
From: Lucas Ponce Sent: Thursday, August 17, 2017 10:18 AM To: users@kafka.apache.org Subject: Federated Alerting for Prometheus, Elasticsearch and Apache Kafka systems Hello, >From Hawkular team we are working to create a lightweight alerting component that

Re: SSL setup in Kafka 2.10.0.10.2.1 for keystore and truststore files

2017-09-29 Thread Martin Gainty
From: Awadhesh Gupta Sent: Friday, September 29, 2017 7:05 AM To: users@kafka.apache.org; manme...@gmail.com Subject: Re: SSL setup in Kafka 2.10.0.10.2.1 for keystore and truststore files Thanks M Manna. I followed the steps to recreate the keystore & trusts

Re: SSL setup in Kafka 2.10.0.10.2.1 for keystore and truststore files

2017-10-03 Thread Martin Gainty
From: Awadhesh Gupta Sent: Tuesday, October 3, 2017 1:44 PM To: users@kafka.apache.org; ja...@scholz.cz Subject: Re: SSL setup in Kafka 2.10.0.10.2.1 for keystore and truststore files Hi, I validated the client chain in server log after enabling the SSL log an

Re: Kafka SSL error

2017-12-26 Thread Martin Gainty
possible you are either not connecting (someone is blocking/redirecting) or possibly you are not authenticating with your security configuration parameters: are your redirecting to other IP's or Ports by intervening proxys? can you ping all the IP addresses in the cluster? can u post the resul

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-12 Thread Martin Gainty
Willkommen Matthias! Martin- From: Damian Guy Sent: Friday, January 12, 2018 7:43 PM To: users@kafka.apache.org Cc: dev Subject: Re: [ANNOUNCE] New committer: Matthias J. Sax Can't think of anyone me deserving! Congratulations Matthias! On Sat, 13 Jan 2018 at 00:1

Re: I would like to increase the bandwidth by binding each broker to each network card in one machine. Is this feasible?

2018-01-17 Thread Martin Gainty
From: 猪少爷 Sent: Tuesday, January 16, 2018 8:21 PM To: users Subject: I would like to increase the bandwidth by binding each broker to each network card in one machine. Is this feasible? I would like to increase the bandwidth by binding each broker to each netw

Re: Question Related to Zookeeper and kafka java error message.

2018-02-10 Thread Martin Gainty
From: Raymond, Shawn P CTR USARMY NETCOM (US) Sent: Thursday, February 8, 2018 2:39 PM To: users@kafka.apache.org Subject: Question Related to Zookeeper and kafka java error message. Afternoon all, I was wondering if anyone has seen the following messages appea

Re: Static IP Configuration

2018-02-15 Thread Martin Gainty
majority of commercial entities (banks/financial-houses) pass this to a CA (certifying authority) who will be responsible for generating X509 certificates generating private key generating public key generating username (aka alias) generating password this depends on what type of PKI your client

Re: Static IP Configuration

2018-02-16 Thread Martin Gainty
ation hence volume of producers would be high. All I want to ensure Broker receives data from trusted (my own) devices. On Fri, Feb 16, 2018 at 9:33 AM, Martin Gainty wrote: > majority of commercial entities (banks/financial-houses) pass this to a CA > (certifying authority) who will be respon

Re: Consultant Help

2018-03-10 Thread Martin Gainty
From: Svante Karlsson Sent: Friday, March 2, 2018 3:50 PM To: users@kafka.apache.org Subject: Re: Consultant Help try https://www.confluent.io/ - that's what they do [https://www.confluent.io/wp-content/uploads/Untitled-design-12.png]

Re: Vids Re: Running SSL and PLAINTEXT mode together (Kafka 10.2.1)

2018-03-11 Thread Martin Gainty
From: svsuj...@gmail.com Sent: Sunday, March 11, 2018 4:22 PM To: users@kafka.apache.org Cc: Ismael Juma; rajinisiva...@gmail.com Subject: Vids Re: Running SSL and PLAINTEXT mode together (Kafka 10.2.1) Chic bhari Sent from my iPhone GC > On Dec 19, 2017, at

Re: kafka offset replication factor - Any suggestion will be appreciated.

2018-03-22 Thread Martin Gainty
that toilet-shutoff-valve water pan gets emptied into sink every day Its a shame I cant get thru to your gf but I'll let you handle that Rest assured we'll get thru this Martin Gainty __ From: adrien ruffie

Please disregard last message

2018-03-22 Thread Martin Gainty
All Kindly disregard last message Thank You Martin __ From: Martin Gainty Sent: Thursday, March 22, 2018 1:13 PM To: users@kafka.apache.org Subject: Re: kafka offset replication factor - Any suggestion will be

Re: Possible to enable client SSL when PLAINTEXT brokers exist in the cluster?

2018-04-02 Thread Martin Gainty
FWIR: is a plaintext broker supported with SASL Zookeeper frontend..assuming no here are the reasons: https://www.tutorialspoint.com/apache_kafka/apache_kafka_cluster_architecture.htm [https://www.tutorialspoint.com/apache_kafka/images/cluster_architecture.jpg]

Re: Making a Window services for kafka having sasl and ssl configuration

2018-04-03 Thread Martin Gainty
From: ashish chauhan Sent: Tuesday, April 3, 2018 4:16 AM To: users@kafka.apache.org Subject: Making a Window services for kafka having sasl and ssl configuration I am trying to make Window services for kafka having sasl and ssl configuration to keep it always

Re: advertised.listeners

2018-04-03 Thread Martin Gainty
tracert MessageBrokerIP do you see ZK server in the trace? if yes then you are running kafka-cluster (ZK does not support mixed mode but there is a backdoor zookeeper.properties config attribute that allows plaintext clients to bypass sasl auth) ? Martin __

Re: advertised.listeners

2018-04-03 Thread Martin Gainty
:47 PM To: users@kafka.apache.org Subject: Re: advertised.listeners We are using 0.10.2.1 and ZK 3.4.9. Can something be derived from this piece of info ? Thanks. On Tue, Apr 3, 2018 at 3:13 PM, Martin Gainty wrote: > tracert MessageBrokerIP > > do you see ZK server in the trace? > &

Re: advertised.listeners

2018-04-04 Thread Martin Gainty
t allocation of IP addresses than the older method which was by assigning organizations a class of IPs. MG>if you dont want network segmentation you can config your Kafka ACLs explained here: https://docs.confluent.io/3.0.0/kafka/platform-security.html MG>HTH Joseph Hammerman On Tue, Apr 3, 2018

RE: Kafka+in+C#

2016-03-28 Thread Martin Gainty
please be more specific on the kafka client you are implementing..here is the list: https://cwiki.apache.org/confluence/display/KAFKA/Clients Martin __ > Date: Mon, 28 Mar 2016 15:30:31 +0530 > Subject: Kafka+in+C# > From: avadhootha...@gmail.com >

RE: java.lang.IllegalArgumentException: Heartbeat must be set lower than the session timeout

2016-03-29 Thread Martin Gainty
MG>what are the mathematical checks between Kafka session.timeout.ms and Tomcat session-timeout in web.xml? 1 MG>Thank You MG>Martin > Date: Tue, 29 Mar 2016 15:07:22 +1100 > Subject: Re: java.lang.IllegalArgumentException: Heartbeat must be set lower > than the session timeout > From: v

RE: Rest Proxy Question

2016-03-31 Thread Martin Gainty
From: Heath Ivie [mailto:hi...@autoanything.com] > Sent: Tuesday, February 16, 2016 10:44 AM > To: users@kafka.apache.org > Subject: RE: Rest Proxy Question > > Hi Martin, > > I can see the items in the queue, that is not the problem. > > The issue is when the co

RE: Encryption at Rest

2016-04-21 Thread Martin Gainty
Dave- so you want username/password credentials to be sent in response to an HTTP Get as clear text? if not this has been asked and answered with Axishttps://axis.apache.org/axis2/java/rampart/ Martin __

RE: Encryption at Rest

2016-05-03 Thread Martin Gainty
http://symc.ly/1pC2CEG ) > >>>>> > >>>>> -- Jim > >>>>> > >>>>> On 4/25/16, 11:39 AM, "David Buschman" wrote: > >>>>> > >>>>>> Kafka handles messages which are compose of an

RE: Encryption at Rest

2016-05-03 Thread Martin Gainty
/privatekey/publicKey MG>return response back to SSLclient MG>Our WS was Axis I coded one app to make a direct call to axis-web-service-with-rampart MG>similar authentication mechanism was employed but in this instance this was not universal security but a secure webservice implementa

RE: Client Protocols

2016-05-06 Thread Martin Gainty
> To: users@kafka.apache.org > From: michael.to...@headforwards.com > Subject: Client Protocols > Date: Fri, 6 May 2016 09:26:59 +0100 > > > Hi, > > I'm doing some testing with two different kafka clients: pykafka and > kafkapython > > When switching between client library, I get an error:

RE: SSL certificate CN validation against FQDN in v0.9

2016-06-01 Thread Martin Gainty
https is a protocol NOT an algorithm..no wonder this causes confusion!ssl.endpoint.identification.algorithmhttps://en.wikipedia.org/wiki/Transport_Layer_Security ismael can you change ssl.endpoint.identification.algorithm property to ssl.endpoint.identification.protocolso the property matches wh

RE: Kafka encryption

2016-06-06 Thread Martin Gainty
MG>quick questions for bruno and jim > Subject: Re: Kafka encryption > From: bruno.rassae...@novazone.be > Date: Mon, 6 Jun 2016 10:51:13 +0200 > CC: tcrayf...@heroku.com > To: users@kafka.apache.org > > Indeed to get proper performance, messages need to be batched before > encryption. > However

RE: Problem with Kafka TLS configuration "no cipher suites in common"

2016-06-07 Thread Martin Gainty
MG>Ismael...any reason not to use openssl to generate the key and the cert simultaneously?openssl req -nodes -newkey rsa:2048 -keyout kafka.server.keystore.jks -out ca.certhttps://www.networking4all.com/en/support/ssl+certificates/manuals/apache/apache+http+server/generate+csr/ MG>Thanks MG>Mart

RE: error: ... protocols are incompatible with those of existing members ??

2016-06-10 Thread Martin Gainty
> Date: Fri, 10 Jun 2016 16:54:47 +0530 > Subject: Re: error: ... protocols are incompatible with those of existing > members ?? > From: bkap...@memelet.com > To: users@kafka.apache.org > > I delete the group using kafka-consumer-groups.sh --delete and still I get > the error. MG>Barry...assum

RE: Error in znode creation after adding SASL digest on server and client

2016-07-09 Thread Martin Gainty
Sidebar: -Dcom.sun.management.jmxremote.authenticate=false why did you disable authentication? Martin __ > From: harsha...@gmail.com > Date: Fri, 8 Ju

RE: TLS based ACL: Does Kafka support multiple CA Certs on broker

2016-07-18 Thread Martin Gainty
ca2root is in client truststorecaroot is not imported into client truststorekafka.example.com is not imported into client truststore oemkafka.example.com is not imported into client truststore Martin __ > From: ka...@harsha.io > Date: Mon, 18 Jul 20

DLL Hell

2016-08-15 Thread Martin Gainty
kafka-trunk\streams>gradle buildCaused by: java.lang.RuntimeException: librocksdbjni-win64.dll was not found inside JAR.at org.rocksdb.NativeLibraryLoader.loadLibraryFromJarToTemp(NativeLibraryLoader.java:106) at org.rocksdb.NativeLibraryLoader.loadLibraryFromJar(NativeLibraryLoad

RE: DLL Hell

2016-08-16 Thread Martin Gainty
updated if this ever changes: https://github.com/facebook/rocksdb/issues/703 > > Mathieu > > > On Mon, Aug 15, 2016 at 1:34 PM, Martin Gainty wrote: > > > kafka-trunk\streams>gradle buildCaused by: java.lang.RuntimeException: > > librocksdbjni-win64.dll was not

RE: DLL Hell

2016-08-16 Thread Martin Gainty
ates Sublime Text 2 project files. MG>I am thinking if I want to automate this native build..I could more easily create binary thru maven-nar-plugin ? MG>as I do not have any MS VS or DotNet installed..maybe I need to install many gigs of MS specific VS? MG>Please advise > Mathieu >

RE: Consumer failure and producer topic deduplication

2016-08-21 Thread Martin Gainty
here is a scala test which produces UNKNOWN_MEMBER_ID @Test def testJoinGroupUnknownConsumerNewGroup() {val joinGroupResult = joinGroup(groupId, memberId, DefaultSessionTimeout, protocolType, protocols) val joinGroupErrorCode = joinGroupResult.errorCode assertEquals(Errors.UNKNOWN_ME

RE: Build Issue with Gradle

2016-08-23 Thread Martin Gainty
gradle hides alot of details such as how the package jars (how does assembly/package include external resources such as dlls?) also the gradle scala -> java conversion was empty so I retasked kafka core and client modules to regular maven pom.xml I am currently correcting my way thru 100+ compi

RE: handling generics in Kafka Scala

2016-08-30 Thread Martin Gainty
is is way outside my Kafka knowledge. I'm just a new > Kafka user who wanted to help with your Windows questions because I > had just faced the same hurdle. :-) Wish I could help, but I wouldn't > know where to start with this. > > Mathieu > > > On Wed, Aug 17,

Re: handling generics in Kafka Scala

2016-08-31 Thread Martin Gainty
declaration K, V whose parameter >> datatype >> extends java.util.ArrayList ? >> Martin >> ______ >> >> >> >>> From: mathieu.fenn...@replicon.com >>> Date: Wed, 17 Aug 2016 18:06:38 -0600 >&

RE: handling generics in Kafka Scala

2016-09-08 Thread Martin Gainty
tbend.com> > @deanwampler <http://twitter.com/deanwampler> > http://polyglotprogramming.com > > On Wed, Aug 31, 2016 at 8:08 AM, Martin Gainty wrote: > > > supposedly gmail wont strip \n so we'll try again with non-html mail > > composer > > > &g

RE: handling generics in Kafka Scala

2016-09-08 Thread Martin Gainty
x27;m just a new > Kafka user who wanted to help with your Windows questions because I > had just faced the same hurdle. :-) Wish I could help, but I wouldn't > know where to start with this. > > Mathieu > > > On Wed, Aug 17, 2016 at 6:00 PM, Martin Gainty wrote: >

RE: handling generics(solved) but new problem unearthed

2016-09-14 Thread Martin Gainty
ns: > > > trait Protocol2 { > type Stuff > def createStuff(): Stuff > } > > object KCALB2 extends Protocol2 { > type Stuff = ArrayList[Byte] > def createStuff(): ArrayList[Byte] = new ArrayList[Byte]() > } > > object KCLL2 extends Protocol2 { >

RE: any update on this?

2016-09-19 Thread Martin Gainty
Jens/Kant not aware of any shortfall with zookeeper so perhaps you can suggest advantages for Consul vs Zookeeper? Maven (I am building, testing and running kafka internally with maven) implements wagon-providers for URLConnection vs HttpURLConnection wagonshttps://maven.apache.org/guides/mini/g

RE: Consul / Zookeeper [was Re: any update on this?]

2016-09-24 Thread Martin Gainty
t;looks like we have work to do..I have a few cycles available starting Sunday..so I would definitely like to "lend a hand" > On Mon, Sep 19, 2016 at 6:31 AM, Martin Gainty wrote: > > Jens/Kant > > not aware of any shortfall with zookeeper so perhaps you can suggest &

RE: SendFailedException

2016-09-27 Thread Martin Gainty
/github.com/apache/kafka/trunk/config/zookeeper.properties which version JVM are you implementing?are you building BEFORE running kafka in which case which version Scala Compiler? Thanks Martin Gainty Enterprise *Contractor* __ > From: achintya

RE: Understanding org.apache.kafka.streams.errors.TopologyBuilderException

2016-10-08 Thread Martin Gainty
> From: sjmit...@gmail.com > Date: Sat, 8 Oct 2016 15:30:33 +0530 > Subject: Understanding > org.apache.kafka.streams.errors.TopologyBuilderException > To: users@kafka.apache.org > > Hi, > I am get

RE: HL7 messages to Kafka consumer

2016-10-12 Thread Martin Gainty
provisionally accomplished task by embedding A01,A03 and A08 HL7 Event-types into SOAP 1.2 Envelopes I remember having difficulty transporting over a non-dedicated transport such as what Kafka implements Producer Embeds Fragment1 into SOAPEnvelope Producer Sends Fragment1-SOAPEnvelope of A01 Cons

RE: HL7 messages to Kafka consumer

2016-10-12 Thread Martin Gainty
ausing or resuming partitions to your kafka consumer MG>possible side-effect of relying only on zks provider would disable this control-flow capability of kafka > Old and new consumer API is available. > > https://community.hortonworks.com/articles/20318/visualize-patients-complaints-t

RE: HL7 messages to Kafka consumer

2016-10-13 Thread Martin Gainty
uarantee the asserts from HL7api are met MG>this has little to do with kafka so lets take this offline> > On Wed, Oct 12, 2016 at 10:10 PM, Martin Gainty wrote: > > > > > > > > > > From: dbis...@gmail.com > > > Date: Wed, 12 Oct 2016 20:42:04 -04

Re: Mysterious timeout

2016-10-27 Thread Martin Gainty
MG>can u write simpleConsumer to determine when lead broker times-out.. then you'll need to tweak connection settings https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example MG>to debug the response determine the leadBroker and the reason for fetch failure as seen here: if

Re: SASL error when tring to connect kafka to kerberos server

2016-11-04 Thread Martin Gainty
//server is using a JAAS-authenticated subject: determine service principal name and hostname from kafka server's subject. elevated privilege authentication implements thru kafka-subject so when you establish your kerberos sasl server authenticator SaslServerAuthenticator(String node, final S

Re: Kafka using existing certificate authority.

2018-04-17 Thread Martin Gainty
MG>below From: Shawn Raymond Sent: Tuesday, April 17, 2018 10:25 AM To: users@kafka.apache.org Subject: Kafka using existing certificate authority. I am trying to set up apache kafka using an existing certificate authority, and I cannot find any documentation rel

Re: Using Kafka CLI without specifying the URLs every single time?

2018-04-20 Thread Martin Gainty
Hello Péter : etc/hosts PUBLIC_IP_ADDRESS FQDN SHORTNAME where shortname can be your shortened HostName (Nota Bene: be respectful of tabs, spaces and are important...best to make backup before modify) https://unix.stackexchange.com/questions/239920/how-to-set-the-fully-qualified-hostname-on

Re: Log Cleanup Support for Windows [KAFKA-1194]

2018-05-09 Thread Martin Gainty
a patch could be rejected if: 1)there is no TestCase to prove the feature works 2)the patch causes failure in an existing testcase 3)the patch errors in an existing testcase 4)the patch works in only 1 version of OS (and doesnt work in other versions of OS) 5)implementing the patch will place a d

Re: Kafka as K/V store

2018-05-09 Thread Martin Gainty
//best to do your generic type declaration at class level and refer to later KafkaConsumer consumer = new KafkaConsumer<>(props); //best to do generic type declaration at class level and refer to later java.util.HashMap hashMap=new java.util.HashMap(); hashMap.put("topic1","topi

Re: Kafka Scala debugging and diagnostics

2018-05-16 Thread Martin Gainty
supposedly scala ide for eclipse should work: http://scala-ide.org/ YMMV Martin From: M. Manna Sent: Wednesday, May 16, 2018 5:46 PM To: Kafka Users Subject: Kafka Scala debugging and diagnostics Hello, Is there anyone who can provide a few steps for settin

Re: Exactly Once, Producer configuration

2018-05-22 Thread Martin Gainty
From: thomas.k...@t-systems.com Sent: Monday, May 14, 2018 12:13 PM To: users@kafka.apache.org Subject: WG: Exactly Once, Producer configuration Hi, the following article describes how to configure Apache Kafka system to enforce exactly once approach: https:

Re: Custom AuthenticateCallbackHandler

2018-06-01 Thread Martin Gainty
are you referring to onCompleteCallback from https://github.com/apache/kafka/commit/837f31dd1850b179918f83338b4b4487486b2c58 [https://avatars2.githubusercontent.com/u/14958864?s=200&v=4] KAFKA-6927; Chunked down-con

Re: Custom AuthenticateCallbackHandler

2018-06-02 Thread Martin Gainty
null) return (String) val; } return null; } MG>so JAAS password where expected_password= user_admin MG>but your password where expected_password = user_test MG>any reason you need to implement username/password test/test instead of admin/admin ?

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

2018-06-15 Thread Martin Gainty
a strong possibility is that kafka-core is missing as a dependency for samza please supply samza pom.xml Martin __ From: Debraj Manna Sent: Friday, June 15, 2018 10:52 AM To: users@kafka.apache.org Subject: NoClass

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

2018-06-15 Thread Martin Gainty
] \- org.apache.kafka:kafka_2.11:jar:0.10.0.0:runtime On Fri, Jun 15, 2018 at 8:31 PM, Martin Gainty wrote: > a strong possibility is that kafka-core is missing as a dependency for > samza > > please supply samza pom.xml

new pom.xml for samza-grid

2018-06-15 Thread Martin Gainty
Martin Gainty has shared a OneDrive file with you. To view it, click the link below. <https://1drv.ms/u/s!AkpuiYcNg4cShUUyzyKvQmvyNPuk> [https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://1drv.ms/u/s!AkpuiYcNg4cShUUyzyKvQmvyNPuk> pom.xml<http

new pom.xml for samza-parent-project

2018-06-15 Thread Martin Gainty
Martin Gainty has shared a OneDrive file with you. To view it, click the link below. <https://1drv.ms/u/s!AkpuiYcNg4cShUb8oiOENPhRhIUV> [https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://1drv.ms/u/s!AkpuiYcNg4cShUb8oiOENPhRhIUV> pom 1.xml<http

Re: Migration Path from 0.8

2018-06-18 Thread Martin Gainty
From: Martín Fernández Sent: Monday, June 18, 2018 4:38 PM To: users@kafka.apache.org Subject: Migration Path from 0.8 Hello, First time writing in the mailing list! At this moment we are running 3 Kafka (0.8) broker cluster. We want to try to upgrade our clu

Re: Configuring Kerberos behind an ELB

2018-06-22 Thread Martin Gainty
MG>quoting stackoverflow below "You can use an ELB as the bootstrap.servers, The ELB will be used for the initial metadata request the client makes to figure out which topic partitions are on which brokers, but after (the initial metadata request) the brokers still need to be directly accessible

Re: Configuring Kerberos behind an ELB

2018-06-22 Thread Martin Gainty
Wood Cc: users@kafka.apache.org; Martin Gainty Subject: Re: Configuring Kerberos behind an ELB Ben, Yes. I want to be able to provide consumers/producers with a single address they can use to connect to the cluster. Having it behind an elb lets us scale up and replace nodes with out needing to

Re: Real time streaming as a microservice

2018-07-08 Thread Martin Gainty
initial work under using Zookeeper as a Microservices container is here http://planet.jboss.org/post/zookeeper_for_microservice_registration_and_discovery ZooKeeper for Microservice Registration and Discovery ...

Re: Real time streaming as a microservice

2018-07-08 Thread Martin Gainty
your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or

Re: [ANNOUNCE] New committer: Colin McCabe

2018-09-26 Thread Martin Gainty
welcome and congratulations Colin Martin From: Konstantine Karantasis Sent: Wednesday, September 26, 2018 1:03 PM To: d...@kafka.apache.org Cc: users@kafka.apache.org Subject: Re: [ANNOUNCE] New committer: Colin McCabe Well deserved! Congratulations Colin. -Kons

Re: How to provide certificate chain/intermediate CA to kafka broker

2018-11-09 Thread Martin Gainty
if you dont have a "certs team" you can purchase a Contract with Certificate Authority such as Verisign to handle signing X509 certs Once the certs are signed and stuffed into truststore(s) you will then be able to supply the x509 cert with public key from CA to your clients Martin __

Re: Kafka Trunk Build Failure with Gradle 5.0

2018-12-13 Thread Martin Gainty
there are at least 12 things that can go wrong with any gradle build if you can provider a link to the source-tree you are building we can be narrow down the reasons you are experiencing NoSuchMethodError for version of Kafka T & R From: Boyang Chen Sent: W

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Martin Gainty
Բարի գալուստ (Bari Galust) From: Satish Duggana Sent: Tuesday, January 15, 2019 7:54 PM To: dev Cc: Kafka Users Subject: Re: [ANNOUNCE] New Committer: Vahid Hashemian Congratulations Vahid! On Tue, Jan 15, 2019 at 5:47 PM Yishun Guan wrote: > > Congratulations

Re: Kafka SSL and multiple domain names

2019-02-14 Thread Martin Gainty
if you require security over multiple subject alt names then you will need a UCC certificate from cert-provider (godaddy/thawte/verisign are some of the providers) https://www.techopedia.com/definition/29764/unified-communications-certificate-ucc [https://cdn.techopedia.com/resource/images/favico

Re: [ANNOUNCE] New Committer: Bill B

2019-02-14 Thread Martin Gainty
and a hearty congratulations on your recent win welcome bill! Martin From: Ivan Ponomarev Sent: Thursday, February 14, 2019 5:25 AM To: d...@kafka.apache.org; users@kafka.apache.org Subject: Re: [ANNOUNCE] New Committer: Bill Bejeck Congratulations, Bill! Your

Re: [ANNOUNCE] New Committer: Randall Hauch

2019-02-15 Thread Martin Gainty
willkommen randall Martin From: Daniel Hanley Sent: Friday, February 15, 2019 6:55 AM To: users@kafka.apache.org Cc: dev Subject: Re: [ANNOUNCE] New Committer: Randall Hauch Congratulations Randall! On Fri, Feb 15, 2019 at 9:35 AM Viktor Somogyi-Vass wrote: >

Re: Proxying the Kafka protocol

2019-03-26 Thread Martin Gainty
mg>that depends on the underlying protocol you are attempting to proxy (see below) From: James Grant Sent: Monday, March 25, 2019 1:21 PM To: users@kafka.apache.org Subject: Re: Proxying the Kafka protocol Thank you all. We have in the past exposed message stre

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Martin Gainty
wilkommen matthias Martin- From: Bill Bejeck Sent: Thursday, April 18, 2019 5:45 PM To: users@kafka.apache.org Cc: dev Subject: Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax Congrats Matthias! Well deserved! -Bill On Thu, Apr 18, 2019 at 5:35 PM Guozhan

Re: SASL + SSL : authentication error in broker-to-broker communication

2019-05-15 Thread Martin Gainty
assuming ScramSaslProvider/ScramSaslServer your credentials are stored in ZK /config/users/ but you cannot see plain-text attributes in ZK so use kafka tool to view kafka-configs.sh -describe /config/users/ /*2019 update for kafka-configs.sh */ For ease of use, kafka-configs.sh will take a passw

Re: SASL + SSL : authentication error in broker-to-broker communication

2019-05-16 Thread Martin Gainty
check ? Thanks a lot. Sincerely, Kieran ________ From: Martin Gainty Sent: Wednesday, May 15, 2019 2:28 PM To: users@kafka.apache.org Subject: Re: SASL + SSL : authentication error in broker-to-broker communication assuming ScramSaslProvider/ScramSaslServer your credentials are

Re: SASL + SSL : authentication error in broker-to-broker communication

2019-05-16 Thread Martin Gainty
anks to Puppet epp templating. Seeing my ps faux, you can see that Kafka is using the jaas file as documentation is advising : -Djava.security.auth.login.config=/opt/kafka/config/kafka_server_jaas.conf I also checked that every zookeeper is able to answer the same salt, server_key for each

Re: Question about Kafka TLS

2019-05-17 Thread Martin Gainty
trust-store AKA $JAVA_HOME/lib/security/cacerts is the system-wide location for all of your certificates when your CA-server starts up unless otherwise specified CA-Server will lookup root cert(s) in truststore/cacerts if you have not installed all your root-certs into cacerts you should do so

Re: Gradle Build Fails when forked from Trunk

2019-05-19 Thread Martin Gainty

Re: Gradle Build Fails when forked from Trunk

2019-05-19 Thread Martin Gainty
with regards to classpath 'org.scoverage:gradle-scoverage:2.0.1' From: M. Manna Sent: Sunday, May 19, 2019 4:22 AM To: Kafka Users Subject: Gradle Build Fails when forked from Trunk Hello, I am trying to run gradle build on a forked repo from trunk. It seems lik

Re: Gradle Build Fails when forked from Trunk

2019-05-19 Thread Martin Gainty
with regards to missing plugin classpath 'org.scoverage:gradle-scoverage:2.0.1' must be located in the following repositories: buildscript { repositories { mavenCentral() jcenter() } From: M. Manna Sent: Sunday, May 19, 2019 4:22 AM To: Kafka Users S

Re: Gradle Build Fails when forked from Trunk

2019-05-20 Thread Martin Gainty
out of the box. > > I will try your proposed solution above. > > Thanks, > > On Mon, 20 May 2019 at 01:44, Martin Gainty wrote: > >> with regards to missing plugin >> classpath 'org.scoverage:gradle-scoverage:2.0.1' >> >> must be located

Re: Unable to build

2019-06-04 Thread Martin Gainty
in build.gradle assuming sourceSets is defined as sourceSets { main { java { srcDirs = ['src/java'] } resources { srcDirs = ['src/resources'] } } } add missing source files: org.apache.kafka.common.security.authenticator.SaslServerCa

  1   2   >