Re: Developing with kafka and other non jvm languages

2018-03-27 Thread Gary Taylor
Hi Robin, Maybe this is where I have been getting confused - when I read the docs about the regex support for topics - I probably made a big assumption it was a server side thing. Is this not the case ? would explain why Ive not found much support for it lol Cheers Gary > On 26 Mar 2018,

Re: Developing with kafka and other non jvm languages

2018-03-26 Thread Dmitriy Vsekhvalnov
Hi Gary, don't have experience with other go libs (they seems to be way younger), but Sarama is quite low level, which is both at same time powerful and to some extent more complicated to work with. With pure Sarama client you have to implement wildcard (or pattern based) topic subscription

Re: Developing with kafka and other non jvm languages

2018-03-26 Thread Gary Taylor
Hi Robin - thanks for that. I started off with sarama, but found it did not (seem to) support regex matching of the topics - I tried all sorts of ‘regex as strings’ as the topic - but it has to be a string according to the interface. I will dig deeper though and look at those other clients too

Re: Developing with kafka and other non jvm languages

2018-03-26 Thread Robin Bartholdson
For go I would seriously consider using a pure go client, for the reasons listed in https://dave.cheney.net/2016/01/18/cgo-is-not-go . There is now a wealth of pure go Kafka clients to choose from: - https://github.com/Shopify/sarama

Re: Developing with kafka and other non jvm languages

2018-03-26 Thread Gary Taylor
Hi Matthias, Thanks for the reply. Ill start hunting around to see what I can find with regards to clients. I had just looked at the 2 most popular ones but you never know, the features I want may be in another library Cheers Gary > On 25 Mar 2018, at 20:24, Matthias J. Sax

Re: Developing with kafka and other non jvm languages

2018-03-25 Thread Matthias J. Sax
Gary, The Apache Kafka project itself, only maintains Java clients -- thus, your are right that those are the primary and best supported clients. (Kafka used to have Scala clients, but those are all deprecated now and will be removed eventually.) Clients in other languages are not part of Apache

Developing with kafka and other non jvm languages

2018-03-25 Thread Gary Taylor
Hi, This is a fairly generic question but has some specifics too Ill ask the specific first - I am trying to use golang to talk to kafka and it works, but a fairly important part of my application is to subscribe to information in many topics where the topic is matched server side and will