Kafka producer iOS and android
hi Is it possible to have iOS and android to run the code needed for Kafka producers ? I want to have mobile clients connect to Kafka broker Thanks, Josh
Re: Kafka producer iOS and android
Hi Josh, Why not have Rest api service running where you post messages from your mobile clients. Rest api can run kafka producers accepting these messages pushing it into kafka brokers. Here is an example where we did similar service for kafka https://github.com/mozilla-metrics/bagheera . This project used kafka 0.7 but you can see how its implemented. Hope that helps. -Harsha On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote: hi Is it possible to have iOS and android to run the code needed for Kafka producers ? I want to have mobile clients connect to Kafka broker Thanks, Josh
Re: Kafka producer iOS and android
Thanks for the tip. I would like to avoid hand rolling any code if possible. For example, on Android I would like to ask if people are able to include and use the kafka jars with no problem? And on iOS, if there is a way to include any C or other relevant code. On Mon, Oct 20, 2014 at 8:49 AM, Harsha ka...@harsha.io wrote: Hi Josh, Why not have Rest api service running where you post messages from your mobile clients. Rest api can run kafka producers accepting these messages pushing it into kafka brokers. Here is an example where we did similar service for kafka https://github.com/mozilla-metrics/bagheera . This project used kafka 0.7 but you can see how its implemented. Hope that helps. -Harsha On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote: hi Is it possible to have iOS and android to run the code needed for Kafka producers ? I want to have mobile clients connect to Kafka broker Thanks, Josh
Re: Kafka producer iOS and android
What is the use case requiring that? If you try to integrate kafka in the two different mobile platforms you will get many separate development cycles and none will work in many mobile networked environments. You can HTTP/HTTPS POST the same Avro objects (or Thrift or ProtoBuf) from each platform. You also then have 1 integration cycle then easily maintained and supported cohesively over all. The Avro/Thrift/ProtoBuf objects and a HTTP/HTTPS layer, thats it. Wrapping the producer is pretty straight forward in any language now a days I think and it depends what language and how you operate production services to pick how to write that producer. That producer and interface should change much and you have to think a little about configurations but most all of that is server side depending on the message. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop http://www.twitter.com/allthingshadoop / On Mon, Oct 20, 2014 at 1:09 PM, Josh J joshjd...@gmail.com wrote: Thanks for the tip. I would like to avoid hand rolling any code if possible. For example, on Android I would like to ask if people are able to include and use the kafka jars with no problem? And on iOS, if there is a way to include any C or other relevant code. On Mon, Oct 20, 2014 at 8:49 AM, Harsha ka...@harsha.io wrote: Hi Josh, Why not have Rest api service running where you post messages from your mobile clients. Rest api can run kafka producers accepting these messages pushing it into kafka brokers. Here is an example where we did similar service for kafka https://github.com/mozilla-metrics/bagheera . This project used kafka 0.7 but you can see how its implemented. Hope that helps. -Harsha On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote: hi Is it possible to have iOS and android to run the code needed for Kafka producers ? I want to have mobile clients connect to Kafka broker Thanks, Josh
Re: Kafka producer iOS and android
What is the use case requiring that? I'm looking for an open source library that I can use in Android and iOS, instead of hand rolling my own. On Mon, Oct 20, 2014 at 10:21 AM, Joe Stein joe.st...@stealth.ly wrote: What is the use case requiring that? If you try to integrate kafka in the two different mobile platforms you will get many separate development cycles and none will work in many mobile networked environments. You can HTTP/HTTPS POST the same Avro objects (or Thrift or ProtoBuf) from each platform. You also then have 1 integration cycle then easily maintained and supported cohesively over all. The Avro/Thrift/ProtoBuf objects and a HTTP/HTTPS layer, thats it. Wrapping the producer is pretty straight forward in any language now a days I think and it depends what language and how you operate production services to pick how to write that producer. That producer and interface should change much and you have to think a little about configurations but most all of that is server side depending on the message. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop http://www.twitter.com/allthingshadoop / On Mon, Oct 20, 2014 at 1:09 PM, Josh J joshjd...@gmail.com wrote: Thanks for the tip. I would like to avoid hand rolling any code if possible. For example, on Android I would like to ask if people are able to include and use the kafka jars with no problem? And on iOS, if there is a way to include any C or other relevant code. On Mon, Oct 20, 2014 at 8:49 AM, Harsha ka...@harsha.io wrote: Hi Josh, Why not have Rest api service running where you post messages from your mobile clients. Rest api can run kafka producers accepting these messages pushing it into kafka brokers. Here is an example where we did similar service for kafka https://github.com/mozilla-metrics/bagheera . This project used kafka 0.7 but you can see how its implemented. Hope that helps. -Harsha On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote: hi Is it possible to have iOS and android to run the code needed for Kafka producers ? I want to have mobile clients connect to Kafka broker Thanks, Josh
Re: Kafka producer iOS and android
I may be out of date, but I believe security measures are only in the proposal stage. Your use case most likely involves sending data from the internet at large to the Kafka instance. This will result in all data sent to the Kafka instance being consumable by the internet at large. This is unlikely to be what you desire and would likely be a disservice to your users. Using a REST wrapper (I believe there is at least one available) will limit the internet at large to producing data and you can build additional authentication mechanisms into that if desired. I hope someone else will correct me if I am mistaken. Christian On Mon, Oct 20, 2014 at 10:28 AM, Josh J joshjd...@gmail.com wrote: What is the use case requiring that? I'm looking for an open source library that I can use in Android and iOS, instead of hand rolling my own. On Mon, Oct 20, 2014 at 10:21 AM, Joe Stein joe.st...@stealth.ly wrote: What is the use case requiring that? If you try to integrate kafka in the two different mobile platforms you will get many separate development cycles and none will work in many mobile networked environments. You can HTTP/HTTPS POST the same Avro objects (or Thrift or ProtoBuf) from each platform. You also then have 1 integration cycle then easily maintained and supported cohesively over all. The Avro/Thrift/ProtoBuf objects and a HTTP/HTTPS layer, thats it. Wrapping the producer is pretty straight forward in any language now a days I think and it depends what language and how you operate production services to pick how to write that producer. That producer and interface should change much and you have to think a little about configurations but most all of that is server side depending on the message. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop http://www.twitter.com/allthingshadoop / On Mon, Oct 20, 2014 at 1:09 PM, Josh J joshjd...@gmail.com wrote: Thanks for the tip. I would like to avoid hand rolling any code if possible. For example, on Android I would like to ask if people are able to include and use the kafka jars with no problem? And on iOS, if there is a way to include any C or other relevant code. On Mon, Oct 20, 2014 at 8:49 AM, Harsha ka...@harsha.io wrote: Hi Josh, Why not have Rest api service running where you post messages from your mobile clients. Rest api can run kafka producers accepting these messages pushing it into kafka brokers. Here is an example where we did similar service for kafka https://github.com/mozilla-metrics/bagheera . This project used kafka 0.7 but you can see how its implemented. Hope that helps. -Harsha On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote: hi Is it possible to have iOS and android to run the code needed for Kafka producers ? I want to have mobile clients connect to Kafka broker Thanks, Josh
