Re: Using Kafka on DC/OS + Marathon

2017-10-03 Thread Sean Glover
an Glover <sean.glo...@lightbend.com>: > > > > Hi Valentin, > > > > Kafka is available on DC/OS in the Catalog (aka Universe) as part of the > > `kafka` package. Mesosphere has put a lot of effort into making Kafka > work > > on DC/OS. Since Kafka requires

Re: Using Kafka on DC/OS + Marathon

2017-10-03 Thread Valentin Forst
package. Mesosphere has put a lot of effort into making Kafka work > on DC/OS. Since Kafka requires persistent disk it's required to make sure > after initial deployment brokers stay put on their assigned Mesos agents. > Deployment and common ops tasks are supported with the help o

Re: Using Kafka on DC/OS + Marathon

2017-10-03 Thread Sean Glover
Hi Valentin, Kafka is available on DC/OS in the Catalog (aka Universe) as part of the `kafka` package. Mesosphere has put a lot of effort into making Kafka work on DC/OS. Since Kafka requires persistent disk it's required to make sure after initial deployment brokers stay put on their assigned

Re: Using Kafka on DC/OS + Marathon

2017-10-03 Thread Valentin Forst
kafka framework which runs on top of DC/OS. > > https://docs.mesosphere.com/service-docs/kafka/ > > This will most likely be a better way to run kafka on DC/OS rather than > running it as a marathon framework. > >

Re: Using Kafka on DC/OS + Marathon

2017-10-03 Thread Valentin Forst
have experience with Kafka on DC/OS + Marathon on a production environment and supports Exactly-Ones Semantic? Which case would you recommend? 1. Kafka on DC/OS + Marathon using Mesos private nodes (+ microservices on the public nodes) 2. Kafka on separate DC/OS-Cluster ? i.e. micro services have

Using Kafka on DC/OS + Marathon

2017-10-02 Thread Valentin Forst
Hi there, Working in a huge compony we are about to install Kafka on DC/OS (Mesos) and intend to use Marathon as a Scheduler. Since I am new to DC/OS and Marathon, I was wondering if this is a recommended way of using Kafka in the production environment. My doubts are: - Kafka manages Broker

Re: Kafka on DC/OS

2016-07-24 Thread Timothy Chen
Hi Abhimanyu, What errors are you seeing? And which version of DCOS are you running as well? Tim On Fri, Jul 22, 2016 at 6:14 AM, Chakrabarty, Abhimanyu <abhimanyu.chakrabarty...@ucl.ac.uk> wrote: > I had a question regarding Kafka on DC/OS because whenever we try to install > the K