Problem deleting topics in 0.8.2?

2015-03-04 Thread Jeff Schroeder
and rm -rf /var/lib/kafka/*, but that is clearly a very poor one once we are done testing our kafka + storm setup. -- Jeff Schroeder Don't drink and derive, alcohol and analysis don't mix. http://www.digitalprognosis.com

Re: cross-colo writing/reading?

2015-03-03 Thread Jeff Schroeder
, that could cater to such situations ? Thanks Yang -- Jeff Schroeder Don't drink and derive, alcohol and analysis don't mix. http://www.digitalprognosis.com

Re: If you run Kafka in AWS or Docker, how do you persist data?

2015-02-27 Thread Jeff Schroeder
Kafka on dedicated hosts running in docker under marathon under Mesos. It was a real bear to get working, but is really beautiful once I did manage to get it working. I simply run with a unique hostname constraint and number of instances = replication factor. If a broker dies and it isn't a

Re: cross-colo writing/reading?

2015-02-27 Thread Jeff Schroeder
Perhaps mirror maker is what you want? https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=27846330 On Friday, February 27, 2015, Yang tedd...@gmail.com wrote: we tested our new application that reads and writes to kafka. at first we found the access latency is very high.

Kafka on Mesos?

2015-02-21 Thread Jeff Schroeder
done this in a reasonably supportable way and how they went about it. Today I'll be trying out the stealth.ly's mesos framework[1] but am not sure how well it will work with a newer mesos (0.21.1). Thanks in advance! [1] https://github.com/stealthly/kafka-mesos -- Jeff Schroeder Don't drink