File as message's content

Hi , Can you please let me know if we can send a file as in a pdf,jpg or Jpeg as a content of a message which we send via Kafka? Thanks, Siddharth Ubale

Re: KafkaSpout

:21 PM, Harsha m...@harsha.io wrote: Are you running this using storm LocalCluster and you want to use external zookeeper for LocalCluster?. The latest code has those changes you can pass params to LocalCluster(localhost,2181). -Harsha On Mon, Sep 15, 2014, at 10:30 PM, siddharth ubale wrote

KafkaSpout

Hi all, I am using a kafka spout for reading data from a producer into my storm topology. On the kafkaconfig : 1. When i set Kafka.forcefromstart = true .. it read from the beginning , however if i close my topology midway and run the topology again by setting Kafka.forcefromstart = false , it

Re: KafkaSpout

Hi harsha, Yes i did check with the above mentioned spoutconfig setup I think i need to bypass the in memory zookeeper which i am unable to do in local mode of storm. Any thoughts on that? Thanks, Siddharth ubale

Re: Kafka data can be stored on a Dbase instead of file system?

...@gmail.com wrote: For your first question, I don't know of a way to do that. For the second question, consumers commit the offset after every/a few reads. When the consumer restarts, it starts from the last committed offset. On Tue, Sep 9, 2014 at 7:23 PM, siddharth ubale siddharth.ub

Kafka topics behaviour

before shutting down my virtual machine. IS THIS THE WAY KAFKA FUNCTIONS IN DISTRIBUTED MODE ALSO?? Thanks, Siddharth Ubale

Failed to find leader

this very often whenever i have restarted my topic .* Thanks, Siddharth ubale

kafkaConfig.forceFromStart=true;

. . and storm 0.9.2_incubating which supports the kafka spout. Also in the above topology i am using kafka spout for ingesting data into storm. Thanks, Siddharth Ubale

Re: Data inputs for Kafka.

at the Ecosystem page: https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem Philip - http://www.philipotoole.com On Wednesday, August 20, 2014 5:05 AM, siddharth ubale siddharth.ub...@gmail.com wrote: Hi guys, We are implementing

Re: Data inputs for Kafka.

technology other than java?? Thanks, Siddharth Ubale On Thu, Aug 21, 2014 at 11:48 AM, Sharninder sharnin...@gmail.com wrote: there are kafka producers/consumers in a lot of languages. There is an Ecosystem page somewhere in the wiki. Take a look at that. Finally, I think you should experiment

Re: Data inputs for Kafka.

it and do the needful. On Thu, Aug 21, 2014 at 3:59 PM, siddharth ubale siddharth.ub...@gmail.com wrote: Hi , In continuity to this thread, can you let me know if i will have to write a kafka producer in C# if i have to get data from c# application onto the kafka bus

Data inputs for Kafka.

other systems? 2. As compared to network of brokers concept in ActiveMQ do we have something like that in kafka also?? Thanks, Siddharth Ubale