Hi Kafka experts,
In my Java code to produce messages to Kafka, I always have to specify the
list of "bootstrap.servers" in initialization since version 0.9. I always
wonder if there is anyway the "bootstrap.servers" is available in zookeeper
(w/o manually storing the list there)?
Thanks.
-B
is setup should work :)
>
> Gwen
>
>
> On Fri, Aug 5, 2016 at 8:47 AM, Banias H <banias4sp...@gmail.com> wrote:
> > Hi,
> >
> > We are using Hortonworks HDP 2.4 with Apache Kafla 0.9 and we have an
> > in-house solution to pull messages from Kafka to HDFS.
Hi,
We are using Hortonworks HDP 2.4 with Apache Kafla 0.9 and we have an
in-house solution to pull messages from Kafka to HDFS. I would like to try
using kakfa-connector-hdfs to push messages to HDFS. As far as I concern,
Apache Kafka 0.9 doesn't come with kafka-connector-hdfs. What is a solid
I should add Flume is not an option for various reasons.
On Tue, May 3, 2016 at 2:49 PM, Banias H <banias4sp...@gmail.com> wrote:
> We use Kafka (0.9.x) internally in our pipeline and now we would like to
> ingest application logs sitting in local file system of servers external to
We use Kafka (0.9.x) internally in our pipeline and now we would like to
ingest application logs sitting in local file system of servers external to
the Kafka cluster.
We could write a producer program running on the application servers to
push files to Kafka. However we wonder if we can leverage
cerSendThread.scala:88)
> at
>
> kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:68)
> at scala.collection.immutable.Stream.foreach(Stream.scala:547)
> at
>
> kafka.producer.async.ProducerSendThread.process
I have had Kafka installed with Hadoop/Spark/etc in a comparable cluster,
except that I didn't have Kafka brokers installed in the nodes with
zookeeper. As long as physical disk space in the rest of the nodes is not a
concern, you will be OK.
I don't have enough background with Cassandra. But I
Hi folks,
I am new to both Kafka and Storm and I have problem having KafkaSpout to
get data from Kafka in our three-node environment with Kafka 0.8.1.1 and
Storm 0.9.3.
What is working:
- I have a Kafka producer (a java application) to generate random string to
a topic and I was able to run the
