Re: Kafka integration with Hadoop

2015-05-12 Thread Gwen Shapira
Also, Flume 1.6 has Kafka source, sink and channel. Using Kafka source or channel with Dataset sink should work. Gwen On Tue, May 12, 2015 at 6:16 AM, Warren Henning warren.henn...@gmail.com wrote: You could start by looking at Linkedin's Camus and go from there? On Mon, May 11, 2015 at 8:10

Kafka integration with Hadoop

2015-05-11 Thread Rajesh Datla
Hi All, How to integrate Kafka with Hadoop ecosystem. How to store Kafka messages into HDFS in parquet format Regards Raj

Re: Kafka integration with Hadoop

2015-05-11 Thread Warren Henning
You could start by looking at Linkedin's Camus and go from there? On Mon, May 11, 2015 at 8:10 PM, Rajesh Datla rajeshdatla2...@gmail.com wrote: Hi All, How to integrate Kafka with Hadoop ecosystem. How to store Kafka messages into HDFS in parquet format Regards Raj