Re: Pointer to stream data from Kafka to HDFS

Kevin, In the forthcoming 0.9 release, the community is adding a new ingest/export feature to help with importing and exporting data to and from Kafka.

Re: Pointer to stream data from Kafka to HDFS

Hi, Assuming you are using Avro then you might want to take a look at: https://github.com/confluentinc/camus If not you can still adopt the pattern used to get data into HDFS. We use something similar at my place of employment. Thanks, Damian On 6 November 2015 at 08:46, Woodbine, Kevin

Pointer to stream data from Kafka to HDFS

Dear Sirs, I'm working on a development project for my company that is looking at the possibility of live streaming transaction data from our Oracle databases into Hadoop HDFS. Doing some research I've been looking into leveraging the power of Kafka to form part of the solution and need some