Hi,
I am trying out the new kakfa connect service.
version : kafka_2.11-0.9.0.0
mode: standalone
I have a conceptual question on the service.
Can I just start a sink connector which reads from Kafka and writes to say
HDFS ?
>From what I have tried, it's expecting a source-connector as well
n't introduce any other dependencies that weren't
> already in Kafka. It's also possible to write implementations for other
> formats (e.g. Thrift, Protocol Buffers, Cap'n Proto, MessagePack, and
> more), but I'm not aware of anyone who has started to tackle those
> converters y
t;e...@confluent.io>
wrote:
> Yes, though it's still awaiting some updates after some renaming and API
> modifications that happened in Kafka recently.
>
> -Ewen
>
> On Thu, Nov 12, 2015 at 9:10 AM, Venkatesh Rudraraju <
> venkatengineer...@gmail.com> wrote:
Dealing with schemaless data will be tricky for connectors like HDFS, but
> is definitely possible. But its worth thinking through the right way to
> handle that data with a minimum of additional configuration options
> required.
>
> -Ewen
>
> On Wed, Feb 17, 2016 at 11:14 AM, V
Hi,
I tried using the HDFS connector sink with kafka-connect and works as
described->
http://docs.confluent.io/2.0.0/connect/connect-hdfs/docs/index.html
My Scenario :
I have plain Json data in a kafka topic. Can I still use HDFS connector
sink to read data from kafka-topic and write to HDFS in
Hi,
I tried using the HDFS connector sink with kafka-connect and works as
described->
http://docs.confluent.io/2.0.0/connect/connect-hdfs/docs/index.html
My Scenario :
I have plain Json data in a kafka topic. Can I still use HDFS connector
sink to read data from kafka-topic and write to HDFS in
How do I include "kafka-avro-serializer" in my maven build. It's not
available in the maven repo as mentioned here ->
http://docs.confluent.io/1.0/app-development.html#java-applications-serializers
Thanks,
Venkatesh
