Re: Convert log file in Avro json encoding to Avro binary encoding and send into Kafka

2016-11-30 Thread Takahiro Hozumi
Hi Ewen, Thank you for your advise. I reached a following compromise: My application sends records in the Avro Binary encoding to Kafka directly using Confluent's serializers(io.confluent/kafka-avro-serializer), which integrated with schema registry, and also does logging in the Avro JSON

Re: Convert log file in Avro json encoding to Avro binary encoding and send into Kafka

2016-11-26 Thread Ewen Cheslack-Postava
Avro JSON encoding is a wire-level format. The AvroConverter accepts Java runtime data (e.g. primitive types like Strings & Integers, Maps, Arrays, and Connect Structs). The component that most closely matches your needs is Confluent's REST proxy, which supports the Avro JSON encoding when