vvysotskyi opened a new pull request #2239: URL: https://github.com/apache/drill/pull/2239
# [DRILL-5940](https://issues.apache.org/jira/browse/DRILL-5940): Add support for Avro messages with schema registry for Kafka ## Description - Refactored `KafkaRecordReader` to use EVF. - Updated `JsonMessageReader` to use V2 JSON reader - Added `AvroMessageReader` for processing messages serialized as Avro records and added schema registry support. To be able to deserialize Kafka messages of Avro type, schema registry URL should be specified in the Kafka storage plugin `kafkaConsumerProps` (and other schema registry options if required): ``` "schema.registry.url": "http://localhost:8081"; ``` After that, `store.kafka.record.reader` session option should be set to `org.apache.drill.exec.store.kafka.decoders.AvroMessageReader`. ## Documentation NA ## Testing Added UT that reads Avro messages. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
