Re: Pulling API Endpoints into Kafka Topics in Avro

Ah, that worked great! I hadn't known about the Avro map type. Thanks!  On Tue, Mar 28, 2017 at 11:51 AM, James Wing wrote: > Steve, > > The inferred schemas can be helpful to get you started, but I recommend > providing your own Avro schema based on your knowledge of what

Re: Pulling API Endpoints into Kafka Topics in Avro

Steve, The inferred schemas can be helpful to get you started, but I recommend providing your own Avro schema based on your knowledge of what should be guaranteed to downstream systems. If you want to pass untyped data, you can't really beat JSON. Avro schema isn't so bad, honest. As part of

Pulling API Endpoints into Kafka Topics in Avro

I'm in the process of creating an ingest workflow that will pull into Kafka topics a number of API endpoints on an hourly basis. I'd like convert them from JSON to AVRO when I bring them in. I have, however, run into a few problems that I haven't been able to figure out and haven't turned anything