kad3nce edited a comment on issue #7001: Which parser to use for Avro encoded messages from Divolte? URL: https://github.com/apache/incubator-druid/issues/7001#issuecomment-460838372 Thanks for the replies! I did the following: - [x] Configure the Divolte hdfs sink and point it to the local file system - [x] Change the `parseSpec.timestampSpec.format` to `auto` - [x] Verify that the Kafka sink on Divolte is running `naked` - [x] Re-initialize a fresh instance of the stack to clear out stale Kafka messages While studying Divolte's logs after adding the new HDFS sink, I was able to deduce that Divolte wasn't picking up my config changes. It turns out I had made a typo in the docker-compose file when specifying the path to my custom Divolte config, so Divolte was silently falling back to its default config (including its default Avro schema). Thus the errors and schema mismatches (good catch, @asnare). I am now processing messages from Divolte successfully. Yay! Thanks again for your time and guidance—both much appreciated!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
