pratyakshsharma commented on pull request #1566: URL: https://github.com/apache/incubator-hudi/pull/1566#issuecomment-620679844
> if we redid the schema provider implementations such that the schema is read each time from SR (schema registry) Do you have some plan around how to achieve this? @vinothchandar I was thinking of maintaining the subject and version information from the very beginning with us (which should be easy to get from the schema-registry url provided by the user), and then compare the same by fetching the serialized schema id from incoming messages. Whenever we experience there is some version update, we can refresh the schemas at that point and continue consuming the incoming messages. This would need writing our own custom AvroDeserializer. Also the above plan only works for the combination of AvroKafkaSource and SchemaRegistryProvider. Thoughts? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
