I think it does make sense and someone at a meetup asked a similar question. There are some things to be considered like how does one annotate the version of a schema, the name, etc.. when all they are providing are files in a directory? How can they support multiple versions of a given schema (or maybe they just dont in this approach)? But there is no question that being able to just push an avsc file into a directory and then have it be useable in the flow could be helpful.
On Jul 5, 2017 9:00 AM, "Andre" <[email protected]> wrote: dev, As I continue to explore the Record based processors I got myself wondering: Does it make sense to have a file-system based schema registry? Idea would be creating something like AvroSchemaRegistry but instead of the adding each schema as a controller service property, we would have a property pointing to a directory. Each avsc file within that directory would then be validated with the root "name" within the Avro schema used as the schema name (i.e. the equivalent to AvroSchemaRegistry property name). The rationale is that while the Hortonworks and Avro Schema Registries work, I reckon one is sort of overkill for edge/DMZ NiFi deployments and the other is painful to update in case of multiple NiFi clusters. Having a file based registry with inotify or something of sort would be great for the folks already using external configuration management. What do you think?
