Just adding to what Joey said, there was a previous discussion about
something like this:
http://apache-nifi-developer-list.39713.n7.nabble.com/Looking-for-feedback-on-my-WIP-Design-td13097.html
As far as the Avro schema, here is an example of how to get access to the
schema from a stream call
Michael, I think you’re right to call this out. I frequently find myself
stringing together flows with ExecuteScripts (which you should be able to use
to pull a schema out by creating an Avro DataFileStream from the InputStream
and then calling getSchema().toString()) or conversions to/from
Nifi Devs,
I noticed you have two processors (ExecuteSQL and QueryDatabaseTable) that
perform SQL select statements and put the results into a flow file. While I am
not sure what their difference is, I did notice that they both produce avro,
and the schema is inferred from the result set.