Hi all, Hoping for some pointers here as I seem to have run into a gap in the NiFi featureset: serializing binary files into a data format like Avro that will allow me to insert them to a database.
This has never been a problem with textbased files, but my usual tricks with extracting to attributes or abusing the CSV reader fall flat with binary files. My goal is to get files from a source location with List/FetchFile and then insert the whole contents of the file into a varbinary field in MySQL. Inserting the data itself is no problem, I am already doing that with binary data retrieved from another database, but then NiFi already put that into a nice Avro schema. But I’m unable to find any way to wrap the flowfile content in an AVRO schema of my own definition (or frankly any other way that allows PutDatabaseRecord or PutSQL to safely insert the binary contents without encoding them in some way). Has anyone encountered this requirement and found a solution? Regards, Isha
