Hello,
I am looking for some advice: I have Nifi sending flowfiles to Kafka. As we know for Kafka everything is an "insert". Messages are inserted into the Kafka log.
Now I wonder what is the best way to insert OR update a relational database table from Kafka messages using Nifi. What is the best way to determine if the record (data) I get from Kafka needs to be updated or inserted in the relational db table? Ok. MySQL e.g. has an "upsert" mode, but I don't see we have a processor for that. So I would need to generate the SQL statement and execute that. But is there a more elegant (straight ahead) way?
I could use MongoDB as well where we have a processor that allows for an upsert, but I wanted to know how to solve this with a relational db.
My idea was to use a db lookup service controller - to lookup if a certain key exists - but there is none from what I have seen. I don't think it is an unusual use case, so I hope that somebody can help or share thought with me.
Thanks,
Uwe
