> want to make it stateless Data itself is a state. If you figure out how to make data stateless then please share the secret. :)
I have seen the NiFi configurations file, state-management.xml, to set state in zookeeper and Redis but then again state is stored somewhere. If you are using a container why not put it in Kubernetes, use Docker volumes for the 3 (or 4 I forget) statefull points in NiFi, use a redis pod for those volume points. I have seen several tricks out there for NiFi state replication. IMO, it would be easier to solve NiFi state this way than trying to develop your own application layer. NiFi state is a common problem with some common solutions. Also look at NiFi-fn. Maybe its ready but I havent followed its development yet. Erik Anderson Bloomberg Sent from my iPad > On Sep 5, 2019, at 3:55 PM, John W. Phillips <[email protected]> wrote: > > > I'm using a QueryDatabaseTable processor to do delta copies every 10 minutes > from MySQL into an avro file. I'm running NiFi in a container & want to > make it stateless, so what I'd like to do is upon startup read the current > pointer from the destination and set the QueryDatabaseTable processor's > state so the delta copies begin from that index. > Looking through the CLI/API docs I can't find a way to set a processor's > state. Does anyone have a way to do this that they can share? > > > > -- > Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/
