There will be an Hazelcast implementation (embedded into NiFi) that will be released with NiFi 1.13. It comes with some limitations that you need to be aware of (example: the data is not persisted in case of a cluster restart) but I believe all of this is documented in the "additional details" of the new controller services.
Thanks, Pierre Le ven. 12 févr. 2021 à 19:21, Jorge Machado <[email protected]> a écrit : > Thanks to all ! > I was thinking about hazelcast hashmap > > > On 12. Feb 2021, at 16:08, Chris Sampson <[email protected]> > wrote: > > I'm pretty sure they don't, you need to use an external implementation, > such as Redis. > > The DistributedMapCacheServer is a reference implementation but there are > alternatives - see the list of available implementations in the > "Distributed Cache Service" property of the PutDistributedMapCache > processor docs [1]. > > You can also implement your own by extending the > DistributedCacheServer class. > > > [1]: > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.12.1/org.apache.nifi.processors.standard.PutDistributedMapCache/index.html > > --- > *Chris Sampson* > IT Consultant > [email protected] > <https://www.naimuri.com/> > > > On Fri, 12 Feb 2021 at 14:48, Jorge Machado <[email protected]> wrote: > >> Hey everyone, >> >> Is there any documentation on how to use DistributedCacheServer ? >> Currently from what I see this is single point of failure or does it >> really sync the data between nodes ? >> >> I want to have something similar to zookeeper state but not in zookeeper >> because it needs to be available between processors. My rough problem: >> >> >> Flow : >> >> * Start the flow and store a state (Similar to the QueryTable, which >> uses zookeeper to store the max row) >> * do some processing >> * update the state >> >> >> This needs to be reachable between servers of course. What I tested the >> DistributedMapCacheClientService needs a server to connect which I point >> to localhost. But if the entry that I need is on another server how do they >> sync the data ? >> >> Thx > > >
