Hello,
 
I'm investigating Redis, seems to work easy.
 
I think it is a bit strange that Zookeeper is not in de list with providers. Zookeeper is already used as cluster manager for Nifi, that would be easy to add in my opinion.
 
regards,
 
Tiemen.
 
 
----- Oorspronkelijk bericht -----
Van: "Mike Thomsen" <[email protected]>
Aan: [email protected]
Cc:
Onderwerp: Re: DistributedMapCacheServer
Datum: do 3 nov. 2022 15:58
 
[EXTERNE E-MAIL] Dit bericht is afkomstig van een externe afzender. Wees voorzichtig met het openen van linkjes en bijlagen.


You can also use the Cassandra DMC, which is something we are starting
to use a lot where I work.

Admittedly, the documentation is non-existent at the moment, but we
also open sourced an experimental delegating DMC client that can be
used to chain multiple DMCs together so you can do Redis for hot
caching and something like Cassandra for broader cold caches

https://github.com/Domestic-Resilience-FOSS/nifi-delegating-distributedmapcache-bundle

On Wed, Nov 2, 2022 at 5:25 PM Peter Turcsanyi <[email protected]> wrote:
>
> Embedded Hazelcast can also be an option. In that case, there is no
> need to set up an external cache but the Hazelcast instances are
> running on the NiFi nodes (in the same JVM as NiFi).
> Please note: no security/authentication is supported in embedded mode.
>
> https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-hazelcast-services-nar/1.18.0/org.apache.nifi.hazelcast.services.cacheclient.HazelcastMapCacheClient/index.html
> https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-hazelcast-services-nar/1.18.0/org.apache.nifi.hazelcast.services.cachemanager.EmbeddedHazelcastCacheManager/index.html
>
> On Wed, Nov 2, 2022 at 5:10 PM Bryan Bende <[email protected]> wrote:
> >
> > The DMC Server does not support high availability. If you have a 3
> > node nifi cluster, each node will have a DMC client and DMC server,
> > but the clients all have to point at only one of the servers, and if
> > the node where that server is running goes down, there is no
> > replication or failover to another node. So it is really up to you to
> > decide if that is acceptable for your use case. If its not then you
> > need to use a different DMC client implementation that can communicate
> > with an external HA cache, like Redis.
> >
> > On Wed, Nov 2, 2022 at 11:38 AM Greene (US), Geoffrey N
> > <[email protected]> wrote:
> > >
> > > I make heavy use of DistributedMapCacheServer in my nifi flows (one node; not clustered).
> > >
> > >
> > >
> > > I seem to remember reading that the DistributedMapCacheServer is not to be used in production; it’s a reference implementation only, and it is not really recommended for production.
> > >
> > >
> > >
> > > Unfortunately, I can no longer find the reference saying that DistributedMapCacheServer is not trustworthy for prod.
> > >
> > > I don’t have an HDFS implementation anywhere, but I do need the cacheing part.
> > >
> > >
> > >
> > > Can someone explain?  Can I use DistributedMapCacheServer in my production flows?
> > >
> > >
> > >
> > >
> > >
> > >
 


------------------------------------------------------------------------
De Belastingdienst stelt e-mail niet open voor aanvragen, aangiften, bezwaarschriften, verzoeken, klachten, ingebrekestellingen en soortgelijke formele berichten.
Dit bericht is uitsluitend bestemd voor de geadresseerde. Het bericht kan vertrouwelijke informatie bevatten waarvoor de fiscale geheimhoudingsplicht geldt. Als u dit bericht per abuis hebt ontvangen, wordt u verzocht het te verwijderen en de afzender te informeren.

The Dutch Tax Administration does not accept filings, requests, appeals, complaints, notices of default or similar formal notices, sent by email.
This message is solely intended for the addressee. It may contain information that is confidential and legally privileged. If you are not the intended recipient please delete this message and notify the sender.

Reply via email to