Re: Who uses NiFi Cluster in Docker ?
Hi Guillaume, Vote for RC3 is in progress, if everything goes well, it could be released before the end of the week. Pierre Le mar. 23 oct. 2018 à 10:31, PICHARD, Guillaume < guillaume.pich...@sogeti.com> a écrit : > Mike, > > > > Do you know when this 1.8 version will be released ? > > > > *De :* Mike Thomsen > *Envoyé :* vendredi 19 octobre 2018 12:22 > *À :* users@nifi.apache.org > *Objet :* Re: Who uses NiFi Cluster in Docker ? > > > > Guillaume, > > > > We also have a patch coming in 1.8 that exposes the clustering settings > through Docker, so that should make it a lot easier for you to set up a > test cluster. > > > > On Fri, Oct 19, 2018 at 3:49 AM Asanka Sanjaya wrote: > > Hi Guillaume, > > I'm using nifi in our production kubernetes cluster on Google cloud for > about a year now and didn't run into any trouble. One thing you need to be > aware of is to have a persistent disk attached to your container in > kubernetes. Otherwise, when the pod gets restarted you will loose queued > flow files. > > > > On Thu, Oct 18, 2018 at 9:10 PM PICHARD, Guillaume < > guillaume.pich...@sogeti.com> wrote: > > Hi, > > > > I’m looking for experiences and return on experience in running a Nifi > Cluster in production using docker/kubernetes/mesos. Is it working well ? > Is it stable ? Does it handle well a high workload ? > > > > Thanks for you feedbacks, > > Guillaume. > > > > > > > -- > > *Thanks,* > > *Asanka Sanjaya Herath* > > *Senior Software Engineer **|** Zone24x7* > >
RE: Who uses NiFi Cluster in Docker ?
Mike, Do you know when this 1.8 version will be released ? De : Mike Thomsen Envoyé : vendredi 19 octobre 2018 12:22 À : users@nifi.apache.org Objet : Re: Who uses NiFi Cluster in Docker ? Guillaume, We also have a patch coming in 1.8 that exposes the clustering settings through Docker, so that should make it a lot easier for you to set up a test cluster. On Fri, Oct 19, 2018 at 3:49 AM Asanka Sanjaya mailto:angal...@gmail.com>> wrote: Hi Guillaume, I'm using nifi in our production kubernetes cluster on Google cloud for about a year now and didn't run into any trouble. One thing you need to be aware of is to have a persistent disk attached to your container in kubernetes. Otherwise, when the pod gets restarted you will loose queued flow files. On Thu, Oct 18, 2018 at 9:10 PM PICHARD, Guillaume mailto:guillaume.pich...@sogeti.com>> wrote: Hi, I’m looking for experiences and return on experience in running a Nifi Cluster in production using docker/kubernetes/mesos. Is it working well ? Is it stable ? Does it handle well a high workload ? Thanks for you feedbacks, Guillaume. -- Thanks, Asanka Sanjaya Herath Senior Software Engineer | Zone24x7
Re: Who uses NiFi Cluster in Docker ?
It will be great! On Fri, 19 Oct 2018 at 16:13 Michael Moser wrote: > I have done exactly what Juan Pablo Gardella suggested in my own Docker > sandbox, and also a *ADDNIFI_* > function. It would take a lot of cleanup and documentation in order to > contribute, but if there is interest in it, then I'll see what I can do. > > -- Mike > > > > On Fri, Oct 19, 2018 at 1:51 PM Juan Pablo Gardella < > gardellajuanpa...@gmail.com> wrote: > >> It would be great to expose properties as *NIFI_> nifi.properties>*. I see that approach at >> https://hub.docker.com/r/wurstmeister/kafka/ kafka docker image. >> >> On Fri, 19 Oct 2018 at 11:56 Robert R. Bruno wrote: >> >>> Been running nifi cluster in a on-prem kubernetes cluster with a lot of >>> success. We found using local disks volumes helped performance. >>> >>> On Fri, Oct 19, 2018, 03:21 Mike Thomsen wrote: >>> Guillaume, We also have a patch coming in 1.8 that exposes the clustering settings through Docker, so that should make it a lot easier for you to set up a test cluster. On Fri, Oct 19, 2018 at 3:49 AM Asanka Sanjaya wrote: > Hi Guillaume, > I'm using nifi in our production kubernetes cluster on Google cloud > for about a year now and didn't run into any trouble. One thing you need > to > be aware of is to have a persistent disk attached to your container in > kubernetes. Otherwise, when the pod gets restarted you will loose queued > flow files. > > On Thu, Oct 18, 2018 at 9:10 PM PICHARD, Guillaume < > guillaume.pich...@sogeti.com> wrote: > >> Hi, >> >> >> >> I’m looking for experiences and return on experience in running a >> Nifi Cluster in production using docker/kubernetes/mesos. Is it working >> well ? Is it stable ? Does it handle well a high workload ? >> >> >> >> Thanks for you feedbacks, >> >> Guillaume. >> >> >> > > > -- > > *Thanks,* > > Asanka Sanjaya Herath > > Senior Software Engineer | Zone24x7 >
Re: Who uses NiFi Cluster in Docker ?
I have done exactly what Juan Pablo Gardella suggested in my own Docker sandbox, and also a *ADDNIFI_* function. It would take a lot of cleanup and documentation in order to contribute, but if there is interest in it, then I'll see what I can do. -- Mike On Fri, Oct 19, 2018 at 1:51 PM Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > It would be great to expose properties as *NIFI_ nifi.properties>*. I see that approach at > https://hub.docker.com/r/wurstmeister/kafka/ kafka docker image. > > On Fri, 19 Oct 2018 at 11:56 Robert R. Bruno wrote: > >> Been running nifi cluster in a on-prem kubernetes cluster with a lot of >> success. We found using local disks volumes helped performance. >> >> On Fri, Oct 19, 2018, 03:21 Mike Thomsen wrote: >> >>> Guillaume, >>> >>> We also have a patch coming in 1.8 that exposes the clustering settings >>> through Docker, so that should make it a lot easier for you to set up a >>> test cluster. >>> >>> On Fri, Oct 19, 2018 at 3:49 AM Asanka Sanjaya >>> wrote: >>> Hi Guillaume, I'm using nifi in our production kubernetes cluster on Google cloud for about a year now and didn't run into any trouble. One thing you need to be aware of is to have a persistent disk attached to your container in kubernetes. Otherwise, when the pod gets restarted you will loose queued flow files. On Thu, Oct 18, 2018 at 9:10 PM PICHARD, Guillaume < guillaume.pich...@sogeti.com> wrote: > Hi, > > > > I’m looking for experiences and return on experience in running a Nifi > Cluster in production using docker/kubernetes/mesos. Is it working well ? > Is it stable ? Does it handle well a high workload ? > > > > Thanks for you feedbacks, > > Guillaume. > > > -- *Thanks,* Asanka Sanjaya Herath Senior Software Engineer | Zone24x7 >>>
Re: Who uses NiFi Cluster in Docker ?
It would be great to expose properties as *NIFI_*. I see that approach at https://hub.docker.com/r/wurstmeister/kafka/ kafka docker image. On Fri, 19 Oct 2018 at 11:56 Robert R. Bruno wrote: > Been running nifi cluster in a on-prem kubernetes cluster with a lot of > success. We found using local disks volumes helped performance. > > On Fri, Oct 19, 2018, 03:21 Mike Thomsen wrote: > >> Guillaume, >> >> We also have a patch coming in 1.8 that exposes the clustering settings >> through Docker, so that should make it a lot easier for you to set up a >> test cluster. >> >> On Fri, Oct 19, 2018 at 3:49 AM Asanka Sanjaya >> wrote: >> >>> Hi Guillaume, >>> I'm using nifi in our production kubernetes cluster on Google cloud for >>> about a year now and didn't run into any trouble. One thing you need to be >>> aware of is to have a persistent disk attached to your container in >>> kubernetes. Otherwise, when the pod gets restarted you will loose queued >>> flow files. >>> >>> On Thu, Oct 18, 2018 at 9:10 PM PICHARD, Guillaume < >>> guillaume.pich...@sogeti.com> wrote: >>> Hi, I’m looking for experiences and return on experience in running a Nifi Cluster in production using docker/kubernetes/mesos. Is it working well ? Is it stable ? Does it handle well a high workload ? Thanks for you feedbacks, Guillaume. >>> >>> >>> -- >>> >>> *Thanks,* >>> >>> Asanka Sanjaya Herath >>> >>> Senior Software Engineer | Zone24x7 >>> >>
Re: Who uses NiFi Cluster in Docker ?
Been running nifi cluster in a on-prem kubernetes cluster with a lot of success. We found using local disks volumes helped performance. On Fri, Oct 19, 2018, 03:21 Mike Thomsen wrote: > Guillaume, > > We also have a patch coming in 1.8 that exposes the clustering settings > through Docker, so that should make it a lot easier for you to set up a > test cluster. > > On Fri, Oct 19, 2018 at 3:49 AM Asanka Sanjaya wrote: > >> Hi Guillaume, >> I'm using nifi in our production kubernetes cluster on Google cloud for >> about a year now and didn't run into any trouble. One thing you need to be >> aware of is to have a persistent disk attached to your container in >> kubernetes. Otherwise, when the pod gets restarted you will loose queued >> flow files. >> >> On Thu, Oct 18, 2018 at 9:10 PM PICHARD, Guillaume < >> guillaume.pich...@sogeti.com> wrote: >> >>> Hi, >>> >>> >>> >>> I’m looking for experiences and return on experience in running a Nifi >>> Cluster in production using docker/kubernetes/mesos. Is it working well ? >>> Is it stable ? Does it handle well a high workload ? >>> >>> >>> >>> Thanks for you feedbacks, >>> >>> Guillaume. >>> >>> >>> >> >> >> -- >> >> *Thanks,* >> >> Asanka Sanjaya Herath >> >> Senior Software Engineer | Zone24x7 >> >
Re: Who uses NiFi Cluster in Docker ?
Guillaume, We also have a patch coming in 1.8 that exposes the clustering settings through Docker, so that should make it a lot easier for you to set up a test cluster. On Fri, Oct 19, 2018 at 3:49 AM Asanka Sanjaya wrote: > Hi Guillaume, > I'm using nifi in our production kubernetes cluster on Google cloud for > about a year now and didn't run into any trouble. One thing you need to be > aware of is to have a persistent disk attached to your container in > kubernetes. Otherwise, when the pod gets restarted you will loose queued > flow files. > > On Thu, Oct 18, 2018 at 9:10 PM PICHARD, Guillaume < > guillaume.pich...@sogeti.com> wrote: > >> Hi, >> >> >> >> I’m looking for experiences and return on experience in running a Nifi >> Cluster in production using docker/kubernetes/mesos. Is it working well ? >> Is it stable ? Does it handle well a high workload ? >> >> >> >> Thanks for you feedbacks, >> >> Guillaume. >> >> >> > > > -- > > *Thanks,* > > Asanka Sanjaya Herath > > Senior Software Engineer | Zone24x7 >
Re: Who uses NiFi Cluster in Docker ?
Hi Guillaume, I'm using nifi in our production kubernetes cluster on Google cloud for about a year now and didn't run into any trouble. One thing you need to be aware of is to have a persistent disk attached to your container in kubernetes. Otherwise, when the pod gets restarted you will loose queued flow files. On Thu, Oct 18, 2018 at 9:10 PM PICHARD, Guillaume < guillaume.pich...@sogeti.com> wrote: > Hi, > > > > I’m looking for experiences and return on experience in running a Nifi > Cluster in production using docker/kubernetes/mesos. Is it working well ? > Is it stable ? Does it handle well a high workload ? > > > > Thanks for you feedbacks, > > Guillaume. > > > -- *Thanks,* Asanka Sanjaya Herath Senior Software Engineer | Zone24x7
Who uses NiFi Cluster in Docker ?
Hi, I'm looking for experiences and return on experience in running a Nifi Cluster in production using docker/kubernetes/mesos. Is it working well ? Is it stable ? Does it handle well a high workload ? Thanks for you feedbacks, Guillaume.
