Re: Content Repository Cleanup

2016-12-10 Thread Alan Jackoway
The scenario Joe G describes is almost exactly what we are doing. We bring in large files and unpack them into many smaller ones. In the most recent iteration of this problem, I saw that we had many small files queued up at the time trouble was happening. We will try your suggestion to see if the

Re: NiFi Clustering

2016-12-10 Thread Caton, Nigel
Thanks Bryan. On 2016-12-09 15:32 (-), Bryan Bende wrote: > Nigel,> > > The advantage of using a cluster is that whenever you change something in> > the UI, it will be changed on all nodes, and you also get a central view of> > the metrics/stats across all nodes. If you use

Re: Content Repository Cleanup

2016-12-10 Thread Joe Gresock
Not sure if your scenario is related, but one of the NiFi devs recently explained to me that the files in the content repository are actually appended together with other flow file content (please correct me if I'm explaining it wrong). That means if you have many small flow files in your current