Hey Joe - The NiFi web UI currently reads as:
Active threads: 3 Queued: 10,173 / 0 bytes Connected nodes: 2 / 2 Stats last refreshed: 13:31:28 PDT On Wed, Jun 15, 2016 at 4:29 PM, Joe Witt <[email protected]> wrote: > And the data remains? If so that is an interesting data point I > think. So to mark's point how much data do you have queued up > actively in the flow then on that nodes? Number of objects you > mention is 3273 files corresponding to 825GB in the content > repository. Does NiFi see those 825GB worth of data as being in the > flow/queued up? And then if that is the case are we talking about a > roughly 1TB repo and so the reported value seems correct and this is > simply a case of queueing near to the limit your system can hold? > > On Wed, Jun 15, 2016 at 4:24 PM, Ricky Saltzer <[email protected]> wrote: > > I have two nodes in clustered mode. I have the other node that isn't > > filling up as my primary. I've actually already restarted nifi on the > node > > which has the large repository a few times. > > > > On Wed, Jun 15, 2016 at 4:22 PM, Joe Witt <[email protected]> wrote: > > > >> Ricky, > >> > >> If you restart nifi and then find that it cleans those things up I > >> believe then it is related to the defects corrected in the 0.5/0.6 > >> timeframe. > >> > >> Is restarting an option for you at this time. You agree mark? > >> > >> Thanks > >> Joe > >> > >> On Wed, Jun 15, 2016 at 4:21 PM, Ricky Saltzer <[email protected]> > wrote: > >> > Hey Mark - > >> > > >> > Thanks for the quick reply! This is our production system so it's > >> > unfortunately running 0.4.0. There are currently 3273 files, with some > >> > files dating back to May 18th. The content repository itself is 825G. > >> > > >> > Ricky > >> > > >> > On Wed, Jun 15, 2016 at 4:17 PM, Mark Payne <[email protected]> > >> wrote: > >> > > >> >> Hey Ricky > >> >> > >> >> The reclaim process is pretty much continuous. What version of NiFi > are > >> >> you running? > >> >> I know there was an issue with this a while back that caused it not > to > >> >> cleanup properly. > >> >> > >> >> Also, how much data & how many FlowFiles do you have queued up in > your > >> >> flow? > >> >> Data won't be archived or reclaimed if in the flow. > >> >> > >> >> Thanks > >> >> -Mark > >> >> > >> >> > >> >> > >> >> > On Jun 15, 2016, at 4:04 PM, Ricky Saltzer <[email protected]> > >> wrote: > >> >> > > >> >> > Hey guys - > >> >> > > >> >> > I recently discovered I didn't have my "archive.enabled" option > set to > >> >> true > >> >> > after my disk filled up to 95%. I enabled it and then set the > >> retention > >> >> > period to 12 hours and 50% (default values). However, after > restarting > >> >> > NiFi, I am not seeing any disk space reclaimed. > >> >> > > >> >> > I'm curious, is the reclaiming process periodic or continuous? > >> >> > > >> >> > --- > >> >> > ricky > >> >> > >> >> > >> > > >> > > >> > -- > >> > Ricky Saltzer > >> > http://www.cloudera.com > >> > > > > > > > > -- > > Ricky Saltzer > > http://www.cloudera.com > -- Ricky Saltzer http://www.cloudera.com
