Jim Blow away the prov repo and restart to get back going. But to troubleshoot why it isn't cleaning up it seems as though there is some reason nifi is failing to rollover.
What version precisely are you running? Thanks Joe On Mar 13, 2017 2:01 PM, "James McMahon" <[email protected]> wrote: > Here is all the info Joe. I had to manually recreate this here. Tried to > avoid typos. Anything that looks bizarre or oddly misspelled is on me. > > Certainly Joe. I need to do whatever is humanly possible to get this up > and > rolling again. Here is what I can provide: > > (Background) > /mnt/provenance_repo 50G size, 47G used, 17M available, 100% capacity > under this is > database_repository > provenance_repository > du -h output: > 8.5M ./database_repository > 16K ./lost+found > 4.0K ./provenance_repository/index-1489...124 > 92K ./provenance_repository/toc > 47G ./provenance_repository/journals > 47G ./provenance_repository > 47G . > > In my nifi.properties: > #H2 Settings > nifi.database.directory=/mnt/provenance_repo/database_repository > nifi.h2.url.append=;LOCK_TIMEOUT=25000;WRITE_DELAY=0;AUTO_SERVER=FALSE > nifi.provenance.repository.directory.default=/mnt/ > provenance_repo/provenance_repos > itory > nifi.provenance.repository.max.storage.time=24 hours > nifi.provenance.repository.max.storage.size=1 GB > nifi.provenance.repository.rollover.time=30 secs > nifi.provenance.repository.rollover.size=100 MB > nifi.provenance.repository.query.threads=2 > nifi.provenance.repository.index.threads=1 > nifi.provenance.repository.compress.on.rollover=true > nifi.provenance.repository.always.sync=false > nifi.provenance.repository.journal.count=16 > nifi.provenance.repository.indexed.fields=EventType,FlofFileUUID,Filename, > ProcessorID,Relationship > nifi.provenance.repository.indexed.attributes= > nifi.provenance.repository.index.shard.size=500 MB > nifi.provenance.repository.max.attributes.length=65536 > nifi.provenance.repository.buffer.size=100000 > (Errors) > in nifi-bootstrap.log, java.io.IOException No space left on device > /mnt/provenance_repo/database_repository/nifi-users.h2.db > similar error reported in nifi-app.log, fails when trying to create > org.springframework.beans.factory.BeanCreationException > > I think both are just symptoms of the true problem, which is to say too > much stuff in > journals under provenance_repository > Jim > > On Mon, Mar 13, 2017 at 4:10 PM, Joe Witt <[email protected]> wrote: > >> Jim, >> >> Processors create provenance events which get written to the >> provenenance repo but that is the end of their relationship. The >> provenance repository is then self managing. Can you share your >> nifi.properties provenance configuration? >> >> Thanks >> Joe >> >> On Mon, Mar 13, 2017 at 1:05 PM, James McMahon <[email protected]> >> wrote: >> > Good evening. I have a number of process groups in my NiFi instance >> that run >> > concurrently. Evidently I have filled up my provenance repo. How do I >> > recover from this? NiFi will not start back up after shutdown. >> > >> > I am in a dev environment right now so I can afford to lose what had >> been in >> > my flows. Does that give me other options to recover? >> > >> > However I must determine what process group and processor are not >> freeing >> > resources from the provenance repo. I can't allow this workflow to >> promote >> > to production until I determine how to prevent this from reoccurring. >> How >> > can I do that? >> > >> > My provenance, content, and flow repos are all on separate disk devices, >> > each of which is 50GB in capacity. >> > >> > Thank you for your help. -Jim >> > >
