Aruna, The bootstrap.conf file is in the conf/ directory under the NiFi installation. You'd be looking for the java.arg.2 and java.arg.3 property.
I recommend both options if you have them :) If you can give NiFi more heap then that can help a number of things, but really Option 2 is the way to attack your problem for sure. Regards, Matt On Thu, Nov 9, 2017 at 1:29 PM, Aruna Sankaralingam < [email protected]> wrote: > Thank you Matt. Could you please let me know where I can find the > bootstrap.conf file? > > > > Out of the two options you have given, which one is recommended? > > > > *From:* Matt Burgess [mailto:[email protected]] > *Sent:* Thursday, November 09, 2017 12:14 PM > *To:* [email protected] > *Subject:* Re: Nifi : 504 Gateway Time-Out Error > > > > Aruna, > > > > The reason you can no longer log in is due to the Out Of Memory Error > occurring on the JVM running NiFi. I believe you will need to restart NiFi > in order to reconnect. > > > > For the original issue, PutDatabaseRecord uses the JDBC driver to set up a > prepared statement along with rows of values. Each incoming record will be > a row, and each column/field in that row becomes an object stored by the > driver. With a million records, I presume it takes more memory to store > these objects than you have allocated to your JVM's heap. There are a > couple of options: > > > > 1) Increase your heap size in the bootstrap.conf file. This might get > things moving again but is not a scalable solution (i.e. 2 million rows > might make you run out of memory again). > > 2) Use SplitRecord [1] before PutDatabaseRecord, to split the > million-record file into slightly smaller files (say, 10000 records per > split or so, although you may need to tune this value based on your > available memory) > > > > The latter option will still allow multiple records to be processed at > once, but they can be done in smaller chunks, so memory can be reused for > the next chunk, rather than having to have all million rows in memory at > once. > > > > Regards, > > Matt > > > > [1] http://nifi.apache.org/docs/nifi-docs/components/org. > apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard. > SplitRecord/index.html > > > > > > On Thu, Nov 9, 2017 at 11:53 AM, Aruna Sankaralingam < > [email protected]> wrote: > > Hi, > > > > I tried to load about a million records in postgres to see how long it > takes as I was testing earlier with less than 100 records. When it was in > the last step where it loads the data into postgres, I got an error > something like “Unexpected error occurred. Check the logs” and after that I > am unable to logon and I get this error. Could you please let me know what > went wrong? > > > > > > *Nifi-app.log:* > > > > 2017-11-09 16:42:04,423 INFO [Write-Ahead Local State Provider > Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali. > MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 > Swap Files in 4 milliseconds (Stop-the-world time = 0 milliseconds, Clear > Edit Logs time = 0 millis), max Transaction ID -1 > > 2017-11-09 16:42:07,977 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Initiating checkpoint of FlowFile Repository > > 2017-11-09 16:42:08,019 INFO [pool-10-thread-1] > org.wali.MinimalLockingWriteAheadLog > org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 0 Records > and 0 Swap Files in 41 milliseconds (Stop-the-world time = 21 milliseconds, > Clear Edit Logs time = 12 millis), max Transaction ID 100 > > 2017-11-09 16:42:08,019 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Successfully checkpointed FlowFile Repository with 0 records in 41 > milliseconds > > 2017-11-09 16:42:15,792 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > > 2017-11-09 16:42:15,793 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] > > 2017-11-09 16:42:15,798 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] > > 2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] > > 2017-11-09 16:42:15,799 INFO [StandardProcessScheduler Thread-3] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] to > run with 1 threads > > 2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] > > 2017-11-09 16:42:15,803 INFO [StandardProcessScheduler Thread-1] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] to run > with 1 threads > > 2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-2] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] to run > with 1 threads > > 2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-6] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] to run with 1 > threads > > 2017-11-09 16:42:15,850 INFO [StandardProcessScheduler Thread-7] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] to run > with 1 threads > > 2017-11-09 16:42:17,252 INFO [Flow Service Tasks Thread-1] > o.a.nifi.controller.StandardFlowService Saved flow controller > org.apache.nifi.controller.FlowController@447301a2 // Another save > pending = false > > 2017-11-09 16:42:23,755 INFO [Provenance Maintenance Thread-3] > o.a.n.p.PersistentProvenanceRepository > Created new Provenance Event Writers for events starting with ID 14 > > 2017-11-09 16:42:23,788 INFO [Provenance Repository Rollover Thread-2] > o.a.n.p.lucene.SimpleIndexManager Index Writer for > ./provenance_repository/index-1507819090000 has been returned to Index > Manager and is no longer in use. Closing Index Writer > > 2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] > o.a.n.p.PersistentProvenanceRepository Successfully merged 16 journal > files (3 records) into single Provenance Log File > ./provenance_repository/11.prov in 45 milliseconds > > 2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] > o.a.n.p.PersistentProvenanceRepository Successfully Rolled over > Provenance Event file containing 12 records. In the past 5 minutes, 3 > events have been written to the Provenance Repository, totaling 2.33 KB > > 2017-11-09 16:43:04,174 INFO [Provenance Maintenance Thread-1] > o.a.n.p.PersistentProvenanceRepository > Created new Provenance Event Writers for events starting with ID 16 > > 2017-11-09 16:44:30,309 ERROR [Event-Driven Process Thread-1] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > at org.apache.nifi.controller.EventDrivenWorkerQueue$ > WorkerReadyQueue.poll(EventDrivenWorkerQueue.java:201) > > at org.apache.nifi.controller.EventDrivenWorkerQueue.poll( > EventDrivenWorkerQueue.java:61) > > at org.apache.nifi.controller.scheduling. > EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent. > java:169) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > > ... 2 common frames omitted > > 2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] > o.a.n.c.repository.FileSystemRepository Failed to cleanup archive for > container default due to java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] > o.a.n.c.repository.FileSystemRepository > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,310 WARN [NiFi Web Server-20-acceptor-0@27563558- > ServerConnector@3cc819e2{SSL,[ssl, http/1.1]}{0.0.0.0:8443}] > o.eclipse.jetty.server.AbstractConnector > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow > Service Tasks Thread-2,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,312 ERROR [Provenance Maintenance Thread-3] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Provenance > Maintenance Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-3] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] > o.a.n.p.PersistentProvenanceRepository > Failed to expire Provenance Query Results due to > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] > o.a.n.p.PersistentProvenanceRepository > > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 ERROR [Timer-Driven Process Thread-8] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Initiating checkpoint of FlowFile Repository > > 2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Timer-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,316 WARN [Timer-Driven Process Thread-5] > o.apache.nifi.controller.FlowController Unable to update Remote Process > Groups due to java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,317 ERROR [FileSystemRepository Workers Thread-1] > o.a.n.c.repository.FileSystemRepository Failed to cleanup content claims > due to {} > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,317 ERROR [Framework Task Thread Thread-1] > o.a.n.c.s.StandardProcessScheduler > Failed to run Framework Task Expire FlowFiles due to > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,317 INFO [Provenance Repository Rollover Thread-1] > o.a.n.p.lucene.SimpleIndexManager Index Writer for > ./provenance_repository/index-1507819090000 has been returned to Index > Manager and is no longer in use. Closing Index Writer > > 2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow > Service Tasks Thread-1,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-1] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:31,747 INFO [Write-Ahead Local State Provider > Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali. > MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 > Swap Files in 25381 milliseconds (Stop-the-world time = 1 milliseconds, > Clear Edit Logs time = 0 millis), max Transaction ID -1 > > 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-2] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Timer-Driven Process Thread-2,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-3] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Timer-Driven Process Thread-3,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-3] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-2] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:33,203 ERROR [Timer-Driven Process Thread-10] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981@5d5f3326 failed to process due to > java.lang.OutOfMemoryError: Java heap space; rolling back session: {} > > java.lang.OutOfMemoryError: Java heap space > > at org.postgresql.jdbc.PgPreparedStatement.setInt( > PgPreparedStatement.java:306) > > at org.postgresql.jdbc.PgPreparedStatement.setObject( > PgPreparedStatement.java:924) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > executeDML(PutDatabaseRecord.java:654) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$null$1(PutDatabaseRecord.java:382) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$246/806461661.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.ExceptionHandler. > execute(ExceptionHandler.java:127) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$new$3(PutDatabaseRecord.java:357) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$58/111888987.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.Put.putFlowFiles( > Put.java:59) > > at org.apache.nifi.processor.util.pattern.Put.onTrigger( > Put.java:101) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$onTrigger$9(PutDatabaseRecord.java:689) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981.execute(Unknown Source) > > at org.apache.nifi.processor.util.pattern.PartialFunctions. > onTrigger(PartialFunctions.java:114) > > at org.apache.nifi.processor.util.pattern. > RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > onTrigger(PutDatabaseRecord.java:689) > > at org.apache.nifi.controller.StandardProcessorNode.onTrigger( > StandardProcessorNode.java:1119) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:147) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:47) > > at org.apache.nifi.controller.scheduling. > TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > 2017-11-09 16:44:33,204 ERROR [Timer-Driven Process Thread-10] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] failed to > process session due to java.lang.OutOfMemoryError: Java heap space: {} > > java.lang.OutOfMemoryError: Java heap space > > at org.postgresql.jdbc.PgPreparedStatement.setInt( > PgPreparedStatement.java:306) > > at org.postgresql.jdbc.PgPreparedStatement.setObject( > PgPreparedStatement.java:924) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > executeDML(PutDatabaseRecord.java:654) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$null$1(PutDatabaseRecord.java:382) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$246/806461661.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.ExceptionHandler. > execute(ExceptionHandler.java:127) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$new$3(PutDatabaseRecord.java:357) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$58/111888987.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.Put.putFlowFiles( > Put.java:59) > > at org.apache.nifi.processor.util.pattern.Put.onTrigger( > Put.java:101) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$onTrigger$9(PutDatabaseRecord.java:689) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981.execute(Unknown Source) > > at org.apache.nifi.processor.util.pattern.PartialFunctions. > onTrigger(PartialFunctions.java:114) > > at org.apache.nifi.processor.util.pattern. > RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > onTrigger(PutDatabaseRecord.java:689) > > at org.apache.nifi.controller.StandardProcessorNode.onTrigger( > StandardProcessorNode.java:1119) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:147) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:47) > > at org.apache.nifi.controller.scheduling. > TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > Processor Administratively Yielded for 1 sec due to processing failure > > 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] > o.a.n.c.t.ContinuallyRunProcessorTask > Administratively Yielding > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > due to uncaught Exception: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] > o.a.n.c.t.ContinuallyRunProcessorTask > > > java.lang.OutOfMemoryError: Java heap space > > at org.postgresql.jdbc.PgPreparedStatement.setInt( > PgPreparedStatement.java:306) > > at org.postgresql.jdbc.PgPreparedStatement.setObject( > PgPreparedStatement.java:924) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > executeDML(PutDatabaseRecord.java:654) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$null$1(PutDatabaseRecord.java:382) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$246/806461661.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.ExceptionHandler. > execute(ExceptionHandler.java:127) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$new$3(PutDatabaseRecord.java:357) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$58/111888987.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.Put.putFlowFiles( > Put.java:59) > > at org.apache.nifi.processor.util.pattern.Put.onTrigger( > Put.java:101) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$onTrigger$9(PutDatabaseRecord.java:689) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981.execute(Unknown Source) > > at org.apache.nifi.processor.util.pattern.PartialFunctions. > onTrigger(PartialFunctions.java:114) > > at org.apache.nifi.processor.util.pattern. > RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > onTrigger(PutDatabaseRecord.java:689) > > at org.apache.nifi.controller.StandardProcessorNode.onTrigger( > StandardProcessorNode.java:1119) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:147) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:47) > > at org.apache.nifi.controller.scheduling. > TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > 2017-11-09 16:44:33,678 INFO [pool-10-thread-1] > org.wali.MinimalLockingWriteAheadLog > org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 1 Records > and 0 Swap Files in 3365 milliseconds (Stop-the-world time = 3344 > milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 104 > > 2017-11-09 16:44:33,678 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Successfully checkpointed FlowFile Repository with 1 records in 3365 > milliseconds > > 2017-11-09 16:44:34,211 INFO [FileSystemRepository Workers Thread-2] > o.a.n.c.repository.FileSystemRepository Successfully archived 2 Resource > Claims for Container default in 1 millis > > 2017-11-09 16:46:15,026 WARN [NiFi Web Server-20] > o.e.jetty.util.thread.QueuedThreadPool > > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,026 ERROR [Cleanup Archive for default] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,027 WARN [NiFi Web Server-20] > o.e.jetty.util.thread.QueuedThreadPool > Unexpected thread death: org.eclipse.jetty.util.thread. > QueuedThreadPool$2@33e78315 in NiFi Web Server{STARTED,8<=8<=200,i=5,q=0} > > 2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-1] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,027 ERROR [FileSystemRepository Workers Thread-1] > o.a.n.c.repository.FileSystemRepository Failed to cleanup content claims > due to {} > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,027 ERROR [Framework Task Thread Thread-1] > o.a.n.c.s.StandardProcessScheduler > Failed to run Framework Task Expire FlowFiles due to > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-7] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981@2a991dcd failed to process due to > java.lang.OutOfMemoryError: Java heap space; rolling back session: {} > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-2] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Event-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Timer-Driven Process Thread-7] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] failed to > process session due to java.lang.OutOfMemoryError: Java heap space: {} > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Provenance > Maintenance Thread-4,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow > Service Tasks Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > Processor Administratively Yielded for 1 sec due to processing failure > > 2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Timer-Driven Process Thread-5,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] > o.a.n.c.t.ContinuallyRunProcessorTask > Administratively Yielding > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > due to uncaught Exception: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] > o.a.n.c.t.ContinuallyRunProcessorTask > > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:31,754 INFO [Write-Ahead Local State Provider > Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali. > MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 > Swap Files in 6 milliseconds (Stop-the-world time = 1 milliseconds, Clear > Edit Logs time = 1 millis), max Transaction ID -1 > > 2017-11-09 16:46:33,679 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Initiating checkpoint of FlowFile Repository > > 2017-11-09 16:46:33,889 INFO [pool-10-thread-1] > org.wali.MinimalLockingWriteAheadLog > org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 1 Records > and 0 Swap Files in 210 milliseconds (Stop-the-world time = 41 > milliseconds, Clear Edit Logs time = 161 millis), max Transaction ID 104 > > 2017-11-09 16:46:33,889 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Successfully checkpointed FlowFile Repository with 1 records in 210 > milliseconds > > > > >
