Aruna, The reason you can no longer log in is due to the Out Of Memory Error occurring on the JVM running NiFi. I believe you will need to restart NiFi in order to reconnect.
For the original issue, PutDatabaseRecord uses the JDBC driver to set up a prepared statement along with rows of values. Each incoming record will be a row, and each column/field in that row becomes an object stored by the driver. With a million records, I presume it takes more memory to store these objects than you have allocated to your JVM's heap. There are a couple of options: 1) Increase your heap size in the bootstrap.conf file. This might get things moving again but is not a scalable solution (i.e. 2 million rows might make you run out of memory again). 2) Use SplitRecord [1] before PutDatabaseRecord, to split the million-record file into slightly smaller files (say, 10000 records per split or so, although you may need to tune this value based on your available memory) The latter option will still allow multiple records to be processed at once, but they can be done in smaller chunks, so memory can be reused for the next chunk, rather than having to have all million rows in memory at once. Regards, Matt [1] http://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.SplitRecord/index.html On Thu, Nov 9, 2017 at 11:53 AM, Aruna Sankaralingam < [email protected]> wrote: > Hi, > > > > I tried to load about a million records in postgres to see how long it > takes as I was testing earlier with less than 100 records. When it was in > the last step where it loads the data into postgres, I got an error > something like “Unexpected error occurred. Check the logs” and after that I > am unable to logon and I get this error. Could you please let me know what > went wrong? > > > > > > *Nifi-app.log:* > > > > 2017-11-09 16:42:04,423 INFO [Write-Ahead Local State Provider > Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali. > MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 > Swap Files in 4 milliseconds (Stop-the-world time = 0 milliseconds, Clear > Edit Logs time = 0 millis), max Transaction ID -1 > > 2017-11-09 16:42:07,977 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Initiating checkpoint of FlowFile Repository > > 2017-11-09 16:42:08,019 INFO [pool-10-thread-1] > org.wali.MinimalLockingWriteAheadLog > org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 0 Records > and 0 Swap Files in 41 milliseconds (Stop-the-world time = 21 milliseconds, > Clear Edit Logs time = 12 millis), max Transaction ID 100 > > 2017-11-09 16:42:08,019 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Successfully checkpointed FlowFile Repository with 0 records in 41 > milliseconds > > 2017-11-09 16:42:15,792 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > > 2017-11-09 16:42:15,793 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] > > 2017-11-09 16:42:15,798 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] > > 2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] > > 2017-11-09 16:42:15,799 INFO [StandardProcessScheduler Thread-3] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] to > run with 1 threads > > 2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] > o.a.n.c.s.StandardProcessScheduler > Starting UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] > > 2017-11-09 16:42:15,803 INFO [StandardProcessScheduler Thread-1] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] to run > with 1 threads > > 2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-2] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] to run > with 1 threads > > 2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-6] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] to run with 1 > threads > > 2017-11-09 16:42:15,850 INFO [StandardProcessScheduler Thread-7] > o.a.n.c.s.TimerDrivenSchedulingAgent > Scheduled PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] to run > with 1 threads > > 2017-11-09 16:42:17,252 INFO [Flow Service Tasks Thread-1] > o.a.nifi.controller.StandardFlowService Saved flow controller > org.apache.nifi.controller.FlowController@447301a2 // Another save > pending = false > > 2017-11-09 16:42:23,755 INFO [Provenance Maintenance Thread-3] > o.a.n.p.PersistentProvenanceRepository > Created new Provenance Event Writers for events starting with ID 14 > > 2017-11-09 16:42:23,788 INFO [Provenance Repository Rollover Thread-2] > o.a.n.p.lucene.SimpleIndexManager Index Writer for > ./provenance_repository/index-1507819090000 has been returned to Index > Manager and is no longer in use. Closing Index Writer > > 2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] > o.a.n.p.PersistentProvenanceRepository Successfully merged 16 journal > files (3 records) into single Provenance Log File > ./provenance_repository/11.prov in 45 milliseconds > > 2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] > o.a.n.p.PersistentProvenanceRepository Successfully Rolled over > Provenance Event file containing 12 records. In the past 5 minutes, 3 > events have been written to the Provenance Repository, totaling 2.33 KB > > 2017-11-09 16:43:04,174 INFO [Provenance Maintenance Thread-1] > o.a.n.p.PersistentProvenanceRepository > Created new Provenance Event Writers for events starting with ID 16 > > 2017-11-09 16:44:30,309 ERROR [Event-Driven Process Thread-1] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > at org.apache.nifi.controller.EventDrivenWorkerQueue$ > WorkerReadyQueue.poll(EventDrivenWorkerQueue.java:201) > > at org.apache.nifi.controller.EventDrivenWorkerQueue.poll( > EventDrivenWorkerQueue.java:61) > > at org.apache.nifi.controller.scheduling. > EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent. > java:169) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > > ... 2 common frames omitted > > 2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] > o.a.n.c.repository.FileSystemRepository Failed to cleanup archive for > container default due to java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] > o.a.n.c.repository.FileSystemRepository > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,310 WARN [NiFi Web Server-20-acceptor-0@27563558- > ServerConnector@3cc819e2{SSL,[ssl, http/1.1]}{0.0.0.0:8443}] > o.eclipse.jetty.server.AbstractConnector > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow > Service Tasks Thread-2,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,312 ERROR [Provenance Maintenance Thread-3] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Provenance > Maintenance Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-3] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] > o.a.n.p.PersistentProvenanceRepository > Failed to expire Provenance Query Results due to > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] > o.a.n.p.PersistentProvenanceRepository > > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 ERROR [Timer-Driven Process Thread-8] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,313 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Initiating checkpoint of FlowFile Repository > > 2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Timer-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,316 WARN [Timer-Driven Process Thread-5] > o.apache.nifi.controller.FlowController Unable to update Remote Process > Groups due to java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,317 ERROR [FileSystemRepository Workers Thread-1] > o.a.n.c.repository.FileSystemRepository Failed to cleanup content claims > due to {} > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,317 ERROR [Framework Task Thread Thread-1] > o.a.n.c.s.StandardProcessScheduler > Failed to run Framework Task Expire FlowFiles due to > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,317 INFO [Provenance Repository Rollover Thread-1] > o.a.n.p.lucene.SimpleIndexManager Index Writer for > ./provenance_repository/index-1507819090000 has been returned to Index > Manager and is no longer in use. Closing Index Writer > > 2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow > Service Tasks Thread-1,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-1] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:31,747 INFO [Write-Ahead Local State Provider > Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali. > MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 > Swap Files in 25381 milliseconds (Stop-the-world time = 1 milliseconds, > Clear Edit Logs time = 0 millis), max Transaction ID -1 > > 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-2] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Timer-Driven Process Thread-2,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-3] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Timer-Driven Process Thread-3,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-3] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-2] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:33,203 ERROR [Timer-Driven Process Thread-10] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981@5d5f3326 failed to process due to > java.lang.OutOfMemoryError: Java heap space; rolling back session: {} > > java.lang.OutOfMemoryError: Java heap space > > at org.postgresql.jdbc.PgPreparedStatement.setInt( > PgPreparedStatement.java:306) > > at org.postgresql.jdbc.PgPreparedStatement.setObject( > PgPreparedStatement.java:924) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > executeDML(PutDatabaseRecord.java:654) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$null$1(PutDatabaseRecord.java:382) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$246/806461661.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.ExceptionHandler. > execute(ExceptionHandler.java:127) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$new$3(PutDatabaseRecord.java:357) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$58/111888987.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.Put.putFlowFiles( > Put.java:59) > > at org.apache.nifi.processor.util.pattern.Put.onTrigger( > Put.java:101) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$onTrigger$9(PutDatabaseRecord.java:689) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981.execute(Unknown Source) > > at org.apache.nifi.processor.util.pattern.PartialFunctions. > onTrigger(PartialFunctions.java:114) > > at org.apache.nifi.processor.util.pattern. > RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > onTrigger(PutDatabaseRecord.java:689) > > at org.apache.nifi.controller.StandardProcessorNode.onTrigger( > StandardProcessorNode.java:1119) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:147) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:47) > > at org.apache.nifi.controller.scheduling. > TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > 2017-11-09 16:44:33,204 ERROR [Timer-Driven Process Thread-10] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] failed to > process session due to java.lang.OutOfMemoryError: Java heap space: {} > > java.lang.OutOfMemoryError: Java heap space > > at org.postgresql.jdbc.PgPreparedStatement.setInt( > PgPreparedStatement.java:306) > > at org.postgresql.jdbc.PgPreparedStatement.setObject( > PgPreparedStatement.java:924) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > executeDML(PutDatabaseRecord.java:654) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$null$1(PutDatabaseRecord.java:382) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$246/806461661.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.ExceptionHandler. > execute(ExceptionHandler.java:127) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$new$3(PutDatabaseRecord.java:357) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$58/111888987.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.Put.putFlowFiles( > Put.java:59) > > at org.apache.nifi.processor.util.pattern.Put.onTrigger( > Put.java:101) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$onTrigger$9(PutDatabaseRecord.java:689) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981.execute(Unknown Source) > > at org.apache.nifi.processor.util.pattern.PartialFunctions. > onTrigger(PartialFunctions.java:114) > > at org.apache.nifi.processor.util.pattern. > RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > onTrigger(PutDatabaseRecord.java:689) > > at org.apache.nifi.controller.StandardProcessorNode.onTrigger( > StandardProcessorNode.java:1119) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:147) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:47) > > at org.apache.nifi.controller.scheduling. > TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > Processor Administratively Yielded for 1 sec due to processing failure > > 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] > o.a.n.c.t.ContinuallyRunProcessorTask > Administratively Yielding > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > due to uncaught Exception: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] > o.a.n.c.t.ContinuallyRunProcessorTask > > > java.lang.OutOfMemoryError: Java heap space > > at org.postgresql.jdbc.PgPreparedStatement.setInt( > PgPreparedStatement.java:306) > > at org.postgresql.jdbc.PgPreparedStatement.setObject( > PgPreparedStatement.java:924) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject( > DelegatingPreparedStatement.java:169) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > executeDML(PutDatabaseRecord.java:654) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$null$1(PutDatabaseRecord.java:382) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$246/806461661.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.ExceptionHandler. > execute(ExceptionHandler.java:127) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$new$3(PutDatabaseRecord.java:357) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$58/111888987.apply(Unknown Source) > > at org.apache.nifi.processor.util.pattern.Put.putFlowFiles( > Put.java:59) > > at org.apache.nifi.processor.util.pattern.Put.onTrigger( > Put.java:101) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > lambda$onTrigger$9(PutDatabaseRecord.java:689) > > at org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981.execute(Unknown Source) > > at org.apache.nifi.processor.util.pattern.PartialFunctions. > onTrigger(PartialFunctions.java:114) > > at org.apache.nifi.processor.util.pattern. > RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) > > at org.apache.nifi.processors.standard.PutDatabaseRecord. > onTrigger(PutDatabaseRecord.java:689) > > at org.apache.nifi.controller.StandardProcessorNode.onTrigger( > StandardProcessorNode.java:1119) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:147) > > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:47) > > at org.apache.nifi.controller.scheduling. > TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) > > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1149) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > 2017-11-09 16:44:33,678 INFO [pool-10-thread-1] > org.wali.MinimalLockingWriteAheadLog > org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 1 Records > and 0 Swap Files in 3365 milliseconds (Stop-the-world time = 3344 > milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 104 > > 2017-11-09 16:44:33,678 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Successfully checkpointed FlowFile Repository with 1 records in 3365 > milliseconds > > 2017-11-09 16:44:34,211 INFO [FileSystemRepository Workers Thread-2] > o.a.n.c.repository.FileSystemRepository Successfully archived 2 Resource > Claims for Container default in 1 millis > > 2017-11-09 16:46:15,026 WARN [NiFi Web Server-20] > o.e.jetty.util.thread.QueuedThreadPool > > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,026 ERROR [Cleanup Archive for default] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,027 WARN [NiFi Web Server-20] > o.e.jetty.util.thread.QueuedThreadPool > Unexpected thread death: org.eclipse.jetty.util.thread. > QueuedThreadPool$2@33e78315 in NiFi Web Server{STARTED,8<=8<=200,i=5,q=0} > > 2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-1] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,027 ERROR [FileSystemRepository Workers Thread-1] > o.a.n.c.repository.FileSystemRepository Failed to cleanup content claims > due to {} > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,027 ERROR [Framework Task Thread Thread-1] > o.a.n.c.s.StandardProcessScheduler > Failed to run Framework Task Expire FlowFiles due to > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-7] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > org.apache.nifi.processors.standard.PutDatabaseRecord$$ > Lambda$243/1454465981@2a991dcd failed to process due to > java.lang.OutOfMemoryError: Java heap space; rolling back session: {} > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-2] > org.apache.nifi.engine.FlowEngine A flow controller task execution > stopped abnormally > > java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java > heap space > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at org.apache.nifi.engine.FlowEngine.afterExecute( > FlowEngine.java:100) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1157) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:748) > > Caused by: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Event-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Timer-Driven Process Thread-7] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] failed to > process session due to java.lang.OutOfMemoryError: Java heap space: {} > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Provenance > Maintenance Thread-4,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow > Service Tasks Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] > o.a.n.p.standard.PutDatabaseRecord > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > Processor Administratively Yielded for 1 sec due to processing failure > > 2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] > org.apache.nifi.NiFi An Unknown Error Occurred in Thread > Thread[Timer-Driven Process Thread-5,5,main]: java.lang.OutOfMemoryError: > Java heap space > > 2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] > org.apache.nifi.NiFi > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] > o.a.n.c.t.ContinuallyRunProcessorTask > Administratively Yielding > PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] > due to uncaught Exception: java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] > o.a.n.c.t.ContinuallyRunProcessorTask > > > java.lang.OutOfMemoryError: Java heap space > > 2017-11-09 16:46:31,754 INFO [Write-Ahead Local State Provider > Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali. > MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 > Swap Files in 6 milliseconds (Stop-the-world time = 1 milliseconds, Clear > Edit Logs time = 1 millis), max Transaction ID -1 > > 2017-11-09 16:46:33,679 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Initiating checkpoint of FlowFile Repository > > 2017-11-09 16:46:33,889 INFO [pool-10-thread-1] > org.wali.MinimalLockingWriteAheadLog > org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 1 Records > and 0 Swap Files in 210 milliseconds (Stop-the-world time = 41 > milliseconds, Clear Edit Logs time = 161 millis), max Transaction ID 104 > > 2017-11-09 16:46:33,889 INFO [pool-10-thread-1] > o.a.n.c.r.WriteAheadFlowFileRepository > Successfully checkpointed FlowFile Repository with 1 records in 210 > milliseconds > > >
