Hi, I tried to load about a million records in postgres to see how long it takes as I was testing earlier with less than 100 records. When it was in the last step where it loads the data into postgres, I got an error something like "Unexpected error occurred. Check the logs" and after that I am unable to logon and I get this error. Could you please let me know what went wrong?
[cid:[email protected]] Nifi-app.log: 2017-11-09 16:42:04,423 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files in 4 milliseconds (Stop-the-world time = 0 milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1 2017-11-09 16:42:07,977 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository 2017-11-09 16:42:08,019 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 0 Records and 0 Swap Files in 41 milliseconds (Stop-the-world time = 21 milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 100 2017-11-09 16:42:08,019 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 0 records in 41 milliseconds 2017-11-09 16:42:15,792 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] 2017-11-09 16:42:15,793 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] 2017-11-09 16:42:15,798 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] 2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] 2017-11-09 16:42:15,799 INFO [StandardProcessScheduler Thread-3] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] to run with 1 threads 2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] 2017-11-09 16:42:15,803 INFO [StandardProcessScheduler Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] to run with 1 threads 2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-2] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] to run with 1 threads 2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-6] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] to run with 1 threads 2017-11-09 16:42:15,850 INFO [StandardProcessScheduler Thread-7] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] to run with 1 threads 2017-11-09 16:42:17,252 INFO [Flow Service Tasks Thread-1] o.a.nifi.controller.StandardFlowService Saved flow controller org.apache.nifi.controller.FlowController@447301a2 // Another save pending = false 2017-11-09 16:42:23,755 INFO [Provenance Maintenance Thread-3] o.a.n.p.PersistentProvenanceRepository Created new Provenance Event Writers for events starting with ID 14 2017-11-09 16:42:23,788 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.lucene.SimpleIndexManager Index Writer for ./provenance_repository/index-1507819090000 has been returned to Index Manager and is no longer in use. Closing Index Writer 2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository Successfully merged 16 journal files (3 records) into single Provenance Log File ./provenance_repository/11.prov in 45 milliseconds 2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository Successfully Rolled over Provenance Event file containing 12 records. In the past 5 minutes, 3 events have been written to the Provenance Repository, totaling 2.33 KB 2017-11-09 16:43:04,174 INFO [Provenance Maintenance Thread-1] o.a.n.p.PersistentProvenanceRepository Created new Provenance Event Writers for events starting with ID 16 2017-11-09 16:44:30,309 ERROR [Event-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: Java heap space at org.apache.nifi.controller.EventDrivenWorkerQueue$WorkerReadyQueue.poll(EventDrivenWorkerQueue.java:201) at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:61) at org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:169) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ... 2 common frames omitted 2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository Failed to cleanup archive for container default due to java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,310 WARN [NiFi Web Server-20-acceptor-0@27563558-ServerConnector@3cc819e2{SSL,[ssl, http/1.1]}{0.0.0.0:8443}] o.eclipse.jetty.server.AbstractConnector java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow Service Tasks Thread-2,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,312 ERROR [Provenance Maintenance Thread-3] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Provenance Maintenance Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-3] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository Failed to expire Provenance Query Results due to java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,313 ERROR [Timer-Driven Process Thread-8] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,313 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository 2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Timer-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,316 WARN [Timer-Driven Process Thread-5] o.apache.nifi.controller.FlowController Unable to update Remote Process Groups due to java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,317 ERROR [FileSystemRepository Workers Thread-1] o.a.n.c.repository.FileSystemRepository Failed to cleanup content claims due to {} java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,317 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,317 INFO [Provenance Repository Rollover Thread-1] o.a.n.p.lucene.SimpleIndexManager Index Writer for ./provenance_repository/index-1507819090000 has been returned to Index Manager and is no longer in use. Closing Index Writer 2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow Service Tasks Thread-1,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:31,747 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files in 25381 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-2] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Timer-Driven Process Thread-2,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-3] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Timer-Driven Process Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-3] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-2] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:33,203 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@5d5f3326 failed to process due to java.lang.OutOfMemoryError: Java heap space; rolling back session: {} java.lang.OutOfMemoryError: Java heap space at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306) at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924) at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169) at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169) at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown Source) at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown Source) at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59) at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown Source) at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114) at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689) at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2017-11-09 16:44:33,204 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] failed to process session due to java.lang.OutOfMemoryError: Java heap space: {} java.lang.OutOfMemoryError: Java heap space at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306) at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924) at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169) at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169) at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown Source) at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown Source) at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59) at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown Source) at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114) at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689) at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] Processor Administratively Yielded for 1 sec due to processing failure 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] due to uncaught Exception: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.c.t.ContinuallyRunProcessorTask java.lang.OutOfMemoryError: Java heap space at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306) at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924) at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169) at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169) at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown Source) at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown Source) at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59) at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101) at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689) at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown Source) at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114) at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184) at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689) at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2017-11-09 16:44:33,678 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 1 Records and 0 Swap Files in 3365 milliseconds (Stop-the-world time = 3344 milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 104 2017-11-09 16:44:33,678 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 1 records in 3365 milliseconds 2017-11-09 16:44:34,211 INFO [FileSystemRepository Workers Thread-2] o.a.n.c.repository.FileSystemRepository Successfully archived 2 Resource Claims for Container default in 1 millis 2017-11-09 16:46:15,026 WARN [NiFi Web Server-20] o.e.jetty.util.thread.QueuedThreadPool java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,026 ERROR [Cleanup Archive for default] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,027 WARN [NiFi Web Server-20] o.e.jetty.util.thread.QueuedThreadPool Unexpected thread death: org.eclipse.jetty.util.thread.QueuedThreadPool$2@33e78315 in NiFi Web Server{STARTED,8<=8<=200,i=5,q=0} 2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,027 ERROR [FileSystemRepository Workers Thread-1] o.a.n.c.repository.FileSystemRepository Failed to cleanup content claims due to {} java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,027 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@2a991dcd failed to process due to java.lang.OutOfMemoryError: Java heap space; rolling back session: {} java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-2] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Event-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,028 ERROR [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] failed to process session due to java.lang.OutOfMemoryError: Java heap space: {} java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Provenance Maintenance Thread-4,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow Service Tasks Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] Processor Administratively Yielded for 1 sec due to processing failure 2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Timer-Driven Process Thread-5,5,main]: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] org.apache.nifi.NiFi java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] due to uncaught Exception: java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask java.lang.OutOfMemoryError: Java heap space 2017-11-09 16:46:31,754 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files in 6 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 1 millis), max Transaction ID -1 2017-11-09 16:46:33,679 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository 2017-11-09 16:46:33,889 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 1 Records and 0 Swap Files in 210 milliseconds (Stop-the-world time = 41 milliseconds, Clear Edit Logs time = 161 millis), max Transaction ID 104 2017-11-09 16:46:33,889 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 1 records in 210 milliseconds
