Hi Matt, Please skip this thread. I had figured out the reason because somebody closed the iptables. I was misled by the above logs.
Best, Chico On 14 February 2017 at 10:30, Chico Qi <[email protected]> wrote: > Hi Matt, > > Could you look at this issue? Thank you. > > > "Cleanup Archive for default" Id=40 RUNNABLE > at sun.nio.fs.UnixNativeDispatcher.access0(Native Method) > at sun.nio.fs.UnixNativeDispatcher.access( > UnixNativeDispatcher.java:449) > at sun.nio.fs.UnixFileSystemProvider.checkAccess( > UnixFileSystemProvider.java:306) > at java.nio.file.Files.exists(Files.java:2385) > at org.apache.nifi.controller.repository.FileSystemRepository. > destroyExpiredArchives(FileSystemRepository.java:1300) > at org.apache.nifi.controller.repository. > FileSystemRepository.access$1600(FileSystemRepository.java:83) > at org.apache.nifi.controller.repository.FileSystemRepository$ > DestroyExpiredArchiveClaims.run(FileSystemRepository.java:1537) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Number of Locked Synchronizers: 1 > - java.util.concurrent.ThreadPoolExecutor$Worker@48dc9950 > > "DestroyJavaVM" Id=60 RUNNABLE > > "Event-Driven Process Thread-1" Id=42 TIMED_WAITING on > java.lang.Object@4d70e3d2 > at java.lang.Object.wait(Native Method) > at org.apache.nifi.controller.EventDrivenWorkerQueue.poll( > EventDrivenWorkerQueue.java:70) > at org.apache.nifi.controller.scheduling. > EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent. > java:166) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Number of Locked Synchronizers: 1 > - java.util.concurrent.ThreadPoolExecutor$Worker@433362e0 > > "Event-Driven Process Thread-2" Id=43 TIMED_WAITING on > java.lang.Object@4d70e3d2 > at java.lang.Object.wait(Native Method) > at org.apache.nifi.controller.EventDrivenWorkerQueue.poll( > EventDrivenWorkerQueue.java:70) > at org.apache.nifi.controller.scheduling. > EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent. > java:166) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Number of Locked Synchronizers: 1 > - java.util.concurrent.ThreadPoolExecutor$Worker@425a5c2e > > "Event-Driven Process Thread-3" Id=44 TIMED_WAITING on > java.lang.Object@4d70e3d2 > at java.lang.Object.wait(Native Method) > at org.apache.nifi.controller.EventDrivenWorkerQueue.poll( > EventDrivenWorkerQueue.java:70) > at org.apache.nifi.controller.scheduling. > EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent. > java:166) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Number of Locked Synchronizers: 1 > - java.util.concurrent.ThreadPoolExecutor$Worker@58cd6088 > > "Event-Driven Process Thread-4" Id=45 TIMED_WAITING on > java.lang.Object@4d70e3d2 > at java.lang.Object.wait(Native Method) > at org.apache.nifi.controller.EventDrivenWorkerQueue.poll( > EventDrivenWorkerQueue.java:70) > at org.apache.nifi.controller.scheduling. > EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent. > java:166) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Number of Locked Synchronizers: 1 > - java.util.concurrent.ThreadPoolExecutor$Worker@44a7661d > > "Event-Driven Process Thread-5" Id=46 TIMED_WAITING on > java.lang.Object@4d70e3d2 > at java.lang.Object.wait(Native Method) > at org.apache.nifi.controller.EventDrivenWorkerQueue.poll( > EventDrivenWorkerQueue.java:70) > at org.apache.nifi.controller.scheduling. > EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent. > java:166) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Number of Locked Synchronizers: 1 > - java.util.concurrent.ThreadPoolExecutor$Worker@1cdb280b > > "FileSystemRepository Workers Thread-1" Id=38 TIMED_WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@9d6b30 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "FileSystemRepository Workers Thread-2" Id=39 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@9d6b30 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "FileSystemRepository Workers Thread-3" Id=56 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@9d6b30 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "FileSystemRepository Workers Thread-4" Id=57 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@9d6b30 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Finalizer" Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@3839e381 > at java.lang.Object.wait(Native Method) > at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143) > at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164) > at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209) > > "Flow Service Tasks Thread-1" Id=49 WAITING on java.util.concurrent.locks. > AbstractQueuedSynchronizer$ConditionObject@3f0a2366 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > "Flow Service Tasks Thread-2" Id=50 TIMED_WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@3f0a2366 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Framework Task Thread Thread-1" Id=47 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@74644b72 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Framework Task Thread Thread-2" Id=61 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@74644b72 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Framework Task Thread Thread-3" Id=63 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@74644b72 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Framework Task Thread Thread-4" Id=66 TIMED_WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@74644b72 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "H2 File Lock Watchdog /data/test/nifi-1.1.1/ > database_repository/nifi-flow-audit.lock.db" Id=31 TIMED_WAITING on null > at java.lang.Thread.sleep(Native Method) > at org.h2.store.FileLock.run(FileLock.java:517) > at java.lang.Thread.run(Thread.java:745) > > "H2 File Lock Watchdog /data/test/nifi-1.1.1/ > database_repository/nifi-user-keys.lock.db" Id=29 TIMED_WAITING on null > at java.lang.Thread.sleep(Native Method) > at org.h2.store.FileLock.run(FileLock.java:517) > at java.lang.Thread.run(Thread.java:745) > > "H2 Log Writer NIFI-FLOW-AUDIT" Id=32 TIMED_WAITING on > org.h2.store.WriterThread@db4db79 > at java.lang.Object.wait(Native Method) > at org.h2.store.WriterThread.run(WriterThread.java:103) > at java.lang.Thread.run(Thread.java:745) > > "H2 Log Writer NIFI-USER-KEYS" Id=30 TIMED_WAITING on > org.h2.store.WriterThread@609725db > at java.lang.Object.wait(Native Method) > at org.h2.store.WriterThread.run(WriterThread.java:103) > at java.lang.Thread.run(Thread.java:745) > > "Http Site-to-Site Transaction Maintenance" Id=52 TIMED_WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@514924d5 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Listen to Bootstrap" Id=11 RUNNABLE (in native code) > at java.net.PlainSocketImpl.socketAccept(Native Method) > at java.net.AbstractPlainSocketImpl.accept( > AbstractPlainSocketImpl.java:409) > at java.net.ServerSocket.implAccept(ServerSocket.java:545) > at java.net.ServerSocket.accept(ServerSocket.java:513) > at org.apache.nifi.BootstrapListener$Listener. > run(BootstrapListener.java:158) > at java.lang.Thread.run(Thread.java:745) > > "NiFi Web Server-14" Id=14 TIMED_WAITING on java.util.concurrent.locks. > AbstractQueuedSynchronizer$ConditionObject@1debbe8b > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at org.eclipse.jetty.util.BlockingArrayQueue.poll( > BlockingArrayQueue.java:392) > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll( > QueuedThreadPool.java:563) > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800( > QueuedThreadPool.java:48) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > QueuedThreadPool.java:626) > at java.lang.Thread.run(Thread.java:745) > > "NiFi Web Server-15-acceptor-0@4b066838-ServerConnector@258291de{HTTP/ > 1.1,[http/1.1]}{172.23.51.151:8080}" Id=15 RUNNABLE (in native code) > at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) > at sun.nio.ch.ServerSocketChannelImpl.accept( > ServerSocketChannelImpl.java:422) > at sun.nio.ch.ServerSocketChannelImpl.accept( > ServerSocketChannelImpl.java:250) > - waiting on java.lang.Object@581cd433 > at org.eclipse.jetty.server.ServerConnector.accept( > ServerConnector.java:373) > at org.eclipse.jetty.server.AbstractConnector$Acceptor. > run(AbstractConnector.java:593) > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( > QueuedThreadPool.java:671) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > QueuedThreadPool.java:589) > at java.lang.Thread.run(Thread.java:745) > > "NiFi Web Server-16" Id=16 TIMED_WAITING on java.util.concurrent.locks. > AbstractQueuedSynchronizer$ConditionObject@1debbe8b > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at org.eclipse.jetty.util.BlockingArrayQueue.poll( > BlockingArrayQueue.java:392) > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll( > QueuedThreadPool.java:563) > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800( > QueuedThreadPool.java:48) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > QueuedThreadPool.java:626) > at java.lang.Thread.run(Thread.java:745) > > "NiFi Web Server-17" Id=17 TIMED_WAITING on java.util.concurrent.locks. > AbstractQueuedSynchronizer$ConditionObject@1debbe8b > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at org.eclipse.jetty.util.BlockingArrayQueue.poll( > BlockingArrayQueue.java:392) > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll( > QueuedThreadPool.java:563) > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800( > QueuedThreadPool.java:48) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > QueuedThreadPool.java:626) > at java.lang.Thread.run(Thread.java:745) > > "NiFi Web Server-18" Id=18 TIMED_WAITING on java.util.concurrent.locks. > AbstractQueuedSynchronizer$ConditionObject@1debbe8b > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at org.eclipse.jetty.util.BlockingArrayQueue.poll( > BlockingArrayQueue.java:392) > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll( > QueuedThreadPool.java:563) > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800( > QueuedThreadPool.java:48) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > QueuedThreadPool.java:626) > at java.lang.Thread.run(Thread.java:745) > > "NiFi Web Server-19" Id=19 RUNNABLE (in native code) > at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) > at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl. > java:93) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) > - waiting on sun.nio.ch.Util$2@1d0fb948 > - waiting on java.util.Collections$UnmodifiableSet@1c0182ea > - waiting on sun.nio.ch.EPollSelectorImpl@18c33e46 > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select( > ManagedSelector.java:243) > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce( > ManagedSelector.java:191) > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume. > executeProduceConsume(ExecuteProduceConsume.java:249) > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume. > produceConsume(ExecuteProduceConsume.java:148) > at org.eclipse.jetty.util.thread.strategy. > ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) > at org.eclipse.jetty.io.ManagedSelector.run( > ManagedSelector.java:147) > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( > QueuedThreadPool.java:671) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > QueuedThreadPool.java:589) > at java.lang.Thread.run(Thread.java:745) > > "NiFi Web Server-20" Id=20 TIMED_WAITING on java.util.concurrent.locks. > AbstractQueuedSynchronizer$ConditionObject@1debbe8b > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at org.eclipse.jetty.util.BlockingArrayQueue.poll( > BlockingArrayQueue.java:392) > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll( > QueuedThreadPool.java:563) > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800( > QueuedThreadPool.java:48) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > QueuedThreadPool.java:626) > at java.lang.Thread.run(Thread.java:745) > > "NiFi Web Server-21" Id=21 TIMED_WAITING on java.util.concurrent.locks. > AbstractQueuedSynchronizer$ConditionObject@1debbe8b > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at org.eclipse.jetty.util.BlockingArrayQueue.poll( > BlockingArrayQueue.java:392) > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll( > QueuedThreadPool.java:563) > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800( > QueuedThreadPool.java:48) > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( > QueuedThreadPool.java:626) > at java.lang.Thread.run(Thread.java:745) > > "org.eclipse.jetty.server.session.HashSessionManager@2a738d47Timer" Id=59 > TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@3166db9a > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "org.eclipse.jetty.server.session.HashSessionManager@35b38986Timer" Id=55 > TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@56748f8a > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "org.eclipse.jetty.server.session.HashSessionManager@469a7575Timer" Id=26 > TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@76c4adba > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "org.eclipse.jetty.server.session.HashSessionManager@4c19d42eTimer" Id=24 > TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@4e0808e > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "org.eclipse.jetty.server.session.HashSessionManager@664632e9Timer" Id=23 > TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@15b287a4 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "org.eclipse.jetty.server.session.HashSessionManager@69f2cb04Timer" Id=27 > TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@37e4d4f2 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "org.eclipse.jetty.server.session.HashSessionManager@7c369270Timer" Id=22 > TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@46c851d5 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "org.eclipse.jetty.server.session.HashSessionManager@fd413fbTimer" Id=25 > TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@5d00cf08 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "pool-1-thread-1" Id=71 RUNNABLE > at java.net.Socket.close(Socket.java:1491) > - waiting on java.net.Socket@60de3224 > at org.apache.nifi.BootstrapListener$Listener$1. > run(BootstrapListener.java:203) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Number of Locked Synchronizers: 1 > - java.util.concurrent.ThreadPoolExecutor$Worker@701e624 > > "pool-1-thread-2" Id=72 RUNNABLE > at sun.management.ThreadImpl.dumpThreads0(Native Method) > at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454) > at org.apache.nifi.BootstrapListener.writeDump( > BootstrapListener.java:221) > at org.apache.nifi.BootstrapListener.access$500( > BootstrapListener.java:49) > at org.apache.nifi.BootstrapListener$Listener$1. > run(BootstrapListener.java:196) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Number of Locked Synchronizers: 1 > - java.util.concurrent.ThreadPoolExecutor$Worker@420378a0 > > "pool-8-thread-1" Id=51 TIMED_WAITING on java.util.concurrent.locks. > AbstractQueuedSynchronizer$ConditionObject@54250639 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Provenance Maintenance Thread-1" Id=34 TIMED_WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@4790ce2a > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Provenance Maintenance Thread-2" Id=35 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@4790ce2a > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Provenance Maintenance Thread-3" Id=36 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@4790ce2a > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Reference Handler" Id=2 WAITING on java.lang.ref.Reference$Lock@283f30be > at java.lang.Object.wait(Native Method) > at java.lang.Object.wait(Object.java:502) > at java.lang.ref.Reference.tryHandlePending(Reference.java:191) > at java.lang.ref.Reference$ReferenceHandler.run( > Reference.java:153) > > "Signal Dispatcher" Id=5 RUNNABLE > > "Timer-Driven Process Thread-1" Id=48 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-10" Id=70 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-2" Id=53 TIMED_WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-3" Id=54 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-4" Id=62 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-5" Id=64 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-6" Id=65 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-7" Id=67 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-8" Id=68 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Timer-Driven Process Thread-9" Id=69 WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@705bd1a1 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport. > java:175) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > "Write-Ahead Local State Provider Maintenance" Id=41 TIMED_WAITING on > java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject@55071925 > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.parkNanos( > LockSupport.java:215) > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ > ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) > at java.util.concurrent.ThreadPoolExecutor.getTask( > ThreadPoolExecutor.java:1067) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1127) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > > On 13 February 2017 at 17:43, Chico Qi <[email protected]> wrote: > >> Hi all, >> >> I am struggling in an infinite loop. I want to install a new NiFi on the >> same machine because the old NiFi was corrupted. But even though I install >> from an original file from NiFi website. There are always same logs as >> bellow. I guess some file was locked and the new NiFi are trying to >> recover from the error status. >> >> >> 2017-02-13 11:32:46,255 INFO [main] o.a.n.c.repository.FileSystemRepository >> Maximum Threshold for Container default set to 4346167787 >> <(434)%20616-7787> bytes; if volume exceeds this size, archived data >> will be deleted until it no longer exceeds this size >> 2017-02-13 11:32:46,256 INFO [main] o.a.n.c.repository.FileSystemRepository >> Initializing FileSystemRepository with 'Always Sync' set to false >> 2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog >> org.wali.MinimalLockingWriteAheadLog@4e8b36af finished recovering >> records. Performing Checkpoint to ensure proper state of Partitions before >> updates >> 2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog >> Successfully recovered 0 records in 6 milliseconds >> 2017-02-13 11:32:46,372 INFO [main] org.wali.MinimalLockingWriteAheadLog >> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 >> Records and 0 Swap Files in 5 milliseconds (Stop-the-world time = 3 >> milliseconds, Clear Edit Logs time = 1 millis), max Transaction ID -1 >> 2017-02-13 11:32:46,398 INFO [main] o.apache.nifi.controller.FlowController >> Not enabling RAW Socket Site-to-Site functionality because >> nifi.remote.input.socket.port is not set >> 2017-02-13 11:32:46,418 INFO [main] >> o.a.n.w.c.ApplicationStartupContextListener >> Starting Flow Controller... >> 2017-02-13 11:32:46,458 INFO [main] o.apache.nifi.controller.FlowController >> Successfully synchronized controller with proposed flow >> 2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog >> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 finished recovering >> records. Performing Checkpoint to ensure proper state of Partitions before >> updates >> 2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog >> Successfully recovered 0 records in 184 milliseconds >> 2017-02-13 11:32:46,879 INFO [main] org.wali.MinimalLockingWriteAheadLog >> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 >> Records and 0 Swap Files in 43 milliseconds (Stop-the-world time = 26 >> milliseconds, Clear Edit Logs time = 16 millis), max Transaction ID -1 >> 2017-02-13 11:32:46,879 INFO [main] o.a.n.c.r.WriteAheadFlowFileRepository >> Successfully restored 0 FlowFiles >> 2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController >> Starting 0 processors/ports/funnels >> 2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController >> Started 0 Remote Group Ports transmitting >> 2017-02-13 11:32:46,896 INFO [main] >> o.a.n.w.c.ApplicationStartupContextListener >> Flow Controller started successfully. >> 2017-02-13 11:32:46,903 INFO [main] o.e.jetty.server.handler.ContextHandler >> Started o.e.j.w.WebAppContext@48614fb3{/nifi-api,file:///dev/shm/nif >> i-1.1.1/work/jetty/nifi-web-api-1.1.1.war/webapp/,AVAILABL >> E}{./work/nar/framework/nifi-framework-nar-1.1.1.nar- >> unpacked/META-INF/bundled-dependencies/nifi-web-api-1.1.1.war} >> 2017-02-13 11:32:47,457 INFO [main] /nifi-content-viewer No Spring >> WebApplicationInitializer types detected on classpath >> 2017-02-13 11:32:47,463 INFO [main] o.e.jetty.server.handler.ContextHandler >> Started o.e.j.w.WebAppContext@439b0198{/nifi-content-viewer,file:/// >> dev/shm/nifi-1.1.1/work/jetty/nifi-web-content-viewer-1.1.1. >> war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-n >> ar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web >> -content-viewer-1.1.1.war} >> 2017-02-13 11:32:47,464 INFO [main] o.e.jetty.server.handler.ContextHandler >> Started o.e.j.s.h.ContextHandler@29088d3d{/nifi-docs,null,AVAILABLE} >> 2017-02-13 11:32:47,499 INFO [main] /nifi-docs No Spring >> WebApplicationInitializer types detected on classpath >> 2017-02-13 11:32:47,524 INFO [main] o.e.jetty.server.handler.ContextHandler >> Started o.e.j.w.WebAppContext@3284de45{/nifi-docs,file:///dev/shm/ni >> fi-1.1.1/work/jetty/nifi-web-docs-1.1.1.war/webapp/,AVAILAB >> LE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar- >> unpacked/META-INF/bundled-dependencies/nifi-web-docs-1.1.1.war} >> 2017-02-13 11:32:47,585 INFO [main] / No Spring WebApplicationInitializer >> types detected on classpath >> 2017-02-13 11:32:47,590 INFO [main] o.e.jetty.server.handler.ContextHandler >> Started o.e.j.w.WebAppContext@7962a364{/,file:///dev/shm/nifi-1.1.1/ >> work/jetty/nifi-web-error-1.1.1.war/webapp/,AVAILABLE}{./wor >> k/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META- >> INF/bundled-dependencies/nifi-web-error-1.1.1.war} >> 2017-02-13 11:32:47,605 INFO [main] o.eclipse.jetty.server.AbstractConnector >> Started ServerConnector@30ce78e3{HTTP/1.1,[http/1.1]}{172.23.51.151:8080} >> 2017-02-13 11:32:47,605 INFO [main] org.eclipse.jetty.server.Server >> Started @201871ms >> 2017-02-13 11:32:48,081 INFO [main] org.apache.nifi.web.server.JettyServer >> NiFi has started. The UI is available at the following URLs: >> 2017-02-13 11:32:48,082 INFO [main] org.apache.nifi.web.server.JettyServer >> http://172.23.51.151:8080/nifi >> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.BootstrapListener >> Successfully initiated communication with Bootstrap >> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.NiFi Controller >> initialization took 157612801054 nanoseconds. >> 2017-02-13 11:34:46,376 INFO [Write-Ahead Local State Provider >> Maintenance] org.wali.MinimalLockingWriteAheadLog >> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 >> Records and 0 Swap Files in 3 milliseconds (Stop-the-world time = 0 >> milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1 >> 2017-02-13 11:34:46,880 INFO [pool-8-thread-1] >> o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile >> Repository >> 2017-02-13 11:34:46,915 INFO [pool-8-thread-1] >> org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAh >> eadLog@6c0bf8f4 checkpointed with 0 Records and 0 Swap Files in 34 >> milliseconds (Stop-the-world time = 21 milliseconds, Clear Edit Logs time = >> 10 millis), max Transaction ID -1 >> 2017-02-13 11:34:46,915 INFO [pool-8-thread-1] >> o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed >> FlowFile Repository with 0 records in 34 milliseconds >> 2017-02-13 11:36:46,378 INFO [Write-Ahead Local State Provider >> Maintenance] org.wali.MinimalLockingWriteAheadLog >> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 >> Records and 0 Swap Files in 1 milliseconds (Stop-the-world time = 1 >> milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1 >> 2017-02-13 11:36:46,915 INFO [pool-8-thread-1] >> o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile >> Repository >> 2017-02-13 11:36:46,947 INFO [pool-8-thread-1] >> org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAh >> eadLog@6c0bf8f4 checkpointed with 0 Records and 0 Swap Files in 31 >> milliseconds (Stop-the-world time = 21 milliseconds, Clear Edit Logs time = >> 9 millis), max Transaction ID -1 >> 2017-02-13 11:36:46,947 INFO [pool-8-thread-1] >> o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed >> FlowFile Repository with 0 records in 31 milliseconds >> >> Thank you. >> >> Cheers, >> Chico >> > >
