SamuelBoerlin commented on issue #3488: URL: https://github.com/apache/jena/issues/3488#issuecomment-3745370415
Hi @afs , sorry for the long delay. Our Fuseki instance has been running for a while now with the changes you've suggested, i.e.: - running with more heap: `-Xmx2G` - removing `--add-modules=jdk.incubator.vector` Unfortunately I'm still observing the same behaviour. Compaction gets stuck and then remains stuck until the next time Fuseki is restarted. These are memory metrics of the Fuseki process and container and various event annotations: <img width="1709" height="537" alt="Image" src="https://github.com/user-attachments/assets/f628f021-d62a-4750-b6d4-265b95830014"; /> The vertical colored dashed lines denote the following events: - purple: Fuseki was restarted - green: Compaction finished successfully (it normally finishes in ~45min.) - orange: Compaction did not finish after 12h of starting - red: Compaction request was immediately rejected I didn't annotate the start of compactions because of clutter, but we start a compaction every night at 4AM. What's interesting: - When compaction works, heap usage remains low. Once it's stuck, it seems to climb quite steadily. - Once compaction is stuck, it remains stuck and subsequent compaction requests either never finish or the compaction requests to `/$/compact/{name}?deleteOld=true` are immediately rejected: `HTTP/1.1 400 Bad Request | Async task request rejected - exceeds the limit of 4 tasks` - This problem happens *almost* exclusively on our production server, but does also rarely happen on our staging server, which uses the same data and same container image. Where they differ is that the staging server has *less* memory available, and different incoming traffic/requests. We have many other smaller instances using the same container image but different and much, much less data, where I haven't observed this issue yet. While I haven't seen any error logs, there are several warning logs, though I don't really see any obvious correlation between warnings and compaction failing. Here are some excerpts from various warnings in the above diagram's timeframe: ``` 2026-01-09T09:35:28,826 WARN writeError: status=500, message=java.io.IOException: content-length 2868 != 0 written, response=ErrorResponse@1627eecb{500,POST@21e0ada1 http://db:3030/dsp-repo/query HTTP/1.1} java.io.IOException: content-length 2868 != 0 written at org.eclipse.jetty.server.internal.HttpChannelState$ChannelCallback.succeeded(HttpChannelState.java:1564) at org.eclipse.jetty.ee10.servlet.ServletChannel.onCompleted(ServletChannel.java:764) at org.eclipse.jetty.ee10.servlet.ServletChannel.handle(ServletChannel.java:430) at org.eclipse.jetty.ee10.servlet.ServletHandler.handle(ServletHandler.java:470) at org.eclipse.jetty.ee10.servlet.SessionHandler.handle(SessionHandler.java:717) at org.eclipse.jetty.server.handler.ContextHandler.handle(ContextHandler.java:1071) at org.eclipse.jetty.server.Server.handle(Server.java:182) at org.eclipse.jetty.server.internal.HttpChannelState$HandlerInvoker.run(HttpChannelState.java:678) at org.eclipse.jetty.server.internal.HttpConnection.onFillable(HttpConnection.java:416) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:322) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:99) at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:480) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:443) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:293) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:201) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:311) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:981) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1211) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1166) at java.base/java.lang.Thread.run(Unknown Source) 2026-01-08T06:36:17,123 WARN Open iterator [execCxt@1241939988]: QueryIterSingleton/674997725 2026-01-08T06:36:17,123 WARN Open iterator [execCxt@643524451]: QueryIterSingleton/674997721 2026-01-08T06:36:17,157 WARN Open iterator [execCxt@1241939988]: QueryIterFilterExpr/674997726 2026-01-08T06:36:17,157 WARN Open iterator [execCxt@1241939988]: QueryIterAbortable/674997727 2026-01-08T06:36:17,158 WARN Open iterator [execCxt@1241939988]: QueryIterGraph/674997728 2026-01-08T06:36:17,159 WARN Open iterator [execCxt@643524451]: QueryIterFilterExpr/674997722 2026-01-08T06:36:17,159 WARN Open iterator [execCxt@643524451]: QueryIterAbortable/674997723 2026-01-08T06:36:17,159 WARN Open iterator [execCxt@643524451]: QueryIterGraph/674997724 2026-01-07T18:32:09,798 WARN [58384] ActionErrorException with cause org.apache.jena.fuseki.servlets.ActionErrorException: Exception while writing the response model: org.eclipse.jetty.io.EofException at org.apache.jena.fuseki.servlets.ServletOps.actionErrorException(ServletOps.java:274) at org.apache.jena.fuseki.servlets.ServletOps.errorOccurred(ServletOps.java:269) at org.apache.jena.fuseki.servlets.Responses$ResponseGraph.doResponseDataset$(Responses.java:371) at org.apache.jena.fuseki.servlets.Responses.doResponseDataset(Responses.java:309) at org.apache.jena.fuseki.servlets.SPARQLQueryProcessor.sendResults(SPARQLQueryProcessor.java:443) at org.apache.jena.fuseki.servlets.SPARQLQueryProcessor.execute(SPARQLQueryProcessor.java:286) at org.apache.jena.fuseki.servlets.SPARQLQueryProcessor.executeWithParameter(SPARQLQueryProcessor.java:224) at org.apache.jena.fuseki.servlets.SPARQLQueryProcessor.execute(SPARQLQueryProcessor.java:209) at org.apache.jena.fuseki.servlets.ActionService.executeLifecycle(ActionService.java:58) at org.apache.jena.fuseki.servlets.SPARQLQueryProcessor.execPost(SPARQLQueryProcessor.java:84) at org.apache.jena.fuseki.servlets.ActionProcessor.process(ActionProcessor.java:34) at org.apache.jena.fuseki.servlets.ActionBase.process(ActionBase.java:54) at org.apache.jena.fuseki.servlets.ActionExecLib.execActionSub(ActionExecLib.java:124) at org.apache.jena.fuseki.servlets.ActionExecLib.execAction(ActionExecLib.java:98) at org.apache.jena.fuseki.server.Dispatcher.dispatchAction(Dispatcher.java:239) at org.apache.jena.fuseki.server.Dispatcher.process(Dispatcher.java:229) at org.apache.jena.fuseki.server.Dispatcher.dispatch(Dispatcher.java:147) at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:49) at org.eclipse.jetty.ee10.servlet.FilterHolder.doFilter(FilterHolder.java:205) at org.eclipse.jetty.ee10.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1594) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:65) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:109) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:138) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:156) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:70) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:109) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:138) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:156) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:70) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:109) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:138) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:156) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:70) at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:463) at org.apache.shiro.web.servlet.AbstractShiroFilter.lambda$doFilterInternal$0(AbstractShiroFilter.java:378) at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:91) at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:84) at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:389) at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:376) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:156) at org.eclipse.jetty.ee10.servlet.FilterHolder.doFilter(FilterHolder.java:205) at org.eclipse.jetty.ee10.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1594) at org.apache.jena.fuseki.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:351) at org.apache.jena.fuseki.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:304) at org.eclipse.jetty.ee10.servlet.FilterHolder.doFilter(FilterHolder.java:205) at org.eclipse.jetty.ee10.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1594) at org.eclipse.jetty.ee10.servlet.ServletHandler$MappedServlet.handle(ServletHandler.java:1555) at org.eclipse.jetty.ee10.servlet.ServletChannel.dispatch(ServletChannel.java:823) at org.eclipse.jetty.ee10.servlet.ServletChannel.handle(ServletChannel.java:440) at org.eclipse.jetty.ee10.servlet.ServletHandler.handle(ServletHandler.java:470) at org.eclipse.jetty.ee10.servlet.SessionHandler.handle(SessionHandler.java:717) at org.eclipse.jetty.server.handler.ContextHandler.handle(ContextHandler.java:1071) at org.eclipse.jetty.server.Server.handle(Server.java:182) at org.eclipse.jetty.server.internal.HttpChannelState$HandlerInvoker.run(HttpChannelState.java:678) at org.eclipse.jetty.server.internal.HttpConnection.onFillable(HttpConnection.java:416) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:322) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:99) at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:480) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:443) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:293) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:201) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:311) 2026-01-07T08:15:12,734 WARN java.util.concurrent.CompletionException: org.eclipse.jetty.server.internal.HttpConnection$HttpEofException: Early EOF 2026-01-07T08:15:12,737 WARN [133] RC = 500 : 400: Unable to parse form content org.eclipse.jetty.http.BadMessageException: 400: Unable to parse form content at org.eclipse.jetty.ee10.servlet.ServletApiRequest.extractContentParameters(ServletApiRequest.java:1008) at org.eclipse.jetty.ee10.servlet.ServletApiRequest.getParameters(ServletApiRequest.java:963) at org.eclipse.jetty.ee10.servlet.ServletApiRequest.getParameterValues(ServletApiRequest.java:944) at jakarta.servlet.ServletRequestWrapper.getParameterValues(ServletRequestWrapper.java:185) at org.apache.jena.fuseki.servlets.SPARQLProtocol.countParamOccurences(SPARQLProtocol.java:118) at org.apache.jena.fuseki.servlets.SPARQLQueryProcessor.validateParams(SPARQLQueryProcessor.java:169) at org.apache.jena.fuseki.servlets.SPARQLQueryProcessor.validate(SPARQLQueryProcessor.java:130) at org.apache.jena.fuseki.servlets.ActionService.executeLifecycle(ActionService.java:49) at org.apache.jena.fuseki.servlets.SPARQLQueryProcessor.execPost(SPARQLQueryProcessor.java:84) at org.apache.jena.fuseki.servlets.ActionProcessor.process(ActionProcessor.java:34) at org.apache.jena.fuseki.servlets.ActionBase.process(ActionBase.java:54) at org.apache.jena.fuseki.servlets.ActionExecLib.execActionSub(ActionExecLib.java:124) at org.apache.jena.fuseki.servlets.ActionExecLib.execAction(ActionExecLib.java:98) at org.apache.jena.fuseki.server.Dispatcher.dispatchAction(Dispatcher.java:239) at org.apache.jena.fuseki.server.Dispatcher.process(Dispatcher.java:229) at org.apache.jena.fuseki.server.Dispatcher.dispatch(Dispatcher.java:147) at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:49) at org.eclipse.jetty.ee10.servlet.FilterHolder.doFilter(FilterHolder.java:205) at org.eclipse.jetty.ee10.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1594) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:65) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:109) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:138) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:156) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:70) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:109) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:138) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:156) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:70) at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:109) at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:138) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:156) at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:70) at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:463) at org.apache.shiro.web.servlet.AbstractShiroFilter.lambda$doFilterInternal$0(AbstractShiroFilter.java:378) at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:91) at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:84) at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:389) at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:376) at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:156) at org.eclipse.jetty.ee10.servlet.FilterHolder.doFilter(FilterHolder.java:205) at org.eclipse.jetty.ee10.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1594) at org.apache.jena.fuseki.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:351) at org.apache.jena.fuseki.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:304) at org.eclipse.jetty.ee10.servlet.FilterHolder.doFilter(FilterHolder.java:205) at org.eclipse.jetty.ee10.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1594) at org.eclipse.jetty.ee10.servlet.ServletHandler$MappedServlet.handle(ServletHandler.java:1555) at org.eclipse.jetty.ee10.servlet.ServletChannel.dispatch(ServletChannel.java:823) at org.eclipse.jetty.ee10.servlet.ServletChannel.handle(ServletChannel.java:440) at org.eclipse.jetty.ee10.servlet.ServletHandler.handle(ServletHandler.java:470) at org.eclipse.jetty.ee10.servlet.SessionHandler.handle(SessionHandler.java:717) at org.eclipse.jetty.server.handler.ContextHandler.handle(ContextHandler.java:1071) at org.eclipse.jetty.server.Server.handle(Server.java:182) at org.eclipse.jetty.server.internal.HttpChannelState$HandlerInvoker.run(HttpChannelState.java:678) at org.eclipse.jetty.server.internal.HttpConnection.onFillable(HttpConnection.java:416) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:322) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:99) at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:480) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:443) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:293) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:201) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:311) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:981) ``` And this is thread dump of Fuseki which shows that 4 compaction threads are currently waiting/blocked on a lock/signal, seemingly indefinitely: ``` root@cc68311f191f:/jena-fuseki# /usr/lib/jvm/java-21-openjdk-amd64/bin/jstack 7 2026-01-13 17:40:17 Full thread dump OpenJDK 64-Bit Server VM (21.0.8+9-LTS mixed mode, sharing): Threads class SMR info: _java_thread_list=0x00007f06b4002030, length=38, elements={ 0x00007f074402aec0, 0x00007f07441cd6e0, 0x00007f07441ced60, 0x00007f07441d04e0, 0x00007f07441d1b10, 0x00007f07441d30a0, 0x00007f07441d4c50, 0x00007f07441d6300, 0x00007f07441df820, 0x00007f07441e2b70, 0x00007f07448f63c0, 0x00007f074514b0c0, 0x00007f0745153710, 0x00007f064001efd0, 0x00007f06044b0b40, 0x00007f047400ac00, 0x00007f06101564e0, 0x00007f060c1ee440, 0x00007f060c0c5260, 0x00007f069425ebf0, 0x00007f04d80b38b0, 0x00007edc98008f80, 0x00007edc98007e80, 0x00007f05a41884c0, 0x00007f04bc50fff0, 0x00007f04bc5b8760, 0x00007f04bc5b8e60, 0x00007f06401370c0, 0x00007f06401481c0, 0x00007f0480142620, 0x00007f04800667c0, 0x00007f04bc510730, 0x00007f04bc510e30, 0x00007f060c34f2c0, 0x00007f047453caa0, 0x00007f047400c5b0, 0x00007f047466ad50, 0x00007f06b4000ff0 } "main" #1 [18] prio=5 os_prio=0 cpu=2056.17ms elapsed=548836.86s tid=0x00007f074402aec0 nid=18 waiting on condition [0x00007f074998f000] java.lang.Thread.State: WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806e4af8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block([email protected]/Unknown Source) at java.util.concurrent.ForkJoinPool.unmanagedBlock([email protected]/Unknown Source) at java.util.concurrent.ForkJoinPool.managedBlock([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await([email protected]/Unknown Source) at org.eclipse.jetty.util.thread.AutoLock$WithCondition.await(AutoLock.java:151) at org.eclipse.jetty.util.thread.QueuedThreadPool.join(QueuedThreadPool.java:834) at org.eclipse.jetty.server.Server.join(Server.java:712) at org.apache.jena.fuseki.main.FusekiServer.join(FusekiServer.java:425) at org.apache.jena.fuseki.main.cmds.FusekiMain.execStartServer(FusekiMain.java:681) at org.apache.jena.fuseki.main.cmds.FusekiMain.exec(FusekiMain.java:648) at org.apache.jena.cmd.CmdMain.mainMethod(CmdMain.java:86) at org.apache.jena.cmd.CmdMain.mainRun(CmdMain.java:55) at org.apache.jena.cmd.CmdMain.mainRun(CmdMain.java:43) at org.apache.jena.fuseki.main.cmds.FusekiMain.run(FusekiMain.java:160) at org.apache.jena.fuseki.mod.FusekiServerRunner.main(FusekiServerRunner.java:45) at org.apache.jena.fuseki.main.cmds.FusekiServerCmd.main(FusekiServerCmd.java:48) "Reference Handler" #9 [26] daemon prio=10 os_prio=0 cpu=141581.70ms elapsed=548836.75s tid=0x00007f07441cd6e0 nid=26 waiting on condition [0x00007f071d60e000] java.lang.Thread.State: RUNNABLE at java.lang.ref.Reference.waitForReferencePendingList([email protected]/Native Method) at java.lang.ref.Reference.processPendingReferences([email protected]/Unknown Source) at java.lang.ref.Reference$ReferenceHandler.run([email protected]/Unknown Source) "Finalizer" #10 [27] daemon prio=8 os_prio=0 cpu=0.21ms elapsed=548836.75s tid=0x00007f07441ced60 nid=27 in Object.wait() [0x00007f071d50e000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait0([email protected]/Native Method) - waiting on <0x000000008d6d4ff8> (a java.lang.ref.NativeReferenceQueue$Lock) at java.lang.Object.wait([email protected]/Unknown Source) at java.lang.Object.wait([email protected]/Unknown Source) at java.lang.ref.NativeReferenceQueue.await([email protected]/Unknown Source) at java.lang.ref.ReferenceQueue.remove0([email protected]/Unknown Source) at java.lang.ref.NativeReferenceQueue.remove([email protected]/Unknown Source) - locked <0x000000008d6d4ff8> (a java.lang.ref.NativeReferenceQueue$Lock) at java.lang.ref.Finalizer$FinalizerThread.run([email protected]/Unknown Source) "Signal Dispatcher" #11 [28] daemon prio=9 os_prio=0 cpu=0.55ms elapsed=548836.75s tid=0x00007f07441d04e0 nid=28 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Service Thread" #12 [29] daemon prio=9 os_prio=0 cpu=1341.17ms elapsed=548836.75s tid=0x00007f07441d1b10 nid=29 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Monitor Deflation Thread" #13 [30] daemon prio=9 os_prio=0 cpu=61864.11ms elapsed=548836.75s tid=0x00007f07441d30a0 nid=30 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE "C2 CompilerThread0" #14 [31] daemon prio=9 os_prio=0 cpu=199783.45ms elapsed=548836.75s tid=0x00007f07441d4c50 nid=31 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE No compile task "C1 CompilerThread0" #22 [32] daemon prio=9 os_prio=0 cpu=16577.04ms elapsed=548836.75s tid=0x00007f07441d6300 nid=32 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE No compile task "Notification Thread" #26 [33] daemon prio=9 os_prio=0 cpu=15188.67ms elapsed=548836.74s tid=0x00007f07441df820 nid=33 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Common-Cleaner" #27 [34] daemon prio=8 os_prio=0 cpu=628.68ms elapsed=548836.74s tid=0x00007f07441e2b70 nid=34 waiting on condition [0x00007f071ce0e000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x000000008d6d5e60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await([email protected]/Unknown Source) at java.lang.ref.ReferenceQueue.await([email protected]/Unknown Source) at java.lang.ref.ReferenceQueue.remove0([email protected]/Unknown Source) at java.lang.ref.ReferenceQueue.remove([email protected]/Unknown Source) at jdk.internal.ref.CleanerImpl.run([email protected]/Unknown Source) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) at jdk.internal.misc.InnocuousThread.run([email protected]/Unknown Source) "ReferenceQueueConsumer" #34 [45] daemon prio=8 os_prio=0 cpu=0.71ms elapsed=548835.37s tid=0x00007f07448f63c0 nid=45 waiting on condition [0x00007f073deb8000] java.lang.Thread.State: WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x0000000081101770> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block([email protected]/Unknown Source) at java.util.concurrent.ForkJoinPool.unmanagedBlock([email protected]/Unknown Source) at java.util.concurrent.ForkJoinPool.managedBlock([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await([email protected]/Unknown Source) at java.lang.ref.ReferenceQueue.await([email protected]/Unknown Source) at java.lang.ref.ReferenceQueue.remove0([email protected]/Unknown Source) at java.lang.ref.ReferenceQueue.remove([email protected]/Unknown Source) at org.apache.sis.system.ReferenceQueueConsumer.run(ReferenceQueueConsumer.java:111) "qtp1418609585-46-acceptor-0@d224095-ServerConnector@3e5bf41{HTTP/1.1, (http/1.1)}{0.0.0.0:3030}" #46 [65] prio=3 os_prio=0 cpu=11788.53ms elapsed=548833.58s tid=0x00007f074514b0c0 nid=65 runnable [0x00007f06ca1a7000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.Net.accept([email protected]/Native Method) at sun.nio.ch.ServerSocketChannelImpl.implAccept([email protected]/Unknown Source) at sun.nio.ch.ServerSocketChannelImpl.accept([email protected]/Unknown Source) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:389) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:698) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:981) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1211) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1166) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "Scheduler-754853679-1" #47 [66] prio=5 os_prio=0 cpu=5381.44ms elapsed=548833.57s tid=0x00007f0745153710 nid=66 waiting on condition [0x00007f06ca0a7000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806edbe0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take([email protected]/Unknown Source) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor.getTask([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/Unknown Source) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "alarm-clock-1" #50 [129] daemon prio=5 os_prio=0 cpu=18352.00ms elapsed=548752.79s tid=0x00007f064001efd0 nid=129 waiting on condition [0x00007f071cd0e000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x0000000081e50de8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take([email protected]/Unknown Source) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor.getTask([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/Unknown Source) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "pool-5-thread-1" #946 [47212] prio=5 os_prio=0 cpu=2411074.10ms elapsed=481216.78s tid=0x00007f06044b0b40 nid=47212 waiting on condition [0x00007f06c80fe000] java.lang.Thread.State: WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x0000000091c255e8> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync) at java.util.concurrent.locks.LockSupport.park([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire([email protected]/Unknown Source) at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock([email protected]/Unknown Source) at org.apache.jena.dboe.transaction.txn.TransactionCoordinator.startExclusiveMode(TransactionCoordinator.java:540) at org.apache.jena.dboe.transaction.txn.TransactionCoordinator.startExclusiveMode(TransactionCoordinator.java:506) at org.apache.jena.tdb2.sys.DatabaseOps.compaction(DatabaseOps.java:476) at org.apache.jena.tdb2.sys.DatabaseOps.compact(DatabaseOps.java:359) - locked <0x0000000081e30b90> (a java.lang.Object) at org.apache.jena.tdb2.DatabaseMgr.compact(DatabaseMgr.java:92) at org.apache.jena.fuseki.ctl.ActionCompact$CompactTask.run(ActionCompact.java:110) at org.apache.jena.fuseki.async.AsyncPool.lambda$submit$0(AsyncPool.java:66) at org.apache.jena.fuseki.async.AsyncPool$$Lambda/0x00007f06d0383400.call(Unknown Source) at org.apache.jena.fuseki.async.AsyncTask.call(AsyncTask.java:100) at java.util.concurrent.FutureTask.run([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/Unknown Source) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "pool-5-thread-2" #1983 [105773] prio=5 os_prio=0 cpu=13013.14ms elapsed=394817.00s tid=0x00007f047400ac00 nid=105773 waiting for monitor entry [0x00007f06187fe000] java.lang.Thread.State: BLOCKED (on object monitor) at org.apache.jena.tdb2.sys.DatabaseOps.compact(DatabaseOps.java:322) - waiting to lock <0x0000000081e30b90> (a java.lang.Object) at org.apache.jena.tdb2.DatabaseMgr.compact(DatabaseMgr.java:92) at org.apache.jena.fuseki.ctl.ActionCompact$CompactTask.run(ActionCompact.java:110) at org.apache.jena.fuseki.async.AsyncPool.lambda$submit$0(AsyncPool.java:66) at org.apache.jena.fuseki.async.AsyncPool$$Lambda/0x00007f06d0383400.call(Unknown Source) at org.apache.jena.fuseki.async.AsyncTask.call(AsyncTask.java:100) at java.util.concurrent.FutureTask.run([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/Unknown Source) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "pool-5-thread-3" #2986 [164175] prio=5 os_prio=0 cpu=0.60ms elapsed=308417.10s tid=0x00007f06101564e0 nid=164175 waiting for monitor entry [0x00007f06c84fe000] java.lang.Thread.State: BLOCKED (on object monitor) at org.apache.jena.tdb2.sys.DatabaseOps.compact(DatabaseOps.java:322) - waiting to lock <0x0000000081e30b90> (a java.lang.Object) at org.apache.jena.tdb2.DatabaseMgr.compact(DatabaseMgr.java:92) at org.apache.jena.fuseki.ctl.ActionCompact$CompactTask.run(ActionCompact.java:110) at org.apache.jena.fuseki.async.AsyncPool.lambda$submit$0(AsyncPool.java:66) at org.apache.jena.fuseki.async.AsyncPool$$Lambda/0x00007f06d0383400.call(Unknown Source) at org.apache.jena.fuseki.async.AsyncTask.call(AsyncTask.java:100) at java.util.concurrent.FutureTask.run([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/Unknown Source) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "pool-5-thread-4" #4013 [222727] prio=5 os_prio=0 cpu=0.44ms elapsed=222017.34s tid=0x00007f060c1ee440 nid=222727 waiting for monitor entry [0x00007f06c83fe000] java.lang.Thread.State: BLOCKED (on object monitor) at org.apache.jena.tdb2.sys.DatabaseOps.compact(DatabaseOps.java:322) - waiting to lock <0x0000000081e30b90> (a java.lang.Object) at org.apache.jena.tdb2.DatabaseMgr.compact(DatabaseMgr.java:92) at org.apache.jena.fuseki.ctl.ActionCompact$CompactTask.run(ActionCompact.java:110) at org.apache.jena.fuseki.async.AsyncPool.lambda$submit$0(AsyncPool.java:66) at org.apache.jena.fuseki.async.AsyncPool$$Lambda/0x00007f06d0383400.call(Unknown Source) at org.apache.jena.fuseki.async.AsyncTask.call(AsyncTask.java:100) at java.util.concurrent.FutureTask.run([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker([email protected]/Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected]/Unknown Source) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6639" #6639 [372089] prio=5 os_prio=0 cpu=6150.88ms elapsed=1684.21s tid=0x00007f060c0c5260 nid=372089 waiting on condition [0x00007f06186fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6650" #6650 [372579] prio=5 os_prio=0 cpu=4045.92ms elapsed=958.81s tid=0x00007f069425ebf0 nid=372579 waiting on condition [0x00007efcc43fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6651" #6651 [372580] prio=5 os_prio=0 cpu=2972.26ms elapsed=958.81s tid=0x00007f04d80b38b0 nid=372580 waiting on condition [0x00007f06083d8000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6653" #6653 [372582] prio=5 os_prio=0 cpu=2759.78ms elapsed=958.80s tid=0x00007edc98008f80 nid=372582 waiting on condition [0x00007f071c90e000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6655" #6655 [372714] prio=5 os_prio=0 cpu=1267.88ms elapsed=762.53s tid=0x00007edc98007e80 nid=372714 waiting on condition [0x00007f06cabfa000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6656" #6656 [372735] prio=5 os_prio=0 cpu=2429.15ms elapsed=724.79s tid=0x00007f05a41884c0 nid=372735 waiting on condition [0x00007f06084d8000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6658" #6658 [372807] prio=5 os_prio=0 cpu=1108.15ms elapsed=619.72s tid=0x00007f04bc50fff0 nid=372807 waiting on condition [0x00007f06c81fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6659" #6659 [372808] prio=5 os_prio=0 cpu=3249.56ms elapsed=619.72s tid=0x00007f04bc5b8760 nid=372808 waiting on condition [0x00007f06ca4a7000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6660" #6660 [372809] prio=5 os_prio=0 cpu=3788.11ms elapsed=619.72s tid=0x00007f04bc5b8e60 nid=372809 waiting on condition [0x00007f06c9fa7000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6663" #6663 [372812] prio=5 os_prio=0 cpu=1858.96ms elapsed=619.71s tid=0x00007f06401370c0 nid=372812 waiting on condition [0x00007f06086fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6664" #6664 [372813] prio=5 os_prio=0 cpu=2497.67ms elapsed=619.71s tid=0x00007f06401481c0 nid=372813 waiting on condition [0x00007f06185fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6665" #6665 [376904] prio=5 os_prio=0 cpu=1086.94ms elapsed=31.61s tid=0x00007f0480142620 nid=376904 waiting on condition [0x00007f06183fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000cfdcc7f8> (a java.util.concurrent.Semaphore$NonfairSync) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos([email protected]/Unknown Source) at java.util.concurrent.Semaphore.tryAcquire([email protected]/Unknown Source) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.waitForTask(ReservedThreadExecutor.java:351) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:290) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:981) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1211) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1166) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6666" #6666 [376905] prio=5 os_prio=0 cpu=97.81ms elapsed=31.61s tid=0x00007f04800667c0 nid=376905 waiting on condition [0x00007f06082d8000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6667" #6667 [376906] prio=5 os_prio=0 cpu=439.11ms elapsed=31.61s tid=0x00007f04bc510730 nid=376906 waiting on condition [0x00007f06c85fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6668" #6668 [376907] prio=5 os_prio=0 cpu=51.62ms elapsed=31.61s tid=0x00007f04bc510e30 nid=376907 waiting on condition [0x00007f071ca0e000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6669" #6669 [376908] prio=5 os_prio=0 cpu=2.10ms elapsed=31.61s tid=0x00007f060c34f2c0 nid=376908 waiting on condition [0x00007f06ca2a7000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6670" #6670 [376909] prio=5 os_prio=0 cpu=675.68ms elapsed=31.61s tid=0x00007f047453caa0 nid=376909 runnable [0x00007f06087fe000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPoll.wait([email protected]/Native Method) at sun.nio.ch.EPollSelectorImpl.doSelect([email protected]/Unknown Source) at sun.nio.ch.SelectorImpl.lockAndDoSelect([email protected]/Unknown Source) - locked <0x00000000806e09e8> (a sun.nio.ch.Util$2) - locked <0x00000000806e0998> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select([email protected]/Unknown Source) at org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:182) at org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:189) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:614) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:548) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:514) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:258) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:201) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:311) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:981) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1211) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1166) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6671" #6671 [376910] prio=5 os_prio=0 cpu=753.17ms elapsed=31.61s tid=0x00007f047400c5b0 nid=376910 waiting on condition [0x00007f06181fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000cff68e78> (a java.util.concurrent.Semaphore$NonfairSync) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos([email protected]/Unknown Source) at java.util.concurrent.Semaphore.tryAcquire([email protected]/Unknown Source) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.waitForTask(ReservedThreadExecutor.java:351) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:290) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:981) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1211) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1166) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "qtp1418609585-6672" #6672 [376911] prio=5 os_prio=0 cpu=8.63ms elapsed=31.61s tid=0x00007f047466ad50 nid=376911 waiting on condition [0x00007f06184fe000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000806f6df0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos([email protected]/Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos([email protected]/Unknown Source) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:213) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1141) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1158) at java.lang.Thread.runWith([email protected]/Unknown Source) at java.lang.Thread.run([email protected]/Unknown Source) "Attach Listener" #6673 [377030] daemon prio=9 os_prio=0 cpu=0.35ms elapsed=0.10s tid=0x00007f06b4000ff0 nid=377030 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "G1 Conc#2" os_prio=0 cpu=6874832.14ms elapsed=548834.90s tid=0x00007f07200018b0 nid=57 runnable "G1 Conc#1" os_prio=0 cpu=6875129.28ms elapsed=548834.90s tid=0x00007f0720000d90 nid=56 runnable "GC Thread#12" os_prio=0 cpu=214004.21ms elapsed=548835.11s tid=0x00007f06c40192f0 nid=52 runnable "GC Thread#11" os_prio=0 cpu=214796.20ms elapsed=548835.11s tid=0x00007f06c40187a0 nid=51 runnable "GC Thread#10" os_prio=0 cpu=214711.54ms elapsed=548835.11s tid=0x00007f06c4017ca0 nid=50 runnable "GC Thread#9" os_prio=0 cpu=214798.59ms elapsed=548835.12s tid=0x00007f06c40171c0 nid=49 runnable "GC Thread#8" os_prio=0 cpu=214807.70ms elapsed=548835.12s tid=0x00007f06c40168e0 nid=48 runnable "GC Thread#7" os_prio=0 cpu=214610.49ms elapsed=548835.12s tid=0x00007f06c4016080 nid=47 runnable "GC Thread#6" os_prio=0 cpu=214528.59ms elapsed=548835.12s tid=0x00007f06c4014990 nid=46 runnable "GC Thread#5" os_prio=0 cpu=214570.07ms elapsed=548835.96s tid=0x00007f06c400b7b0 nid=44 runnable "GC Thread#4" os_prio=0 cpu=214620.78ms elapsed=548835.96s tid=0x00007f06c400acd0 nid=43 runnable "GC Thread#3" os_prio=0 cpu=214189.25ms elapsed=548835.96s tid=0x00007f06c400a1f0 nid=42 runnable "GC Thread#2" os_prio=0 cpu=214033.19ms elapsed=548835.96s tid=0x00007f06c4009710 nid=41 runnable "GC Thread#1" os_prio=0 cpu=215198.29ms elapsed=548835.96s tid=0x00007f06c4008c30 nid=40 runnable "VM Thread" os_prio=0 cpu=67196.68ms elapsed=548836.76s tid=0x00007f07441c42a0 nid=25 runnable "VM Periodic Task Thread" os_prio=0 cpu=319396.87ms elapsed=548836.77s tid=0x00007f07441b21c0 nid=24 waiting on condition "G1 Service" os_prio=0 cpu=28773.33ms elapsed=548836.84s tid=0x00007f0744198790 nid=23 runnable "G1 Refine#0" os_prio=0 cpu=428302.15ms elapsed=548836.84s tid=0x00007f07441977e0 nid=22 runnable "G1 Conc#0" os_prio=0 cpu=6874433.72ms elapsed=548836.84s tid=0x00007f0744077bb0 nid=21 runnable "G1 Main Marker" os_prio=0 cpu=6413.09ms elapsed=548836.84s tid=0x00007f0744076c10 nid=20 runnable "GC Thread#0" os_prio=0 cpu=215024.83ms elapsed=548836.84s tid=0x00007f07440655e0 nid=19 runnable JNI global refs: 35, weak refs: 0 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
