I think the following thread is the issue. Can anyone please suggest what
can I do to get rid of it?
"qtp417900728-247" prio=10 tid=0x0000000000da1800 nid=0x3de2 runnable
[0x00007dba38d51000]
java.lang.Thread.State: RUNNABLE
at
org.neo4j.kernel.impl.cache.AutoLoadingCache.get(AutoLoadingCache.java:69)
at
org.neo4j.kernel.impl.core.NodeManager.getRelationshipForProxy(NodeManager.java:544)
at
org.neo4j.kernel.InternalAbstractGraphDatabase$6.lookupRelationship(InternalAbstractGraphDatabase.java:831)
at
org.neo4j.kernel.impl.core.RelationshipProxy.getOtherNode(RelationshipProxy.java:108)
at
org.neo4j.graphalgo.impl.path.ShortestPath$DirectionData.fetchNextOrNull(ShortestPath.java:336)
at
org.neo4j.graphalgo.impl.path.ShortestPath$DirectionData.fetchNextOrNull(ShortestPath.java:260)
at
org.neo4j.helpers.collection.PrefetchingIterator.hasNext(PrefetchingIterator.java:55)
at
org.neo4j.graphalgo.impl.path.ShortestPath.internalPaths(ShortestPath.java:156)
at
org.neo4j.graphalgo.impl.path.ShortestPath.findSinglePath(ShortestPath.java:132)
at
org.neo4j.cypher.internal.compiler.v2_0.commands.expressions.SingleShortestPathStrategy.findResult(ShortestPathExpression.scala:93)
at
org.neo4j.cypher.internal.compiler.v2_0.commands.expressions.SingleShortestPathStrategy.findResult(ShortestPathExpression.scala:90)
at
org.neo4j.cypher.internal.compiler.v2_0.commands.expressions.ShortestPathExpression.getMatches(ShortestPathExpression.scala:48)
at
org.neo4j.cypher.internal.compiler.v2_0.commands.expressions.ShortestPathExpression.apply(ShortestPathExpression.scala:41)
at
org.neo4j.cypher.internal.compiler.v2_0.pipes.ShortestPathPipe$$anonfun$internalCreateResults$1.apply(ShortestPathPipe.scala:37)
at
org.neo4j.cypher.internal.compiler.v2_0.pipes.ShortestPathPipe$$anonfun$internalCreateResults$1.apply(ShortestPathPipe.scala:36)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at
org.neo4j.cypher.internal.compiler.v2_0.ClosingIterator$$anonfun$hasNext$1.apply$mcZ$sp(ClosingIterator.scala:38)
at
org.neo4j.cypher.internal.compiler.v2_0.ClosingIterator$$anonfun$hasNext$1.apply(ClosingIterator.scala:37)
at
org.neo4j.cypher.internal.compiler.v2_0.ClosingIterator$$anonfun$hasNext$1.apply(ClosingIterator.scala:37)
at
org.neo4j.cypher.internal.compiler.v2_0.ClosingIterator.failIfThrows(ClosingIterator.scala:91)
at
org.neo4j.cypher.internal.compiler.v2_0.ClosingIterator.hasNext(ClosingIterator.scala:37)
at
org.neo4j.cypher.internal.compiler.v2_0.PipeExecutionResult.hasNext(PipeExecutionResult.scala:166)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at
scala.collection.convert.Wrappers$IteratorWrapper.hasNext(Wrappers.scala:29)
at
org.neo4j.cypher.internal.compiler.v2_0.PipeExecutionResult$$anon$1.hasNext(PipeExecutionResult.scala:74)
at
org.neo4j.helpers.collection.ExceptionHandlingIterable$1.hasNext(ExceptionHandlingIterable.java:44)
at
org.neo4j.helpers.collection.IteratorWrapper.hasNext(IteratorWrapper.java:42)
at
org.neo4j.server.rest.repr.ListRepresentation.serialize(ListRepresentation.java:62)
at
org.neo4j.server.rest.repr.Serializer.serialize(Serializer.java:75)
at
org.neo4j.server.rest.repr.MappingSerializer.putList(MappingSerializer.java:61)
at
org.neo4j.server.rest.repr.CypherResultRepresentation.serialize(CypherResultRepresentation.java:83)
at
org.neo4j.server.rest.repr.MappingRepresentation.serialize(MappingRepresentation.java:41)
at
org.neo4j.server.rest.repr.OutputFormat.assemble(OutputFormat.java:215)
at
org.neo4j.server.rest.repr.OutputFormat.formatRepresentation(OutputFormat.java:147)
at
org.neo4j.server.rest.repr.OutputFormat.response(OutputFormat.java:130)
at org.neo4j.server.rest.repr.OutputFormat.ok(OutputFormat.java:67)
at
org.neo4j.server.rest.web.CypherService.cypher(CypherService.java:101)
at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethod
DispatchProvider.java:205)
at
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at
org.neo4j.server.rest.transactional.TransactionalRequestDispatcher.dispatch(TransactionalRequestDispatcher.java:132)
at
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
at
com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at
com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
at
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
at
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
at
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
at
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
at
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
at
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:698)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1506)
at
org.neo4j.server.rest.security.SecurityFilter.doFilter(SecurityFilter.java:112)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1477)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:211)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1096)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:432)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:175)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1030)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:136)
at
org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:52)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:445)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:268)
at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:229)
at
org.eclipse.jetty.io.AbstractConnection$ReadCallback.run(AbstractConnection.java:358)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:601)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:532)
at java.lang.Thread.run(Thread.java:722)
On Sunday, December 22, 2013 9:07:08 PM UTC+1, Lokesh Gidra wrote:
>
> All the queries are read requests. I am just trying to performance test
> the server. So I am using only shortestPath queries.
>
> Please find attached the files. I have compressed the log dir as one of
> the file was pretty big.
>
>
> Thanks,
> Lokesh
>
> On Sunday, December 22, 2013 6:48:52 PM UTC+1, Michael Hunger wrote:
>>
>> Are these queries only reading or reading and writing?
>>
>> can you produce a thread dump of you neo4j server when that happens ?
>>
>> either send a kill -3 <pid>
>> or use jstack <pid>
>>
>> and send us the thread-dump and the content of your logfiles (data/log/*
>> and data/graph.db/messages.log)
>>
>> Am 22.12.2013 um 14:06 schrieb Lokesh Gidra <[email protected]>:
>>
>> Hello,
>>
>> I am running a neo4j-2.0.0 server on a linux machine with 48-cores. I run
>> a python script on another machine. The script uses multiple threads to
>> perform multiple shortestPath queries to the server. I am using py2neo
>> package in the python script. In the beginning the queries are processed
>> fine. I can see multiple cpus being used by neo4j server in the "top"
>> output. But suddenly, the server gets into a serial phase where only 1 cpu
>> is used 100%. During this time, the python also doesn't make any progress.
>>
>> I am certain that the script is not faulty as sometimes this serial phase
>> begins AFTER processing all the queries sent by the script, but BEFORE the
>> script exits.
>>
>> Can anyone please suggest me what causes this behaviour. And what can be
>> done to avoid it.
>>
>>
>> Regards,
>> Lokesh
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Neo4j" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to [email protected].
>> For more options, visit https://groups.google.com/groups/opt_out.
>>
>>
>>
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.