Take a look at the cluster performance history: hostname:8002/history Mysterious slowdowns like this, especially in a cluster, are usually some form of resource contention. Severe contention can cause other requests, even trivial ones, to run slowly or get stalled. In a cluster, lock contention can manifest like this. When there is more than one node in a cluster, locks need to be communicated to all nodes and conflicts resolved. It’s actually quite easy to induce lock storms with some kinds of requests.
Another thing about clusters is that they can run along nicely until some limit is reached and then, because of the cluster communication overhead, performance can fall off a cliff. Perhaps you’re bumping up against the size limits of the cluster. Look at the performance history and see if there are spikes in lock contention, disk I/O, etc. It may give you a clue to what’s going on. Ideally, the various graph lines should remain fairly flat, without radical spikes. ---- Ron Hitchens [email protected], +44 7879 358212 On August 1, 2017 at 1:49:55 PM, Basavaraj Kalloli ( [email protected]) wrote: Hi All, We faced a strange issue today when the http server on Marklogic was responding really slowly. We use the check to determine whether the server is up and running. We have a HA proxy infront of marklogic which load balances requests to Marklogic. The check in HA proxy to verify if the server is healthy is: curl http://x.x.x.x:8300 But the server was responding really slowly on this, because of this the Load Balancer assumed that the server was down. But at this time we could login to Admin and QConsole and do queries. We are not sure what caused this huge latency. The number of threads for the server is set to 32, we couldn't find anything in the logs and the Marklogic dashboard is not really helpful either. Can someone please share a few ideas we could try to investigate this a bit further? We have been facing similar issues and the Marklogic Dashboard is pretty useless, any debugging help would be appreciated. Thanks, Basu _______________________________________________ General mailing list [email protected] Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
_______________________________________________ General mailing list [email protected] Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
