| Addshore added a comment. |
I just went through the api-requests dashboard for each wikibase api module and didn't spot any spikes in the execution time
https://grafana.wikimedia.org/dashboard/db/api-requests?orgId=1&from=1512594024756&to=1512597639992&var-percentile=p50&var-dc=eqiad&refresh=5m
These timings are sampled and come from ApiMain and are essentially the time spent in the execute method.
It looks like all of this data gets logged into the ApiAction table in hadoop so we could also try looking there (also unsampled there I believe).
While just going to the sandbox https://www.wikidata.org/wiki/Q4115189 and removing some statements I am able to trigger some requests that do seem to take quite a while.
The behaviour seems very inconsistent, perhaps 1 in 3 sets of requests go very slowly.
F11669545: image.png
I managed to grab some profiling info for some of the requests that I made, however I only know how to do this while firing all of the requests at the same server, so that might also affect the results.
One request - 20:33:05 - https://performance.wikimedia.org/xhgui/run/flamegraph?id=5a29a587bb85442702adb00f
Another request - 20:36:50 - https://performance.wikimedia.org/xhgui/run/flamegraph?id=5a29a66d3f3dfa28025f286b
4 requests together:
- https://performance.wikimedia.org/xhgui/run/view?id=5a29a7603f3dfa2802d43e1d
- https://performance.wikimedia.org/xhgui/run/view?id=5a29a7603f3dfa2802c98787
- https://performance.wikimedia.org/xhgui/run/view?id=5a29a7663f3dfa2802fa0748
- https://performance.wikimedia.org/xhgui/run/view?id=5a29a7663f3dfa2802dc2eb0
From those requests the thing that stands out is Wikimedia\WaitConditionLoop::usleep.
You can see the call stack by looking at the flamegraph or the call graph
Not sure if any of that is too useful but thats what I found while looking and poking around...
Cc: hoo, daniel, Framawiki, Envlh, Kghbln, jhsoby, Trizek-WMF, Liuxinyu970226, Joe, Ladsgroup, Addshore, Lea_Lacroix_WMDE, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
