dr0ptp4kt added a comment.
Following below are "per-query" summary stats. I actually just put this
together by bringing CSV data into Google Sheets for now - all of the columns
are calculated upon the "per-query" rows (but you'll see how the Mean
corresponds with the value calculated up above, with just slightly less
precision). The underlying CSV data don't bear actual queries (the `.nt` files
from which they're generated do), but rather rows of this form:
endpointLabel,task,queryId,totalTime,success,failed,timeouts,resultSize,unknownException,wrongCodes,qps,penalizedQPS
baseline,http://iguana-benchmark.eu/resource/1706221131/1/1,http://iguana-benchmark.eu/resource/1989023647/sparql0,53.592,2,0,0,1,0,0,37.319002836244216,37.319002836244216
No big surprises here. The "per-query" behavior was similar between nodes.
The "main" graph skewed somewhat faster over the full range of queries with one
exception: the absolute fastest singular query for "randomized 1" run was
slightly faster on the "baseline" full graph...but generally, everything else
skewed faster for the "main" graph otherwise.
**Per-query theoretical throughput (queries per second for given query)**
| Run | Endpoint Label | Mean | Median | Standard Deviation
| Max (fastest) | 99% (very fast) | 0.95 | 0.75 | 0.5 | 0.25 | 1% (pretty
slow) | Total w/ success |
| ---------------- | ------------------- | ---- | ------ | ------------------
| ------------- | --------------- | ---- | ---- | ---- | ---- |
---------------- | ---------------- |
| non-randomized 1 | baseline | 32.6059031135735 |
34.3489164537969 | 19.4337414434464 | 120.235661897318
| 76.8554161439261 | 55.7841155056668 | 49.1222469015747 |
34.3489164537969 | 14.3159887843845 | 0.0564663314012815 | 15538
|
| non-randomized 1 | wikidata_main_graph | 33.8619129716351 |
35.7193884840691 | 20.2056740376445 | 148.610491900728
| 81.2789060283893 | 57.5619081064873 | 50.4922999242615 |
35.7193884840691 | 15.098897780462 | 0.0625188498260728 | 16773
|
| non-randomized 2 | baseline | 32.9728451327437 |
34.7318699638788 | 19.5908672232246 | 128.890893858348
| 74.7142465127726 | 56.1419267909274 | 49.7404172035179 |
34.7318699638788 | 14.6689672498449 | 0.0569581938930891 | 15893
|
| non-randomized 2 | wikidata_main_graph | 34.0852093005914 | 36.106296938186
| 20.1931723422722 | 130.25921583952 | 82.0449565998977
| 57.6139754652666 | 50.625221485344 | 36.106296938186 |
15.378937007874 | 0.0622306059862422 | 16780 |
| randomized 1 | baseline | 32.8878633004489 |
34.6404323125952 | 19.8757923913207 | 136.072935093209
| 79.2782608462366 | 56.2164107372478 | 49.4926998267755 |
34.6404323125952 | 14.1755500113404 | 0.0557895216707227 | 15180
|
| randomized 1 | wikidata_main_graph | 33.9156003706814 |
35.7091844022282 | 20.2748013579631 | 132.082948091401
| 81.0501654381498 | 57.747392312958 | 50.5101525406606 |
35.7091844022282 | 15.079658294943 | 0.0574330048487202 | 15929
|
| randomized 2 | baseline | 33.007109052298 | 34.5670904661201
| 19.8511760316909 | 133.904659882163 |
81.4017649973028 | 56.1335754963953 | 49.6176341128876 |
34.5670904661201 | 14.3154187934342 | 0.0538090222917457 | 15211
|
| randomized 2 | wikidata_main_graph | 34.1402036271541 |
36.0958706323996 | 20.2577595936201 | 134.156157767641
| 83.0239310934627 | 57.7850982363029 | 50.5292946486809 |
36.0958706323996 | 15.7122834258313 | 0.0589775584599512 | 16084
|
|
TASK DETAIL
https://phabricator.wikimedia.org/T355037
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: dr0ptp4kt, dcausse, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1,
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi,
Gq86, GoranSMilovanovic, QZanden, EBjune, KimKelting, LawExplorer, _jensen,
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
_______________________________________________
Wikidata-bugs mailing list -- [email protected]
To unsubscribe send an email to [email protected]
