| Gehel added a comment. |
The main contention point for WDQS (or investigating alternatives) seems to be IOPS. We tried setting up a wdqs test instance on WMCS, but IO contention meant that we were not able to keep up with the update flow. Our production instance consume ~3-4K IOPS just for updates. If there is a way to get this kind of throughput on our VMs, then that would be great!
The more general concern here is that we are investigating alternatives to blazegraph as a graph database. Part of that investigation is getting some performance numbers from which we could extrapolate whether any solution we investigate is fit for the load we expect in production. Obviously, testing on similar hardware as what we have on production makes this easier.
If getting >4K IOPS on our VM is possible, I'd be happy to do another test with WDQS.
Cc: Andrew, Aklapper, Smalyshev, Gehel, Nandana, AndyTan, sietec, Davinaclare77, Qtn1293, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, bd808, fgiunchedi, chasemp
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
