| Smalyshev added a comment. |
I have not yet heard an explanation of the resources needed
Sure, sorry for not specifying it early. So, in production we have:
- Database size now is 193G, 75% growth per year for now, though not sure it will keep growing this way for years. We have 500 to 700G of diskspace on production hosts, so I'd say we need about 500G on test host too (though we could reduce the data set on test DB, possibly, but the growth will still remain). Production uses (and requires) SSD, but I think for test host spinning disk would be ok.
- Memory - directly related to performance, so the more the better, but it can run inside 16G, though something like 64G would probably work better.
- CPU - here's it a bit hard for me to say. The workload is mostly I/O (disk) bound, production has Dual Xeon E5-2620 v3 @2.4Ghz, but it's hard to see what we need in labs since we won't be serving any traffic. What we have in production is probably overkill for test setup, but what we have now in labs with 8 cores can't reliably keep up with update steam (maybe not CPU but I/O issue).
Summarily, what is needed is:
- Much more diskspace and I/O throughput
- Somewhat more memory
- Maybe more CPU power, not sure - need to see
TASK DETAIL
EMAIL PREFERENCES
To: Smalyshev
Cc: daniel, Lydia_Pintscher, bd808, chasemp, Gehel, Aklapper, Smalyshev, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
Cc: daniel, Lydia_Pintscher, bd808, chasemp, Gehel, Aklapper, Smalyshev, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
