Gehel added a comment.
Some minimal packet drop is still seen (< 100 packet / 24h), so the situation is very much better. More work needs to be done on limiting CPU usage on the blazegraph side.TASK DETAILhttps://phabricator.wikimedia.org/T206105EMAIL
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-10-17T13:08:15Z] applying rps NIC config for all wdqs nodes - T206105TASK DETAILhttps://phabricator.wikimedia.org/T206105EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel,
gerritbot added a comment.
Change 465624 merged by Gehel:
[operations/puppet@production] wdqs: spread IRQ from NIC over multiple CPUs
https://gerrit.wikimedia.org/r/465624TASK DETAILhttps://phabricator.wikimedia.org/T206105EMAIL
gerritbot added a comment.
Change 467443 merged by BBlack:
[operations/puppet@production] interface::rps: support tg3 properly
https://gerrit.wikimedia.org/r/467443TASK DETAILhttps://phabricator.wikimedia.org/T206105EMAIL
gerritbot added a comment.
Change 467443 had a related patch set uploaded (by BBlack; owner: BBlack):
[operations/puppet@production] interface::rps: support tg3 properly
https://gerrit.wikimedia.org/r/467443TASK DETAILhttps://phabricator.wikimedia.org/T206105EMAIL
BBlack added a comment.
Yes, let's look at this today. I think we need better tg3 ethernet card support in interface::rps for one of our authdnses anyways, which you'll need here too.TASK DETAILhttps://phabricator.wikimedia.org/T206105EMAIL
gerritbot added a comment.
Change 465624 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] wdqs: spread IRQ from NIC over multiple CPUs
https://gerrit.wikimedia.org/r/465624TASK DETAILhttps://phabricator.wikimedia.org/T206105EMAIL
Gehel added a comment.
With some trial an error, it looks like the smp_affinity = 00ff00ff would allow the IRQ to be managed by any CPU, but it is still managed by the first one (in this case, any == CPU0). Setting each IRQ on a specific CPU (and one only) will spread them. It looks like puppet
