[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Aude aude.w...@gmail.com changed: What|Removed |Added CC||aude.w...@gmail.com --- Comment #19 from Aude aude.w...@gmail.com --- my patch (https://gerrit.wikimedia.org/r/#/c/174113/) ensures the memcached lookup of SiteList is confined to users with the other projects beta feature enabled. This should help quite a lot to reduce memcached access for the SiteList. the SiteList is used in similar functionality as the interwiki data, used to add links to related sister projects in the sidebar. to roll out the feature more widely, we should have local caching (json, like i18n?) of the site list data and may want to have memcached store the hash (like done for i18n), per Aaron's suggestion. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|REOPENED|PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #18 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 174113 had a related patch set uploaded by Aude: Lazy initialize OtherProjectsSidebarGenerator in hook handlers https://gerrit.wikimedia.org/r/174113 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Ori Livneh o...@wikimedia.org changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|FIXED |--- --- Comment #15 from Ori Livneh o...@wikimedia.org --- This wasn't fixed, so I'm not sure why the bug was closed. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #16 from Faidon Liambotis fai...@wikimedia.org --- This causes: https://ganglia.wikimedia.org/latest/graph.php?r=yearz=xlargeh=mc1005.eqiad.wmnetm=network_reports=by+namemc=2g=network_reportc=Memcached+eqiad https://ganglia.wikimedia.org/latest/graph.php?r=yearz=xlargeh=mc1011.eqiad.wmnetm=network_reports=by+namemc=2g=network_reportc=Memcached+eqiad https://ganglia.wikimedia.org/latest/graph.php?r=yearz=xlargeh=mc1014.eqiad.wmnetm=cpu_reports=by+namemc=2g=network_reportc=Memcached+eqiad Top keys are: enwiki:sites/SiteList#2014-03-17+Site:2013-01-23 (54MB/s) wikidatawiki:sites/SiteList#2014-03-17+Site:2013-01-23 (20MB/s) commonswiki:sites/SiteList#2014-03-17+Site:2013-01-23 (18MB/s) This has been pointed out as early as September 2013, and again March 2014 and again September 2014 and is still happening. Having e.g. 80% of mc1005's total network bandwidth being a single wikidata key, or SiteList keys being consistently on the top of memcached bandwidth output by multiple factors compared to the rest, is frankly indicative of a serious design failure and unacceptable. I don't understand why this bug was closed either. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #17 from Aaron Schulz aschulz4...@gmail.com --- Can we just have a current version hash stored in memcached and used to validate server-local CDB caches (made on the fly, with a special key holding the hash of the other key/values). This would reduce the memcached I/O to a minuscule amount. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Jan Zerebecki jan.wikime...@zerebecki.de changed: What|Removed |Added Status|REOPENED|RESOLVED CC||jan.wikime...@zerebecki.de Resolution|--- |FIXED -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Ori Livneh o...@wikimedia.org changed: What|Removed |Added Status|VERIFIED|REOPENED Resolution|FIXED |--- Severity|major |critical --- Comment #14 from Ori Livneh o...@wikimedia.org --- This is once again an issue; it is loading on every request. Impact: http://i.imgur.com/v9ebld6.png -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Sam Reed (reedy) s...@reedyboy.net changed: What|Removed |Added Keywords||performance -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Lydia Pintscher lydia.pintsc...@wikimedia.de changed: What|Removed |Added Status|RESOLVED|VERIFIED CC||lydia.pintscher@wikimedia.d ||e -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #5 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93661 merged by jenkins-bot: Re-introduce siteGroup setting for performance reasons https://gerrit.wikimedia.org/r/93661 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #6 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93767 had a related patch set uploaded by Aude: Re-introduce siteGroup setting for performance reasons https://gerrit.wikimedia.org/r/93767 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #7 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93767 merged by jenkins-bot: Re-introduce siteGroup setting for performance reasons https://gerrit.wikimedia.org/r/93767 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #8 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93769 had a related patch set uploaded by Aude: Update Wikibase, use siteGroup setting instead of doing lookup https://gerrit.wikimedia.org/r/93769 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #9 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93772 had a related patch set uploaded by Aude: Update Wikibase, use siteGroup setting instead of doing lookup https://gerrit.wikimedia.org/r/93772 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #10 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93769 merged by jenkins-bot: Update Wikibase, use siteGroup setting instead of doing lookup https://gerrit.wikimedia.org/r/93769 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #11 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93772 merged by jenkins-bot: Update Wikibase, use siteGroup setting instead of doing lookup https://gerrit.wikimedia.org/r/93772 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #12 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93773 had a related patch set uploaded by Aude: Add siteGroup setting for Wikibase https://gerrit.wikimedia.org/r/93773 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #13 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93773 merged by Ori.livneh: Add siteGroup setting for Wikibase https://gerrit.wikimedia.org/r/93773 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Ori Livneh o...@wikimedia.org changed: What|Removed |Added Status|PATCH_TO_REVIEW |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #1 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93648 had a related patch set uploaded by Ori.livneh: Set enwiki's languageLinkSiteGroup to 'wikipedia' https://gerrit.wikimedia.org/r/93648 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|NEW |PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #2 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 93648 merged by Ori.livneh: Set enwiki's languageLinkSiteGroup to 'wikipedia' https://gerrit.wikimedia.org/r/93648 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #3 from Ori Livneh o...@wikimedia.org --- Didn't improve things a whole lot, since the call to getSite in WikibaseClient.hooks.php's onSkinTemplateOutputPageBeforeExec hook handler is executed much more frequently. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602 --- Comment #4 from Ori Livneh o...@wikimedia.org --- (In reply to comment #3) Didn't improve things a whole lot, since the call to getSite in WikibaseClient.hooks.php's onSkinTemplateOutputPageBeforeExec hook handler is executed much more frequently. That's Ie17f2af09, to be specific. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l