[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-11-19 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Aude aude.w...@gmail.com changed:

   What|Removed |Added

 CC||aude.w...@gmail.com

--- Comment #19 from Aude aude.w...@gmail.com ---
my patch (https://gerrit.wikimedia.org/r/#/c/174113/) ensures the memcached
lookup of SiteList is confined to users with the other projects beta feature
enabled. This should help quite a lot to reduce memcached access for the
SiteList.

the SiteList is used in similar functionality as the interwiki data, used to
add links to related sister projects in the sidebar.

to roll out the feature more widely, we should have local caching (json, like
i18n?) of the site list data and may want to have memcached store the hash
(like done for i18n), per Aaron's suggestion.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-11-18 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Gerrit Notification Bot gerritad...@wikimedia.org changed:

   What|Removed |Added

 Status|REOPENED|PATCH_TO_REVIEW

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-11-18 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #18 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 174113 had a related patch set uploaded by Aude:
Lazy initialize OtherProjectsSidebarGenerator in hook handlers

https://gerrit.wikimedia.org/r/174113

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-11-17 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Ori Livneh o...@wikimedia.org changed:

   What|Removed |Added

 Status|RESOLVED|REOPENED
 Resolution|FIXED   |---

--- Comment #15 from Ori Livneh o...@wikimedia.org ---
This wasn't fixed, so I'm not sure why the bug was closed.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-11-17 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #16 from Faidon Liambotis fai...@wikimedia.org ---
This causes:
https://ganglia.wikimedia.org/latest/graph.php?r=yearz=xlargeh=mc1005.eqiad.wmnetm=network_reports=by+namemc=2g=network_reportc=Memcached+eqiad
https://ganglia.wikimedia.org/latest/graph.php?r=yearz=xlargeh=mc1011.eqiad.wmnetm=network_reports=by+namemc=2g=network_reportc=Memcached+eqiad
https://ganglia.wikimedia.org/latest/graph.php?r=yearz=xlargeh=mc1014.eqiad.wmnetm=cpu_reports=by+namemc=2g=network_reportc=Memcached+eqiad

Top keys are:
enwiki:sites/SiteList#2014-03-17+Site:2013-01-23 (54MB/s)
wikidatawiki:sites/SiteList#2014-03-17+Site:2013-01-23 (20MB/s)
commonswiki:sites/SiteList#2014-03-17+Site:2013-01-23 (18MB/s)

This has been pointed out as early as September 2013, and again March 2014 and
again September 2014 and is still happening. Having e.g. 80% of mc1005's total
network bandwidth being a single wikidata key, or SiteList keys being
consistently on the top of memcached bandwidth output by multiple factors
compared to the rest, is frankly indicative of a serious design failure and
unacceptable. I don't understand why this bug was closed either.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-11-17 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #17 from Aaron Schulz aschulz4...@gmail.com ---
Can we just have a current version hash stored in memcached and used to
validate server-local CDB caches (made on the fly, with a special key holding
the hash of the other key/values). This would reduce the memcached I/O to a
minuscule amount.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-10-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Jan Zerebecki jan.wikime...@zerebecki.de changed:

   What|Removed |Added

 Status|REOPENED|RESOLVED
 CC||jan.wikime...@zerebecki.de
 Resolution|--- |FIXED

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-09-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Ori Livneh o...@wikimedia.org changed:

   What|Removed |Added

 Status|VERIFIED|REOPENED
 Resolution|FIXED   |---
   Severity|major   |critical

--- Comment #14 from Ori Livneh o...@wikimedia.org ---
This is once again an issue; it is loading on every request.

Impact: http://i.imgur.com/v9ebld6.png

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2014-09-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Sam Reed (reedy) s...@reedyboy.net changed:

   What|Removed |Added

   Keywords||performance

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-12 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Lydia Pintscher lydia.pintsc...@wikimedia.de changed:

   What|Removed |Added

 Status|RESOLVED|VERIFIED
 CC||lydia.pintscher@wikimedia.d
   ||e

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #5 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93661 merged by jenkins-bot:
Re-introduce siteGroup setting for performance reasons

https://gerrit.wikimedia.org/r/93661

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #6 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93767 had a related patch set uploaded by Aude:
Re-introduce siteGroup setting for performance reasons

https://gerrit.wikimedia.org/r/93767

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #7 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93767 merged by jenkins-bot:
Re-introduce siteGroup setting for performance reasons

https://gerrit.wikimedia.org/r/93767

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #8 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93769 had a related patch set uploaded by Aude:
Update Wikibase, use siteGroup setting instead of doing lookup

https://gerrit.wikimedia.org/r/93769

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #9 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93772 had a related patch set uploaded by Aude:
Update Wikibase, use siteGroup setting instead of doing lookup

https://gerrit.wikimedia.org/r/93772

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #10 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93769 merged by jenkins-bot:
Update Wikibase, use siteGroup setting instead of doing lookup

https://gerrit.wikimedia.org/r/93769

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #11 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93772 merged by jenkins-bot:
Update Wikibase, use siteGroup setting instead of doing lookup

https://gerrit.wikimedia.org/r/93772

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #12 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93773 had a related patch set uploaded by Aude:
Add siteGroup setting for Wikibase

https://gerrit.wikimedia.org/r/93773

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #13 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93773 merged by Ori.livneh:
Add siteGroup setting for Wikibase

https://gerrit.wikimedia.org/r/93773

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-05 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Ori Livneh o...@wikimedia.org changed:

   What|Removed |Added

 Status|PATCH_TO_REVIEW |RESOLVED
 Resolution|--- |FIXED

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #1 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93648 had a related patch set uploaded by Ori.livneh:
Set enwiki's languageLinkSiteGroup to 'wikipedia'

https://gerrit.wikimedia.org/r/93648

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

Gerrit Notification Bot gerritad...@wikimedia.org changed:

   What|Removed |Added

 Status|NEW |PATCH_TO_REVIEW

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #2 from Gerrit Notification Bot gerritad...@wikimedia.org ---
Change 93648 merged by Ori.livneh:
Set enwiki's languageLinkSiteGroup to 'wikipedia'

https://gerrit.wikimedia.org/r/93648

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #3 from Ori Livneh o...@wikimedia.org ---
Didn't improve things a whole lot, since the call to getSite in
WikibaseClient.hooks.php's onSkinTemplateOutputPageBeforeExec hook handler is
executed much more frequently.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 56602] Set languageLinkSiteGroup in $wgWBClientSettings to avoid fetching SiteList object from memcached

2013-11-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=56602

--- Comment #4 from Ori Livneh o...@wikimedia.org ---
(In reply to comment #3)
 Didn't improve things a whole lot, since the call to getSite in
 WikibaseClient.hooks.php's onSkinTemplateOutputPageBeforeExec hook handler is
 executed much more frequently.

That's Ie17f2af09, to be specific.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l