[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added Status|PATCH_TO_REVIEW |ASSIGNED --- Comment #36 from Andre Klapper aklap...@wikimedia.org --- (In reply to comment #35 by csteipp) The only remaining thing would be to (very carefully) return a cached response from Varnish for loginwiki's /checkLoggedIn [...] But I think Varnish still ignores all caching for Special:CentralAutoLogin after bug 53032? All patches are in - resetting status. Chris: Is this still highest priority or is this only high now? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Chris Steipp cste...@wikimedia.org changed: What|Removed |Added Priority|Highest |Normal --- Comment #37 from Chris Steipp cste...@wikimedia.org --- I'll let Faidon weigh in on how much we need to setup the varnish cache for that page. But given the current load on the backend vs the potential impact (positive, and negative if we mess any part of it up), I'm not sure how high of a priority we want that. Bumping this to normal for now. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #35 from Chris Steipp cste...@wikimedia.org --- The only remaining thing would be to (very carefully) return a cached response from Varnish for loginwiki's /checkLoggedIn, if the user doesn't have any loggin cookies, since we return the exact same content for all logged-out users (but unique content for logged in users). MediaWiki should be sending the correct headers-- CC:public, with a max-age of 1200 when the request came from a logged out user, or CC:private when the user is logged in. But I think Varnish still ignores all caching for Special:CentralAutoLogin after bug 53032? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #34 from Faidon Liambotis fai...@wikimedia.org --- These were all deployed and the effect is nicely visualized here: https://ganglia.wikimedia.org/latest/stacked.php?c=Application+servers+eqiadhost_regex=m=ap_rpsr=yearst=1388322880 (application server requests per second) I'm happy with seeing this bug report closed. Chris, you mentioned some other optimizations you had in mind. Are you still planning these? Are we going to track them im this bug? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #30 from Chris Steipp cste...@wikimedia.org --- (In reply to comment #29) It's very odd that /createSession is more popular than /checkLoggedIn, since /checkLoggedIn redirecting to /createSession is the only way /createSession is called. Not really. /checkLoggedIn has the wikiid parameter to tell it which wiki to redirect back to, so you have to add together /checkLoggedIn?wikiid=enwiki, /checkLoggedIn?wikiid=eswiki, and so on. /createSession will be on all the different domains, but it looks like the stats above aren't being split that way so all the /createSession?gu_id=0 are already added together. Or is /createSession still more popular after doing that? Good point, I think those were only counting full urls. Faidon, could we get a list of urls without query parameters, to make sure /checkLoggedIn is being called roughly the same amount as /createSession? Brad, if you get time to review and merge gerrit 100508, I'm happy to deploy it today, so that we reduce the load as much as possible before we make any changes to how we pass the parameters. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #31 from Faidon Liambotis fai...@wikimedia.org --- On a sample of 100k requests, /createSession matched 3650 times, while /checkLoggedIn 3679 times (this is literally greps, not filtered per domain or query params). I tried 3 different such samples with similar results. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #32 from Chris Steipp cste...@wikimedia.org --- Thanks Faidon, that is exactly what I was expecting. Just wanted to confirm. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #33 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 100508 merged by jenkins-bot: Don't redirects anons to /createSession https://gerrit.wikimedia.org/r/100508 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #27 from Chris Steipp cste...@wikimedia.org --- I updated 1.23wmf5 (including enwiki) to include the patch that removes calls to /start for anons. After that, Faidon was looking at the logs and observed: paravoid /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=http is first paravoid /wiki/Special:CentralAutoLogin/checkLoggedIn?type=scriptwikiid=enwikiproto=http is second, /wiki/Special:CentralAutoLogin/checkLoggedIn?type=scriptwikiid=eswikiproto=http is third paravoid on backend requests paravoid 6392.37 RxURL /w/index.php?title=MediaWiki:Wikiminiatlas.jsaction=rawctype=text/javascriptsmaxage=21600maxage=86400 paravoid 6133.61 RxURL /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=http paravoid 4772.53 RxURL /w/api.php paravoid on frontends paravoid I also see on no5 /w/index.php?title=Spezial:Zentrale_automatische_Anmeldung/createSessiongu_id=0type=scriptproto=http so I guess https://gerrit.wikimedia.org/r/#/c/98461/ didn't work It's very odd that /createSession is more popular than /checkLoggedIn, since /checkLoggedIn redirecting to /createSession is the only way /createSession is called. On another bug, Brad and I have been discussion removing the call to createSession for annons, and ending the protocol once we know they're anonymous. So we can address the symptoms, but I'm still concerned we have something weird going on causing this. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #28 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 100508 had a related patch set uploaded by CSteipp: Don't redirects anons to /createSession https://gerrit.wikimedia.org/r/100508 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #29 from Brad Jorsch bjor...@wikimedia.org --- (In reply to comment #27) paravoid /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=http is first paravoid /wiki/Special:CentralAutoLogin/ checkLoggedIn?type=scriptwikiid=enwikiproto=http is second, /wiki/Special:CentralAutoLogin/ checkLoggedIn?type=scriptwikiid=eswikiproto=http is third paravoid on backend requests It's very odd that /createSession is more popular than /checkLoggedIn, since /checkLoggedIn redirecting to /createSession is the only way /createSession is called. Not really. /checkLoggedIn has the wikiid parameter to tell it which wiki to redirect back to, so you have to add together /checkLoggedIn?wikiid=enwiki, /checkLoggedIn?wikiid=eswiki, and so on. /createSession will be on all the different domains, but it looks like the stats above aren't being split that way so all the /createSession?gu_id=0 are already added together. Or is /createSession still more popular after doing that? paravoid I also see on no5 /w/index.php?title=Spezial:Zentrale_automatische_Anmeldung/ createSessiongu_id=0type=scriptproto=http so I guess https://gerrit.wikimedia.org/r/#/c/98461/ didn't work I'm not so sure, it doesn't seem like a localisation update was run after the patch was backported to wmf5. The nightly update just ran now, and now it seems to no longer be redirecting. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #26 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 98461 merged by jenkins-bot: Don't localize Special:CentralAutoLogin https://gerrit.wikimedia.org/r/98461 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #25 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 98461 had a related patch set uploaded by Anomie: Don't localize Special:CentralAutoLogin https://gerrit.wikimedia.org/r/98461 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Bug 54195 depends on bug 57223, which changed state. Bug 57223 Summary: CentralAuth $wgSecureLogin redirect is uncacheable https://bugzilla.wikimedia.org/show_bug.cgi?id=57223 What|Removed |Added Status|PATCH_TO_REVIEW |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #24 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 95609 merged by jenkins-bot: Skip Special:CentralAutoLogin/start for JS anons https://gerrit.wikimedia.org/r/95609 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Tim Starling tstarl...@wikimedia.org changed: What|Removed |Added Depends on||57223 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Faidon Liambotis fai...@wikimedia.org changed: What|Removed |Added Priority|High|Highest CC||o...@wikimedia.org, ||tstarl...@wikimedia.org --- Comment #20 from Faidon Liambotis fai...@wikimedia.org --- OK, I had another quick look, as this in combination with consistent hashing directing /wiki/Special:CentralAutoLogin/start?type=script to a single Varnish backend produced a partial outage by exhausting its resources. (this has been workarounded since with https://gerrit.wikimedia.org/r/#/c/95458/ ) This is far more than just caching. I'm going to report these here so we don't get lost into multiple bugs, but feel free to fork into other bugs as needed: 1) From Varnish text frontends, i.e. *all* text client-side requests (hits misses), the top 10 URLs are: 6895.39 RxURL /wiki/Special:CentralAutoLogin/start?type=script 5627.74 RxURL /w/index.php?title=MediaWiki:Wikiminiatlas.jsaction=rawctype=text/javascriptsmaxage=21600maxage=86400 3235.81 RxURL /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=https 2137.83 RxURL /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=http 1981.98 RxURL /w/index.php?title=MediaWiki:EnhancedCollapsibleElements.jsaction=rawctype=text/javascript 1943.81 RxURL /w/index.php?title=MediaWiki:Common.js/NormalizeCharWidth.jsaction=rawctype=text/javascript 1567.70 RxURL /wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=enwikiproto=httpstype=script 1383.12 RxURL /favicon.ico 1266.87 RxURL /w/index.php?title=%E7%89%B9%E5%88%A5:%E4%B8%AD%E5%A4%AE%E7%AE%A1%E7%90%86%E8%87%AA%E5%8B%95%E3%83%AD%E3%82%B0%E3%82%A4%E3%83%B3/star 1020.66 RxURL /w/index.php?title=MediaWiki:OSM.jsaction=rawctype=text/javascriptsmaxage=21600maxage=86400 (also note how the first is double the requests from the third and triple the requests from fourth) and from the top-50 URLs, 10 (20%) are CentralAutoLogin URLs, namely: 6944.76 RxURL /wiki/Special:CentralAutoLogin/start?type=script 3003.28 RxURL /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=https 2273.40 RxURL /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=http 1452.62 RxURL /wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=enwikiproto=httpstype=script 551.49 RxURL /wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=jawikiproto=httpstype=script 362.93 RxURL /wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=eswikiproto=httpstype=script 298.33 RxURL /wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=zhwikiproto=httptype=script 293.00 RxURL /wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=enwikiproto=httptype=script 289.84 RxURL /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=1x1proto=https 240.99 RxURL /wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=ptwikiproto=httpstype=script Moreover, these stats do not include the localized URLs that I'm seeing, such as http://de.wikipedia.org/w/index.php?title=Spezial:Zentrale_automatische_Anmeldung/starttype=script (localized URLs for such basic functions are a bad idea, as it doesn't help us aggregate URLs counts and find outliers like the above) And, surpisingly, does not include the 1x1 URL that I see e.g. on all(?) enwiki pages as: noscriptimg src=//en.wikipedia.org/w/index.php?title=Special:CentralAutoLogin/startamp;type=1x1 alt= title= width=1 height=1 style=border: none; position: absolute; //noscript/div which also comes with Cache-control: private. The fact that these URLs are so popular points to far more than just editors attempting to login -- it surely includes anonymous page views and it's probably aggravated by the fact that due to caching headers, we do not make use of client-side caching. I see ext.centralauth.centralautologin.js doing such requests and that script being loaded on every anon, but it's clearly not my area of expertise. Those URLs not being cached also means these get passed through to appservers and increasing their load significantly, which the original point of this report. It's also very apparent now, though, that they're causing problems in all kinds of layers in our infrastructure (Varnish frontend/backend hit ratio is down the drain, Varnish backends were/are suffering) and possibly causing a client-side slow-down. I think we can fix the caching issues -even for redirects depending on GeoIP- but first and foremost we need to stop forcing all page views to requests all kinds of (uncacheable) CentralAutoLogin URLs in this way. -- You are receiving this mail because:
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #21 from Faidon Liambotis fai...@wikimedia.org --- Oh, and the for the record, the top 5 from Varnish backends, i.e. frontend misses, which filters out cacheable hotspots: 6964.24 RxURL /wiki/Special:CentralAutoLogin/start?type=script 5650.14 RxURL /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=https 3943.42 RxURL /wiki/Special:CentralAutoLogin/createSession?gu_id=0type=scriptproto=http 2417.36 RxURL /wiki/Special:CentralAutoLogin/checkLoggedIn?wikiid=enwikiproto=httptype=script 1513.81 RxURL /check (all but /check being passed through as-is to appservers) -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #22 from Brad Jorsch bjor...@wikimedia.org --- Unless the client lacks/blocks localStorage and cookies, it should be one pageview per client per site visited per day that is hitting /start?type=script, /checkLoggedIn?wikiid=*proto=http(s)type=script, and /createSession?gu_id=0type=scriptproto=http(s). There will also be extra hits coming from the login form, but those hits will include return=1 and likely returnto and returntoquery parameters. As long as each of those URLs is varied on the CentralAuth cookies, they all should be fully cacheable. We can't just not have anons hit these, though, because anons hitting them is an integral part of the SUL2 login scheme: browsers will no longer allow us to set cookies for (e.g.) wikivoyage.org on login if the user has never visited wikivoyage.org before, so when a user does visit wikivoyage.org anonymously we need to somehow check whether they're logged in centrally. /start?type=1x1 does appear on anon pageviews, but there it's wrapped in noscript tags so it should only be hit when the browser lacks JavaScript. /start?type=1x1from=* appears on the pageview after login. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #23 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 95609 had a related patch set uploaded by Anomie: Skip Special:CentralAutoLogin/start for JS anons https://gerrit.wikimedia.org/r/95609 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|NEW |PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #19 from Chris Steipp cste...@wikimedia.org --- Any updates Faidon? I'm curious to know if you found anything, so we can make sure this is as minimal load on the apaches as possible. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #18 from Faidon Liambotis fai...@wikimedia.org --- Yes, the redirects should vary on XFP, but right now it won't have any effect, since these redirects also come with Cache-Control: private so they're not cached anyway. I guess the rationale behind no caching is that the redirects are dependent on the client's IP and you can't Vary on that. We can do tricks to solve this (e.g. do the GeoIP lookup on the Varnish side for particular URLs and set an X-Country header that you could vary on, for example), but before we go down that road I'd like to analyze the traffic a bit further and figure out why these rank so high in amount of req/s. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #16 from Faidon Liambotis fai...@wikimedia.org --- What do you mean on the user being logged in? Is it a preference (Cookie?), geolocation data for the IP or something else? We could likely enforce some logic with Vary/XVO/Varnish VCL and avoid hitting apaches for all of these. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #17 from Brad Jorsch bjor...@wikimedia.org --- (In reply to comment #15) Faidon also mentioned on irc that he was seeing http-https redirects. We wouldn't want to cache those, since those are based on the user being logged in. For Special:CentralAutoLogin, it redirects to https if $wgSecureLogin is set and wfCanIPUseHTTPS() returns true for the IP, regardless of whether the user is logged in or not. If the user has the forceHTTPS cookie or is logged in and returns true for $user-requiresHTTPS(), then I believe MediaWiki will do the same sort of redirect before getting to CentralAuth. BTW, should that redirect be varying on X-Forwarded-Proto? Probably, so I submitted Gerrit change 90543 to do that. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Faidon Liambotis fai...@wikimedia.org changed: What|Removed |Added Status|PATCH_TO_REVIEW |NEW --- Comment #14 from Faidon Liambotis fai...@wikimedia.org --- The fix had the intended effect but I still see those URLs (without returnto this time) not being cached at all. It seems MediaWiki emits Cache-control: private, must-revalidate, max-age=0 and Expires: Thu, 01 Jan 1970 00:00:00 GMT; a request/response sample would be: GET /wiki/Special:CentralAutoLogin/start?type=script HTTP/1.0 Host: zh.wikipedia.org Accept: */* User-Agent: (...) Accept-Encoding: gzip,deflate,sdch Accept-Language: zh-CN,zh;q=0.8 Via: 1.0 cp1015.eqiad.wmnet:3128 (squid/2.7.STABLE9) X-Forwarded-For: (...) Connection: keep-alive HTTP/1.1 302 Found Date: Fri, 18 Oct 2013 00:35:12 GMT Server: Apache X-Powered-By: PHP/5.3.10-1ubuntu3.8+wmf2 X-Content-Type-Options: nosniff Cache-control: private, must-revalidate, max-age=0 Vary: Accept-Encoding,X-Forwarded-Proto,Cookie X-Vary-Options: Accept-Encoding;list-contains=gzip,X-Forwarded-Proto,Cookie;string-contains=zhwikiToken;string-contains=zhwikiLoggedOut;string-contains=forceHTTPS;string-contains=zhwikiSession;string-contains=centralauth_Token;string-contains=centralauth_Session;string-contains=centralauth_LoggedOut;string-contains=mf_useformat;string-contains=stopMobileRedirect Expires: Thu, 01 Jan 1970 00:00:00 GMT Location: http://zh.wikipedia.org/w/index.php?title=Special:%E4%B8%AD%E5%A4%AE%E8%AE%A4%E8%AF%81%E7%99%BB%E5%BD%95/starttype=script Content-Encoding: gzip Content-Length: 20 Keep-Alive: timeout=2, max=147 Connection: Keep-Alive Content-Type: text/html; charset=utf-8 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #15 from Chris Steipp cste...@wikimedia.org --- This looks like another issue, since the user is just being redirected to a translated page name. That seems like it would be a safe redirect for mediawiki to cache, and we probably haven't had sufficient volumes to worry about caching it in the past. But maybe someone else knows for sure? If the user actually gets to Special:CentralAutoLogin/start, they are redirected to loginwiki's Special:CentralAutoLogin/checkLoggedIn, which should be cached, and I'm guessing those are since Faidon didn't see many of those. Faidon also mentioned on irc that he was seeing http-https redirects. We wouldn't want to cache those, since those are based on the user being logged in. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #12 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 86265 had a related patch set uploaded by Anomie: For caching, avoid passing returnto to Special:CentralAutoLogin https://gerrit.wikimedia.org/r/86265 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|NEW |PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #13 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 86265 merged by jenkins-bot: For caching, avoid passing returnto to Special:CentralAutoLogin https://gerrit.wikimedia.org/r/86265 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #5 from Faidon Liambotis fai...@wikimedia.org --- CentralAutoLogin traffic is still 50% of all Apache traffic, so no huge effect there. CentralAutoLogin/start is 27.5% in my small sample, however this has little to do with caching: all of the URLs are different because of the returnto query parameter. There is of course benefit with having those cached when returnto is some popular page (e.g. Main_Page). -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Chris Steipp cste...@wikimedia.org changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|FIXED |--- --- Comment #6 from Chris Steipp cste...@wikimedia.org --- Thanks Faidon. In the majority case, the ping to check if the anon user is logged in, we shouldn't need the returnto.. so if that's being added, I think we can fix that. Brad, do remember why we add returnto and returntoquery in centralautologin.js for non-login pages? It's not used except when we get to the /setCookies phase, and there, it only adds a window.location if the request had a 'return' parameter, which I don't ever see set. So it seems like we're passing it around without actually using it.. but am I missing something? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #7 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 86207 had a related patch set uploaded by CSteipp: Remove returnto for basic login test https://gerrit.wikimedia.org/r/86207 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|REOPENED|PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #8 from Brad Jorsch bjor...@wikimedia.org --- (In reply to comment #6) Brad, do remember why we add returnto and returntoquery in centralautologin.js for non-login pages? It's not used except when we get to the /setCookies phase, and there, it only adds a window.location if the request had a 'return' parameter, which I don't ever see set. So it seems like we're passing it around without actually using it.. but am I missing something? git blame would point you to Gerrit change 83007. The returnto gets used in SkinTemplate.php in core, when it generates the #p-personal replacement. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #9 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 86207 abandoned by CSteipp: Remove returnto for basic login test Reason: We'll find a better solution https://gerrit.wikimedia.org/r/86207 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #10 from Chris Steipp cste...@wikimedia.org --- (In reply to comment #8) (In reply to comment #6) Brad, do remember why we add returnto and returntoquery in centralautologin.js for non-login pages? It's not used except when we get to the /setCookies phase, and there, it only adds a window.location if the request had a 'return' parameter, which I don't ever see set. So it seems like we're passing it around without actually using it.. but am I missing something? git blame would point you to Gerrit change #83007. The returnto gets used in SkinTemplate.php in core, when it generates the #p-personal replacement. Ah, thanks. Could we build the correct returnto and update the link in the javascript that we return from /setCookies? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Brad Jorsch bjor...@wikimedia.org changed: What|Removed |Added Status|PATCH_TO_REVIEW |NEW --- Comment #11 from Brad Jorsch bjor...@wikimedia.org --- (In reply to comment #10) Ah, thanks. Could we build the correct returnto and update the link in the javascript that we return from /setCookies? Probably. Although my gut reaction is this #p-personal thing keeps getting more and more hacky. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Chris Steipp cste...@wikimedia.org changed: What|Removed |Added Status|PATCH_TO_REVIEW |RESOLVED Resolution|--- |FIXED --- Comment #4 from Chris Steipp cste...@wikimedia.org --- This change has been deployed, and load to eqiad application servers seems to have dropped a bit. 20:31 logmsgbot: csteipp synchronized php-1.22wmf17/extensions/CentralAuth 'update to master for SUL fix' 20:28 logmsgbot: csteipp synchronized php-1.22wmf18/extensions/CentralAuth 'update to master for SUL fix' -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #1 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 85036 had a related patch set uploaded by CSteipp: Set Squid maxage so proxies will cache https://gerrit.wikimedia.org/r/85036 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|NEW |PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #2 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 85036 merged by jenkins-bot: Set Squid maxage so proxies will cache https://gerrit.wikimedia.org/r/85036 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 --- Comment #3 from Chris Steipp cste...@wikimedia.org --- Faidon, Tim, or Mark, it would be good if you guys could take a look at gerrit 85036 too, and just make sure Brad and my assumptions about squid / varnish are correct. If anything doesn't seem right, let us know asap! -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added Keywords||performance -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added See Also||https://bugzilla.wikimedia. ||org/show_bug.cgi?id=52206 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 54195] CentralAuth not caching Special:CentralAutoLogin/start
https://bugzilla.wikimedia.org/show_bug.cgi?id=54195 Chris Steipp cste...@wikimedia.org changed: What|Removed |Added Priority|Unprioritized |High -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
