[Bug 49872] max_user_connections too low on Wikimedia Labs
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 Sean Pringle sprin...@wikimedia.org changed: What|Removed |Added Status|REOPENED|RESOLVED Resolution|--- |FIXED --- Comment #18 from Sean Pringle sprin...@wikimedia.org --- Regarding monitoring: We have userstat=ON on the labsdb instances to maintain user_statistics and client_statistics tables in information_schema. The data is also being logged on db1044 for time-series reporting, but isn't exposed anywhere yet. http://www.percona.com/doc/percona-server/5.5/diagnostics/user_stats.html Unfortunately the user_statistics.concurrent_connections field isn't updated due to bug. However by logging user_statistics.total_connections we can still identify spikes. So far nobody has abused max_user_connections=512, and, as Coren implied earlier, we can continue to be lenient until forced to do otherwise. Closing. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low on Wikimedia Labs
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #17 from Andre Klapper aklap...@wikimedia.org --- Johannes: Any recent complaints from users because article list generator doesn't work? Is there any work left to do here or can this be closed (see comment 14)? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low on Wikimedia Labs
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #16 from Tim Landscheidt t...@tim-landscheidt.de --- (In reply to comment #14) [...] Need to monitor for a while to see peak connection usage per user. From that we can pick a sane cut-off. Do we now how some data to close this bug? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low on Wikimedia Labs
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #13 from Johannes Kroll (WMDE) johannes.kr...@wikimedia.de --- This has been un-fixed since more than a month now. We are getting angry emails from users because the article list generator doesn't work for anything except enwiki. Please fix it. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low on Wikimedia Labs
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #14 from Sean Pringle sprin...@wikimedia.org --- Should now be re-fixed back to 512. https://gerrit.wikimedia.org/r/#/c/106254/ Need to monitor for a while to see peak connection usage per user. From that we can pick a sane cut-off. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low on Wikimedia Labs
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #15 from Marc A. Pelletier m...@uberbox.org --- I wish mariadb had a 95th percentile max_connections. /That/ would be useful. :-) -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low on Wikimedia Labs
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 Marc A. Pelletier m...@uberbox.org changed: What|Removed |Added Assignee|m...@uberbox.org|sprin...@wikimedia.org --- Comment #12 from Marc A. Pelletier m...@uberbox.org --- Sean, I agree with the request in principle; given the use patterns it'd be reasonable to up the limit by a few orders of magnitude (just low enough that no single tool can use up everything) so that bursts of activity don't hit the limit. It was set (by hand) to 512 in the past with no issues. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low on Wikimedia Labs
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 MZMcBride b...@mzmcbride.com changed: What|Removed |Added CC||b...@mzmcbride.com Summary|max_user_connections too|max_user_connections too |low |low on Wikimedia Labs -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 Tim Landscheidt t...@tim-landscheidt.de changed: What|Removed |Added Blocks||58798 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 Andrew Bogott abog...@wikimedia.org changed: What|Removed |Added CC||t...@tim-landscheidt.de Component|Infrastructure |tools Assignee|rlan...@gmail.com |m...@uberbox.org -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 Johannes Kroll (WMDE) johannes.kr...@wikimedia.de changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|FIXED |--- --- Comment #11 from Johannes Kroll (WMDE) johannes.kr...@wikimedia.de --- Something must have reset the variable to its default value. But only for some wikis: local-render@tools-login:~$ sql enwiki_p 'show variables like max_user_connections' Variable_nameValue max_user_connections512 local-render@tools-login:~$ sql dewiki_p 'show variables like max_user_connections' Variable_nameValue max_user_connections10 local-render@tools-login:~$ sql frwiki_p 'show variables like max_user_connections' Variable_nameValue max_user_connections10 Can somebody please set it to 512 for all wikis permanently? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #8 from Johannes Kroll (WMDE) johannes.kr...@wikimedia.de --- You need to take into account that the connection limit also affects web requests, and several users might do requests at the same time. The Article List Generator opens several connections, and several programs in the Toolkit as well. We need to be able to have several people use our tools, so the raised limit for render and render-tests isn't really optional. And I am pretty sure it is the same for several other tools. If you don't want to raise the limit for all tools, I suggest you set a default value of, say, 20, and create a simple process to raise the limit per-tool if necessary. In any case, I never requested to raise the limit for all accounts by default, so don't blame us if performance is affected by somebody abusing the new default limit! -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #9 from Johannes Kroll (WMDE) johannes.kr...@wikimedia.de --- In any case, I never requested to raise the limit for all accounts by default *** to something as high as 512 so don't blame us if performance is affected by somebody abusing the new default limit! -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #10 from Marc A. Pelletier m...@uberbox.org --- I put in an arbitrarily high limit so that (a) users are generally not limited in the number of connection but (b) no runaway user can consume all of them. I believe that tools using too many connections is a human problem not a technical one. :-) -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #7 from Asher Feldman afeld...@wikimedia.org --- For the record, I think the new limit of 500 is unwise, and will likely impact performance and availability at times. 50 could be ok, instead of the 10 I originally chose. Any labs project that needs more connections to a single db should probably use mysql proxy with a limited connection pool or something similar. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 Antoine hashar Musso has...@free.fr changed: What|Removed |Added CC||afeld...@wikimedia.org, ||has...@free.fr, ||m...@uberbox.org, ||p...@wikimedia.org --- Comment #1 from Antoine hashar Musso has...@free.fr --- That is hardcoded in puppet: modules/mysql_multi_instance/manifests/instance.pp 'max_user_connections'= 10, Adding in CC a few ops people that edited that file (Peter, Asher and Marc-André). -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872
--- Comment #2 from Antoine hashar Musso has...@free.fr ---
The role::db::labsdb class calls:
mysql_multi_instance::instance { $instances_keys :
instances = $instances
}
mysql_multi_instance::instance should have a new 'max_user_connections'
parameter defaulting to '10' that would let one override it in
role::db::labsdb.
--
You are receiving this mail because:
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 Peter Bena benap...@gmail.com changed: What|Removed |Added Priority|Unprioritized |Normal CC||benap...@gmail.com Blocks||48930 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 Marc A. Pelletier m...@uberbox.org changed: What|Removed |Added Status|NEW |RESOLVED Resolution|--- |FIXED --- Comment #3 from Marc A. Pelletier m...@uberbox.org --- Permament fix in puppet, runtime directive in place (that will last until the next DB restart) -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #4 from Johannes Kroll (WMDE) johannes.kr...@wikimedia.de --- Thanks. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #5 from Antoine hashar Musso has...@free.fr --- Puppet change is https://gerrit.wikimedia.org/r/#/c/69648/ (unmerged right now). -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 49872] max_user_connections too low
https://bugzilla.wikimedia.org/show_bug.cgi?id=49872 --- Comment #6 from Marc A. Pelletier m...@uberbox.org --- Merged. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
