[Bug 56041] updateCollation.php script prohibitively slow for very large wikis
https://bugzilla.wikimedia.org/show_bug.cgi?id=56041 Bartosz Dziewoński changed: What|Removed |Added Summary|updateCollation.php script |updateCollation.php script |prohibitively slow |prohibitively slow for very ||large wikis -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56041] updateCollation.php script prohibitively slow
https://bugzilla.wikimedia.org/show_bug.cgi?id=56041 Gerrit Notification Bot changed: What|Removed |Added Status|NEW |PATCH_TO_REVIEW -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56041] updateCollation.php script prohibitively slow
https://bugzilla.wikimedia.org/show_bug.cgi?id=56041 --- Comment #3 from Gerrit Notification Bot --- Change 106162 had a related patch set uploaded by Reedy: Make SELECT queries against slaves in updateCollation.php https://gerrit.wikimedia.org/r/106162 -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56041] updateCollation.php script prohibitively slow
https://bugzilla.wikimedia.org/show_bug.cgi?id=56041 Bartosz Dziewoński changed: What|Removed |Added Blocks||45443 -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56041] updateCollation.php script prohibitively slow
https://bugzilla.wikimedia.org/show_bug.cgi?id=56041 --- Comment #2 from Tim Starling --- Reedy: could UpdateCollation do reads from a slave? Couldn't see why not... We've got the wfWaitForSlave() calls in anyway, so they should be up to date for when we do the next select() TimStarling might have some input too the select is too slow? yes. does a large filesort. innodb buffer pool gets out of whack pulling on old data, other writes pile up, then swap starts and everything crawls, then max_connections I suppose it would work, as long as the slave is guaranteed to have no open snapshot trying without adaptive hash latch now, but not convinced that's a core issue -- 5.5 already has some fo the old related bugs fixed maybe it could use a $dbr->commit() before the select to be on the safe side the select does ORDER BY cl_to, cl_type, cl_from .. is that definitely needed? springle: yes, see https://gerrit.wikimedia.org/r/#/c/53301/ ok -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56041] updateCollation.php script prohibitively slow
https://bugzilla.wikimedia.org/show_bug.cgi?id=56041 --- Comment #1 from Bawolff (Brian Wolff) --- My guess would be that the icu algorithm is slow, and that is the bottleneck. (Possibly uca-fr is even slower than normal icu as it has to do special things with accents in that language). However that is pure speculation. We should do profiling to figure out where the bottleneck really is. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56041] updateCollation.php script prohibitively slow
https://bugzilla.wikimedia.org/show_bug.cgi?id=56041 Bartosz Dziewoński changed: What|Removed |Added Keywords||performance -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 56041] updateCollation.php script prohibitively slow
https://bugzilla.wikimedia.org/show_bug.cgi?id=56041 Bartosz Dziewoński changed: What|Removed |Added Priority|Unprioritized |Normal CC||matma@gmail.com -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l