[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #30 from Niklas Laxström --- I'm sorry but responding to your questions which are spread out like been shot with shotgun requires me to explain you how Translate works and the place for that is not here. I'll repeat, we need to be able to debug this issue interactively or a very bright person. Currently we don't have either. To answer your questions very briefly: yes, yes, not a question, no such thing as DB happiness. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #29 from Nemo --- (In reply to Niklas Laxström from comment #26) > Or, we could have some bright person (Not me... But one can try.) > read the code and find the cause. I > have spent hours on that without success. In case anyone is interested, have > a look at TranslatablePageRenderJob.php. Line 52 there is a call to > TPParse::getTranslationPageText(). That method calls on line 182 > MessageCollection::loadTranslations( DB_MASTER ), which should, in my > opinion, see the latest version, but apparently it does not. Isn't it possible to use some logging? For instance: * do we know from the logs if the exception "Oops, this should not happen!" is thrown; * the function is passed the result of initCollection() which reads from MessageGroupCache, can't something go wrong there; * in MessageCollection, loadTranslations() calls some functions to which DB_MASTER is passed, but initMessages() doesn't even tell whether it did something or not, it passes if $messages is already defined (from where?) and otherwise does $messages = array(); $definitions = $this->definitions->getDefinitions(); > This all is > executed in a subscriber to hook PageContentSaveComplete. The same hook is attached to run addReadyTag() which inserts in revtag table, is the DB happy about that? -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #28 from Philippe Verdy --- My opinion is that updates performed by the tool have been commited but still not propagated to the slave DB, they are still pending final commit, which will occur only at end of the scripts, but scripts are still not terminated, and then later another part attempts to read the database but just sees the pre-image at start of the transaction and not any updates made in it. All pending updates are invisible. It seems that something is mising to really terminate the commits and cancel the preimage cache in the DB client plugin. Or that the further actions made "FuzzyBot" (update statistics, generate pages) should not attempt ot initate a separate transaction which cannot see the content of an uncommited transaction performed in a early parallel job. The bug occurs everywhere on Wikimedia sites using the translation extension, and it seemsto be related to the server farm infrastructure with its proxies and coordination/synchronization mechanisms. Visibly the developers of this tool (testing it in a single server like translatewiki.net) have not understood the differences about what happens in the Wikimedia servers farm (or these differences are not clearly documented about how preimages/postimages can be synchronized or about how to control the usage of intermediate caches and how transactions are propagated between them). The Wikimedia farm is highly optimized locally to use several layers of caches to save many internal requests on its databases. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #27 from Nemo --- Created attachment 17113 --> https://bugzilla.wikimedia.org/attachment.cgi?id=17113&action=edit ack DB_SLAVE Should said person start looking into DB_SLAVE usages or would that be fruitless? -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #26 from Niklas Laxström --- What would really help here is to way to reproduce the issue in a development environment. There was an attempt to build such environment at labs, but it was never finished to the extent that this bug could be observed there. The environment didn't survive some updates and needs to be recreated. Or, we could have some bright person read the code and find the cause. I have spent hours on that without success. In case anyone is interested, have a look at TranslatablePageRenderJob.php. Line 52 there is a call to TPParse::getTranslationPageText(). That method calls on line 182 MessageCollection::loadTranslations( DB_MASTER ), which should, in my opinion, see the latest version, but apparently it does not. This all is executed in a subscriber to hook PageContentSaveComplete. JobQueue is not involved in this. There is also no separate FuzzyBot entity. It's just an username used by different parts of Translate extension for different purposes. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Niklas Laxström changed: What|Removed |Added Status|REOPENED|NEW CC||alolita.sha...@gmail.com, ||dc...@wikimedia.org, ||jsahl...@wikimedia.org Component|General/Unknown |Translate Version|unspecified |master Product|Wikimedia |MediaWiki extensions -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Steinsplitter changed: What|Removed |Added Component|Translate |General/Unknown Product|MediaWiki extensions|Wikimedia --- Comment #25 from Steinsplitter --- Changing product to wikimedia. Seems something which affects only the MW cluster and not other wikis. Every version is exactly one version outdated. Maye something wrong with the configuration. fuzzybot edits are done via jobqueue. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #24 from Steinsplitter --- This affects ten thousands of pages. A lot of uses are complaining because pages are outdated. This should be fixed as soon as possible -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Andre Klapper changed: What|Removed |Added Priority|High|Normal --- Comment #23 from Andre Klapper --- Priorities are defined by developers, hence reverting from "high" to "normal". -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #22 from Philippe Verdy --- Note: this bug has been reported since long, explained many times (with the workaround), it has NEVER been resolved (unlike what the resolution above indicates) and it has always been a high priority for this extension because it irritates everyone and is ALWAYS reproduced for EVERY new translation added : pages are NEVER synchronized without using TWO additional dummy edits with a new "mark for translation" applied after each of them (dummy edit: adding/removing a space without visible effect suc has the sapce between "" in the translation source page), but NOT with a null edit (edit and save without change; applying a dummy edit in a translation unit by clicking it again, inserting and removing space and reapplyinhg it generally works but only for one language, the current translation language target). This is clearly a bug of "FuzzyBot" that uses an incorrect cached version of translation units (the version which was there just before the saved change) when generating pages or refreshing statistics. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Philippe Verdy changed: What|Removed |Added Priority|Normal |High -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Philippe Verdy changed: What|Removed |Added CC||verd...@wanadoo.fr --- Comment #21 from Philippe Verdy --- This is very irritating, although the last Tech News were FULLY translated to French last week, and even VALIDATED with 100% status displayed, it was delivered missing one translation unit because it has an INCORRECT status (needing update, which was done with a null edit to confirm it) even though there was NOTHING to change in the translation. But for some unknown reason the generated page was reflecting the old version without this transaltion unit (so it displayed just English), and that version was then the one that was posted to Tech News subscribers (the admin that manages this newsletter reguarly forgets to check the effective status of pages by performing two edits (the last one being a dummy null update) on the main page. Lack of synchronization is really a problem (and causes lot of time being lost, including from transltors themselves or translate admins as they all constantly need to use the dummy edit workaround, and this workaround is frequently forgotten) -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #20 from Nemo --- Let's see how much previous translation admin time we're wasting by requiring basically every single "mark for translation" action to be done twice, with a dummy edit in between. This catches many such edits (but possibly not the majority), with nearly no false positives, by looking for common edit summaries: SELECT count(rev_id) FROM revision JOIN logging ON rev_page = log_page AND log_type = 'pagetranslation' WHERE rev_comment RLIKE '.*(null|dummy|trigger|propagate|46716).*'; +---+ | count(rev_id) | +---+ | 5489 | +---+ 1 row in set (9.32 sec) MariaDB [metawiki_p]> +---+ | count(rev_id) | +---+ | 959 | +---+ 1 row in set (4.17 sec) MariaDB [mediawikiwiki_p]> +---+ | count(rev_id) | +---+ | 284 | +---+ 1 row in set (2.40 sec) MariaDB [commonswiki_p]> Not amusing. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Steinsplitter changed: What|Removed |Added Priority|Low |Normal CC||steinsplit...@wikipedia.de --- Comment #19 from Steinsplitter --- It is a problem that FuzzyBot didn't sync language subpages with the (newly) marked translatable page. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Niklas Laxström changed: What|Removed |Added Assignee|niklas.laxst...@gmail.com |wikibugs-l@lists.wikimedia. ||org --- Comment #18 from Niklas Laxström --- Nemo, thanks for this info. It will help to prioritize this bug. Unassigning myself for now since I am not currently working on this. -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #17 from Nemo --- I just run touch.py on all mediawiki.org "Translations" pages, about 70k total: over 5.5k updates were made, meaning almost 10 % of translation units were not reflected on the corresponding translation pages. This proves the bug happens systematically. refresh-translatable-pages.php should be run on all wikis. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Nemo changed: What|Removed |Added See Also||https://bugzilla.wikimedia. ||org/show_bug.cgi?id=61353 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Nemo changed: What|Removed |Added See Also||https://bugzilla.wikimedia. ||org/show_bug.cgi?id=54579 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #16 from Nemo --- In this case, FuzzyBot didn't sync language subpages with the (newly) marked translatable page, but it was convinced to do so by a dummy edit + remark. No idea if it's the same issue. https://www.mediawiki.org/w/index.php?title=Special:Contributions/FuzzyBot&dir=prev&offset=20140217090916&limit=25&target=FuzzyBot -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Nemo changed: What|Removed |Added See Also||https://bugzilla.wikimedia. ||org/show_bug.cgi?id=54915 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Tilman Bayer changed: What|Removed |Added See Also||https://bugzilla.wikimedia. ||org/show_bug.cgi?id=53343 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Tilman Bayer changed: What|Removed |Added See Also||https://bugzilla.wikimedia. ||org/show_bug.cgi?id=51731 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Nemo changed: What|Removed |Added Priority|High|Low --- Comment #15 from Nemo --- AFAICS, no work is planned on this before bug 38945 is solved; parifying priority. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Nemo changed: What|Removed |Added See Also||https://bugzilla.wikimedia. ||org/show_bug.cgi?id=48971 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #14 from Nemo --- Could the rebuild script be rerun to see which and how many translations were not reflected on translation pages? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Purodha Blissenbach changed: What|Removed |Added CC||bugzilla.wikime...@publi.pu ||rodha.net --- Comment #13 from Purodha Blissenbach --- Maybe, I am experienceing the same with page http://www.wikidata.org/wiki/Wikidata:About/ksh where the main content of the upper box at the right edge appears in English although a translation should exist. Yet, I had to try to save the translation several times due to (mostly) unreported errors resulting from a shaky wireless internet connection - saving took forever. See also Bug 48773, Comment 4. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 --- Comment #12 from Niklas Laxström --- I just reproduced it here: http://www.wikidata.org/wiki/Wikidata:List_of_properties/Person/fi The last translation was not visible until my maintenance script updated it a bit later. The statistics are still wrong at 67%. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Nemo changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|FIXED |--- --- Comment #11 from Nemo --- Niklas reproduced it: https://www.wikidata.org/w/index.php?title=Translations:Wikidata:List_of_properties/Person/132/fi&oldid=37050275 Forgotten for some minutes then something triggered FuzzyBot: https://www.wikidata.org/w/index.php?title=Wikidata%3AList_of_properties%2FPerson%2Ffi&diff=37053242&oldid=37050334 The translation before the "forgotten" one took a minute to arrive on translation page: https://www.wikidata.org/w/index.php?title=Special:Contributions/Nikerabbit&dir=prev&offset=20130507093549&limit=3&target=Nikerabbit -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 46716] Translation page does not contain the latest translations/last translation
https://bugzilla.wikimedia.org/show_bug.cgi?id=46716 Nemo changed: What|Removed |Added Summary|Translation page does not |Translation page does not |contain the latest |contain the latest |translations|translations/last ||translation -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
