[Pywikipedia-bugs] [Maniphest] [Commented On] T297238: Wikidata edit did not update the langlinks tables on MediaWiki side

2021-12-08 Thread Huji
Huji added a comment. I like that plan. I find it way about my paygrade (of 0 as a volunteer) to implement. TASK DETAIL https://phabricator.wikimedia.org/T297238 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Huji Cc: Ladsgroup, Xqt, Aklapper,

[Pywikipedia-bugs] [Maniphest] [Claimed] T272088: Logging (pywiki module) always verbose if enabled

2021-12-08 Thread maynorc
maynorc claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T272088 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: maynorc Cc: maynorc, AntiCompositeNumber, CONFIQ, Xqt, Aklapper, Inductiveload, pywikibot-bugs-list, Jyoo1011,

[Pywikipedia-bugs] [Maniphest] [Commented On] T297238: Wikidata edit did not update the langlinks tables on MediaWiki side

2021-12-08 Thread Ladsgroup
Ladsgroup added a comment. I can't answer that with 100% certainty but I think it's mostly the organic growth of this part of mediawiki. The only thing to keep in mind is that ParserCache for each page gets evicted after certain time (currently twenty days, seven days for talk pages) and it

[Pywikipedia-bugs] [Maniphest] [Commented On] T297238: Wikidata edit did not update the langlinks tables on MediaWiki side

2021-12-08 Thread Huji
Huji added a comment. I appreciate your explanation. Is there a reason the API should not use ParserCache output? TASK DETAIL https://phabricator.wikimedia.org/T297238 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Huji Cc: Ladsgroup, Xqt,

[Pywikipedia-bugs] [Maniphest] [Commented On] T297238: Wikidata edit did not update the langlinks tables on MediaWiki side

2021-12-08 Thread Ladsgroup
Ladsgroup added a comment. The web sidebar links come from content of ParserCache (which gets reparsed in edit/purge requests) but API (by proxy `langlinks` table) gets updated if purge has its explicit option or on edit. But for most cases, it should work the same and if wikidata purges

[Pywikipedia-bugs] [Maniphest] [Updated] T297238: Wikidata edit did not update the langlinks tables on MediaWiki side

2021-12-08 Thread Huji
Huji added a project: MediaWiki-API. Huji added a comment. In T297238#7556908 , @Ladsgroup wrote: > Three reasons I can think of: > > - Loading an item is heavy and requires a lot of network bandwith inside the dc. Plus it would put

[Pywikipedia-bugs] [Maniphest] [Commented On] T297238: Wikidata edit did not update the langlinks tables on MediaWiki side

2021-12-08 Thread Ladsgroup
Ladsgroup added a comment. Three reasons I can think of: - Loading an item is heavy and requires a lot of network bandwith inside the dc. Plus it would put a lot of pressure on memcached and databases. See this as a cache layer - Client wikis need to override those entries (sometimes)

[Pywikipedia-bugs] [Maniphest] [Commented On] T297238: Wikidata edit did not update the langlinks tables on MediaWiki side

2021-12-08 Thread Huji
Huji added a comment. Potentially dumb question: is there a reason MediaWiki's API uses its own `langlinks` table (rather than Wikidata) as the data source? The wiki pages themselves show the interwiki links based on Wikidata; why doesn't the API use the same source? TASK DETAIL

[Pywikipedia-bugs] [Maniphest] [Updated] T297238: Wikidata edit did not update the langlinks tables on MediaWiki side

2021-12-08 Thread Ladsgroup
Ladsgroup added a comment. Since I'm pinged. Yes. This is sorta expected and due to CAP theorem . The more we become distributed and scale, the discrepancy gets bigger, jobs that trigger the refresh might fail. Might not get queued (used to be 1%

[Pywikipedia-bugs] [Maniphest] [Commented On] T296371: Move pywikibot tests from Travis to Github action

2021-12-08 Thread Dalba
Dalba added a comment. Hi @Xqt, Do you have access to `pywikibot` account on toolforge? (according to https://admin.toolforge.org/tool/pywikibot you do) The password for `Pywikibot-test` is stored in a file named `passwd` which only toolforge account maintainers can read. TASK DETAIL

[Pywikipedia-bugs] [Maniphest] [Updated] T110925: Run macOS builds on CI

2021-12-08 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T110925 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: Xqt, Dvorapa, gerritbot, jayvdb, Aklapper, pywikibot-bugs-list, XZise, 786, Suran38,

[Pywikipedia-bugs] [Maniphest] [Commented On] T110925: Run macOS builds on CI

2021-12-08 Thread gerritbot
gerritbot added a comment. Change 745214 had a related patch set uploaded (by Xqt; author: Xqt): [pywikibot/core@master] [tests] Add macOS to github test matrix https://gerrit.wikimedia.org/r/745214 TASK DETAIL https://phabricator.wikimedia.org/T110925 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Closed] T282962: ui_tests are failing on Travis

2021-12-08 Thread Xqt
Xqt closed this task as "Resolved". Xqt claimed this task. Xqt added a comment. Seems this is solved aleready. Anyway we have no travis tests anymore- TASK DETAIL https://phabricator.wikimedia.org/T282962 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Unblock] T129368: Usages of unittest.expectedFailure should be solved (goal)

2021-12-08 Thread Xqt
Xqt closed subtask T282962: ui_tests are failing on Travis as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T129368 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Xqt Cc: Dvorapa, Mpaa, gerritbot, valhallasw, jayvdb, Aklapper, Xqt,

[Pywikipedia-bugs] [Maniphest] [Commented On] T272088: Logging (pywiki module) always verbose if enabled

2021-12-08 Thread Xqt
Xqt added a comment. In T272088#7551453 , @maynorc wrote: >> 'pywiki' logger will be initialized to level 11 and there is no easy way to change that > > Python's `logging` module offers a lot of options

[Pywikipedia-bugs] [Maniphest] [Closed] T186323: Travis and Appveyor: Major improvement to test time

2021-12-08 Thread Xqt
Xqt closed this task as "Resolved". Xqt claimed this task. Xqt added a comment. Moving from Travis to Github actions improves test times a lot. Github needs less then one hour whereas travis needs 5 hours. Closing then. TASK DETAIL https://phabricator.wikimedia.org/T186323 EMAIL

[Pywikipedia-bugs] [Maniphest] [Unblock] T152961: Improve tests suite

2021-12-08 Thread Xqt
Xqt closed subtask T186323: Travis and Appveyor: Major improvement to test time as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T152961 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Xqt Cc: Aklapper, pywikibot-bugs-list, Magul,

[Pywikipedia-bugs] [Maniphest] [Changed Subscribers] T296371: Move pywikibot tests from Travis to Github action

2021-12-08 Thread Xqt
Xqt added subscribers: Dalba, Dvorapa, Mpaa, jayvdb, Ladsgroup, valhallasw. Xqt added a comment. I've migrated most tests from tests to github but I have no access to the Pywikibot-test* user accounts. Their passwords must be added as github secrets:

[Pywikipedia-bugs] [Maniphest] [Updated] T296371: Move pywikibot tests from Travis to Github action

2021-12-08 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T296371 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: Rubin16, Aklapper, pywikibot-bugs-list, mdipietro, dcaro, RhinosF1, Legoktm, Xqt, 786,

[Pywikipedia-bugs] [Maniphest] [Commented On] T296371: Move pywikibot tests from Travis to Github action

2021-12-08 Thread gerritbot
gerritbot added a comment. Change 745195 had a related patch set uploaded (by Xqt; author: Xqt): [pywikibot/core@master] [tests] Add wpbeta and wsbeta to test matrix https://gerrit.wikimedia.org/r/745195 TASK DETAIL https://phabricator.wikimedia.org/T296371 EMAIL PREFERENCES