[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

Dvorapa added a comment. In T181443#5909015 , @TheSandDoctor wrote: > Also: thanks for switching it to a catchable exception! :) Yeah, the error should be now better. > @Dvorapa But what would cause it to return it then when

[Pywikipedia-bugs] [Maniphest] [Commented On] T245915: enum34 1.1.8 does not work correctly

gerritbot added a comment. Change 574157 **merged** by jenkins-bot: [pywikibot/core@master] Don't use enum34 1.1.8 https://gerrit.wikimedia.org/r/574157 TASK DETAIL https://phabricator.wikimedia.org/T245915 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Created] T245915: enum34 1.1.8 does not work correctly

Dvorapa created this task. Dvorapa added projects: Pywikibot, Upstream. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. TASK DESCRIPTION https://bitbucket.org/stoneleaf/enum34/issues/27/enum34-118-broken TASK DETAIL https://phabricator.wikimedia.org/T245915 EMAIL

[Pywikipedia-bugs] [Maniphest] [Closed] T245915: enum34 1.1.8 does not work correctly

Xqt triaged this task as "High" priority. Xqt assigned this task to Dvorapa. Xqt closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T245915 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa, Xqt Cc: Aklapper,

[Pywikipedia-bugs] [Maniphest] [Commented On] T245915: enum34 1.1.8 does not work correctly

gerritbot added a comment. Change 574157 had a related patch set uploaded (by Dvorapa; owner: Dvorapa): [pywikibot/core@master] Don't use enum34 1.1.8 https://gerrit.wikimedia.org/r/574157 TASK DETAIL https://phabricator.wikimedia.org/T245915 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Updated] T245915: enum34 1.1.8 does not work correctly

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T245915 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: Aklapper, pywikibot-bugs-list, Dvorapa, Beast1978, Un1tY, Zkhalido, Hook696, Daryl-TTMG,

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

gerritbot added a comment. Change 574111 **merged** by jenkins-bot: [pywikibot/core@master] [bugfix] Raise InvalidTitle for title containing illegal char https://gerrit.wikimedia.org/r/574111 TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

TheSandDoctor added a comment. @Dvorapa Just trying to create a file page reference given a name of a file from recent changes. Here is the error log . The line that causes the problem is `file_page = pywikibot.FilePage(site,

[Pywikipedia-bugs] [Maniphest] [Changed Status] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

Dvorapa changed the task status from "Open" to "Stalled". Dvorapa added a comment. @Fructibus @TheSandDoctor Anything else we could fix in Pywikibot? TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

Dvorapa added a comment. I don't understand it either. Could you find out, which file makes this (or is it for random files?) and also tell me, which wiki do you check? (Commons?) TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Updated] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa, Maintenance_bot Cc: Dvorapa, zhuyifei1999, TheSandDoctor, Mpaa, Aklapper,

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

Dvorapa added a comment. I'm sorry, I don't understand, what your script does and how. There should be no title in commons with that character and if there are links to a page with that character, the freshly called InvalidTitle error should be always checked in scripts. So what else

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

TheSandDoctor added a comment. @Dvorapa grabs the file from recent changes using site_rc_listener and then sends it to the other script for processing. site_rc_listener is what must be giving

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

TheSandDoctor added a comment. @Dvorapa Commons. The issue appears to happen at random. I have improved the ordering of my logs so next time it happens it should //hopefully// actually tell me the issue. Given that the files are only run from recent changes if they are new uploads, this

[Pywikipedia-bugs] [Maniphest] [Updated] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

Urbanecm edited projects, added Core Platform Team Workboards (Clinic Duty Team); removed Core Platform Team. TASK DETAIL https://phabricator.wikimedia.org/T130381 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Urbanecm Cc: Urbanecm, Dvorapa,

[Pywikipedia-bugs] [Maniphest] [Commented On] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

Urbanecm added a comment. I've uploaded a patch that should make InterwikiMap to not add language parameter when wgInterwikiMagic=false. TASK DETAIL https://phabricator.wikimedia.org/T130381 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Pywikipedia-bugs] [Maniphest] [Updated] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T130381 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: Dvorapa, gerritbot, Aklapper, pywikibot-bugs-list, jayvdb, Beast1978, Un1tY, Zkhalido,

[Pywikipedia-bugs] [Maniphest] [Commented On] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

gerritbot added a comment. Change 574201 had a related patch set uploaded (by Urbanecm; owner: Urbanecm): [mediawiki/core@master] [api] InterwikiMap shouldn't report any interwikis as language ones when InterwikiMagic=false https://gerrit.wikimedia.org/r/574201 TASK DETAIL

[Pywikipedia-bugs] [Maniphest] [Updated] T243669: Travis fails on generate_family_files_tests.TestGenerateFamilyFiles

Dvorapa added a subtask: T130381: wiki.musicbrainz.org has started reporting multiple languages. TASK DETAIL https://phabricator.wikimedia.org/T243669 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Aklapper, pywikibot-bugs-list,

[Pywikipedia-bugs] [Maniphest] [Updated] T130381: wiki.musicbrainz.org has started reporting multiple languages

Dvorapa added a parent task: T243669: Travis fails on generate_family_files_tests.TestGenerateFamilyFiles. TASK DETAIL https://phabricator.wikimedia.org/T130381 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Urbanecm, Dvorapa,

[Pywikipedia-bugs] [Maniphest] [Updated] T243669: Travis fails on generate_family_files_tests.TestGenerateFamilyFiles

Dvorapa added a subtask: T245917: Beta Cluster Wikisource contains invalid interwikis. TASK DETAIL https://phabricator.wikimedia.org/T243669 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Aklapper, pywikibot-bugs-list, Dvorapa,

[Pywikipedia-bugs] [Maniphest] [Updated] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

Dvorapa added a project: MediaWiki-API. Dvorapa added a comment. Restricted Application added a project: Core Platform Team. It seems action=query=siteinfo=interwikimap automatically considers `ab` interwiki as Abkhazian language interwiki for acousticbrainz.org/$1 and `lb` as Luxembourgish

[Pywikipedia-bugs] [Maniphest] [Retitled] T130381: wiki.musicbrainz.org has started reporting multiple languages

Dvorapa renamed this task from "generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages" to "wiki.musicbrainz.org has started reporting multiple languages". TASK DETAIL https://phabricator.wikimedia.org/T130381 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Updated] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

Urbanecm removed projects: Core Platform Team Workboards (Clinic Duty Team), Patch-For-Review, MediaWiki-API. Urbanecm added a comment. This problem is PWB-specific, untagging MediaWiki from this. The MW side of the problem moved to T245931 . TASK

[Pywikipedia-bugs] [Maniphest] [Updated] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

Urbanecm added a subtask: T245931: interwiki map API shouldn't add language parameter when InterwikiMagic is false. TASK DETAIL https://phabricator.wikimedia.org/T130381 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Urbanecm Cc: Urbanecm, Dvorapa,

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

Dvorapa added a comment. Now we need to know, why is this happening, because I don't feel like there are so many new files in Commons with this character TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

zhuyifei1999 added a comment. What is the traceback? Any minimal reproducible test case (even if it takes a long time to reproduce that's still something)? TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Commented On] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

Dvorapa added a comment. Asked in the MusicBrainz bug tracker , but I feel like this isn't their fault. Is this even configurable in MediaWiki, that ab is not Abkhazian MusicBrainz wiki, but AcousticBrainz website? TASK DETAIL

[Pywikipedia-bugs] [Maniphest] [Commented On] T130381: generate_family_file for wiki.musicbrainz.org has started reporting that multiple languages

Dvorapa added a comment. $wgInterwikiMagic=false seems to be ignored by API TASK DETAIL https://phabricator.wikimedia.org/T130381 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Dvorapa, gerritbot, Aklapper, pywikibot-bugs-list,

[Pywikipedia-bugs] [Maniphest] [Commented On] T199643: Generate a new CSRF token if the old one is invalidated

Dvorapa added a comment. We should use action=checktoken for a token validation, but I'm not sure, where to put this check. It needs to check before every write/relogin action I think TASK DETAIL https://phabricator.wikimedia.org/T199643 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

TheSandDoctor added a comment. @zhuyifei1999 Unknown at this point. Implemented and running alongside it now. If either crashes will report back here. TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

TheSandDoctor added a comment. @zhuyifei1999 The only log currently available is as follows (and linked above): 2020-02-18 18:45:16,662 __main__: INFO File:PICT0430 - 301032 - onroerenderfgoed.jpg :Not corrupt. Stored Traceback (most recent call last): File

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

zhuyifei1999 added a comment. > rcworker.py would just be reduced to a few lines Is redis queue critical to reproducing the issue? If not, that is an extra layer of complexity and a minimal reproducible test case does not need that. TASK DETAIL