[Pywikipedia-bugs] [Maniphest] [Commented On] T247095: Is it possible to download smaller than full res image using Pywikibot?

2023-06-02 Thread TheSandDoctor
TheSandDoctor added a comment. Thank you @Xqt ! I'd admittedly forgotten about this request but am glad that the feature has been added. TASK DETAIL https://phabricator.wikimedia.org/T247095 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Xqt

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2021-11-03 Thread TheSandDoctor
TheSandDoctor added a comment. @zhuyifei1999 any word? TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: zhuyifei1999, TheSandDoctor Cc: Count_Count, Dvorapa, zhuyifei1999, TheSandDoctor, Mpaa

[Pywikipedia-bugs] [Maniphest] [Commented On] T85656: Pywikibot to detect and correctly handle edits that trigger abusefilter rules

2021-04-17 Thread TheSandDoctor
TheSandDoctor added a comment. This seems to have stalled. It is currently an issue I am running into as well that is preventing my bot from doing its job on commons. TASK DETAIL https://phabricator.wikimedia.org/T85656 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-09-12 Thread TheSandDoctor
TheSandDoctor added a comment. Thanks @zhuyifei1999 ! Have you been able to work on this any? TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: zhuyifei1999, TheSandDoctor Cc: Count_Count

[Pywikipedia-bugs] [Maniphest] [Commented On] T249392: Pywikibot add isLocked() function

2020-04-03 Thread TheSandDoctor
TheSandDoctor added a comment. The "vanilla" requests code that would accomplish this (using the same format as API:Users) is: import requests S = requests.Session() URL = "https://en.wikipedia.org/w/api.php; PARAMS = { &

[Pywikipedia-bugs] [Maniphest] [Updated] T249392: Pywikibot add isLocked() function

2020-04-03 Thread TheSandDoctor
TheSandDoctor added a project: MediaWiki-extensions-CentralAuth. TASK DETAIL https://phabricator.wikimedia.org/T249392 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: Aklapper, TheSandDoctor, pywikibot-bugs-list, Zkhalido, Viztor

[Pywikipedia-bugs] [Maniphest] [Unassigned] T249392: Pywikibot add isLocked() function

2020-04-03 Thread TheSandDoctor
TheSandDoctor removed TheSandDoctor as the assignee of this task. TASK DETAIL https://phabricator.wikimedia.org/T249392 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: Aklapper, TheSandDoctor, pywikibot-bugs-list, Zkhalido, Viztor

[Pywikipedia-bugs] [Maniphest] [Claimed] T249392: Pywikibot add isLocked() function

2020-04-03 Thread TheSandDoctor
TheSandDoctor claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T249392 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: Aklapper, TheSandDoctor, pywikibot-bugs-list, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont

[Pywikipedia-bugs] [Maniphest] [Updated] T249392: Pywikibot add isLocked() function

2020-04-03 Thread TheSandDoctor
TheSandDoctor changed the subtype of this task from "Task" to "Feature Request". TASK DETAIL https://phabricator.wikimedia.org/T249392 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: Aklapper, TheSandDoctor,

[Pywikipedia-bugs] [Maniphest] [Created] T249392: Pywikibot add isLocked() function

2020-04-03 Thread TheSandDoctor
TheSandDoctor created this task. TheSandDoctor added a project: Pywikibot. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. TASK DESCRIPTION pywikibot's user object should have a function to check if an account is currently locked. I would envision this working almost

[Pywikipedia-bugs] [Maniphest] [Created] T247718: Update Manual:Pywikibot/login.py to remove use of sysopnames

2020-03-15 Thread TheSandDoctor
TheSandDoctor created this task. TheSandDoctor added a project: Pywikibot-Documentation. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. Restricted Application added a project: Pywikibot. TASK DESCRIPTION /Library/Frameworks/Python.framework/Versions/3.8/lib

[Pywikipedia-bugs] [Maniphest] [Commented On] T247447: Pywikibot eventstreams.py 504 Server Error: Gateway Timeout

2020-03-11 Thread TheSandDoctor
TheSandDoctor added a comment. I am using the latest sseclient. I assume that it isn't "real" as event streams shouldn't be 504ing constantly? That wouldn't make sense & would mean that recent changes should be broken etc? This script is connecting to it throu

[Pywikipedia-bugs] [Maniphest] [Commented On] T247447: Pywikibot eventstreams.py 504 Server Error: Gateway Timeout

2020-03-11 Thread TheSandDoctor
TheSandDoctor added a comment. This is happening only a few seconds after I start the script. TASK DETAIL https://phabricator.wikimedia.org/T247447 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: Dvorapa, zhuyifei1999, Aklapper

[Pywikipedia-bugs] [Maniphest] [Created] T247447: Pywikibot eventstreams.py 504 Server Error: Gateway Timeout

2020-03-11 Thread TheSandDoctor
TheSandDoctor created this task. TheSandDoctor added a project: Pywikibot. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. TASK DESCRIPTION I did not encounter this previously and have made no substantial code changes, but by only script hooked into the event stream

[Pywikipedia-bugs] [Maniphest] [Closed] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-03-11 Thread TheSandDoctor
TheSandDoctor closed this task as "Resolved". TheSandDoctor added a comment. Going to resolve this then, given that it appears unavoidable. At least now that it throughs an exception, it can be handled (ie skip to the next item in the queue). TASK DETAIL https://phabricator.wik

[Pywikipedia-bugs] [Maniphest] [Edited] T247095: Is it possible to download smaller than full res image using Pywikibot?

2020-03-06 Thread TheSandDoctor
TheSandDoctor updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T247095 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: Aklapper, TheSandDoctor, pywikibot-bugs-list, Zkhalido, Viztor, Wenyi, Tbscho, MayS

[Pywikipedia-bugs] [Maniphest] [Edited] T247095: Is it possible to download smaller than full res image using Pywikibot?

2020-03-06 Thread TheSandDoctor
TheSandDoctor updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T247095 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: Aklapper, TheSandDoctor, pywikibot-bugs-list, Zkhalido, Viztor, Wenyi, Tbscho, MayS

[Pywikipedia-bugs] [Maniphest] [Created] T247095: Is it possible to download smaller than full res image using Pywikibot?

2020-03-06 Thread TheSandDoctor
TheSandDoctor created this task. TheSandDoctor added a project: Pywikibot. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. TASK DESCRIPTION Is it possible to download smaller than full res image using Pywikibot? Downloading a smaller file size would probably help

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-03-01 Thread TheSandDoctor
TheSandDoctor added a comment. I just discovered that rcwatcher.py crashed at some point within the past couple of days. Interesting. Traceback (most recent call last): File "rcwatcher.py", line 65, in main() File "rcwatcher.py&quo

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-28 Thread TheSandDoctor
TheSandDoctor added a comment. In T181443#5927865 <https://phabricator.wikimedia.org/T181443#5927865>, @zhuyifei1999 wrote: > Whichever is simplest. That would be test_rc.py <https://github.com/TheSandDoctor/Commons-image-corruption-detector/blob/master/test_rc.py>

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-28 Thread TheSandDoctor
TheSandDoctor added a comment. In T181443#5927759 <https://phabricator.wikimedia.org/T181443#5927759>, @zhuyifei1999 wrote: > I will be running the script with pdb + save all sseclient trace over the weekend. Running test_rc.py, right? TASK DETAI

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-28 Thread TheSandDoctor
TheSandDoctor added a comment. @Dvorapa I saw that myself & just updated my above comment prior to seeing your response. It appears to have slipped through, will have to add a catch for that. Others still relevant though. In T181443#5927703 <https://phabricator.wikimedia.org/

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-28 Thread TheSandDoctor
TheSandDoctor added a comment. Since updating to the latest master version of sseclient (post-fix merges) more of the workers crashed than usual (4 of the 5). 3 of the 4 crashes were due to the same issue and the 4th was: 2020-02-27 23:07:01,324 __main__: DEBUG None 2020-02-27

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-25 Thread TheSandDoctor
TheSandDoctor added a comment. @zhuyifei1999 requests has been updated & the workers/feeder all restarted. I have re-started test_rc.py and will post back here if anything crashes. If it is good in a few days/week or something like that I think we could consider this resolved. Th

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-25 Thread TheSandDoctor
TheSandDoctor added a comment. @zhuyifei1999 Yes, first and third are two separate customers. The first and second are working with the same customer. The third (code <https://github.com/TheSandDoctor/Commons-image-corruption-detector/blob/df6f8e2385cfc063453bee2083bb7089fdba87fb/test_rc

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-25 Thread TheSandDoctor
TheSandDoctor added a comment. @zhuyifei1999 the first and second traceback are from "production" worker instances and pop items off of the same redis queue (all fed by a single instance of rcwatcher.py), thus they wouldn't get the same image. So it isn't feasible that they would

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-25 Thread TheSandDoctor
TheSandDoctor added a comment. 2020-02-22 20:02:20 TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa, TheSandDoctor Cc: Dvorapa, zhuyifei1999, TheSandDoctor, Mpaa, Aklapper, pywikibot

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-25 Thread TheSandDoctor
TheSandDoctor added a comment. In T181443#5915796 <https://phabricator.wikimedia.org/T181443#5915796>, @Dvorapa wrote: > Also, what is the output of `echo $LC_CTYPE` and `echo $LANG`? Weird is this happens only for some letters. I can not reproduce it on my machine. If

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-25 Thread TheSandDoctor
TheSandDoctor added a comment. @Dvorapa python 3 TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa, TheSandDoctor Cc: Dvorapa, zhuyifei1999, TheSandDoctor, Mpaa, Aklapper, pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-25 Thread TheSandDoctor
TheSandDoctor added a comment. @zhuyifei1999 Oops, thought I had. see here <https://github.com/TheSandDoctor/Commons-image-corruption-detector/blob/master/test_rc.py> TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-24 Thread TheSandDoctor
TheSandDoctor added a comment. @zhuyifei1999 For both of these worth noting that I have //not// updated the the latest version with the change in behaviour that this task merged. From a normal worker: 2020-02-24 08:42:16,590 __main__: INFO File:�রপক্ষ মন্দির থেকে ভক্তদের বের

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-22 Thread TheSandDoctor
TheSandDoctor added a comment. @zhuyifei1999 Unknown at this point. Implemented and running alongside it now. If either crashes will report back here. TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-22 Thread TheSandDoctor
TheSandDoctor added a comment. @zhuyifei1999 The only log currently available is as follows (and linked above): 2020-02-18 18:45:16,662 __main__: INFO File:PICT0430 - 301032 - onroerenderfgoed.jpg :Not corrupt. Stored Traceback (most recent call last): File "rcwork

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-22 Thread TheSandDoctor
TheSandDoctor added a comment. @Dvorapa Commons. The issue appears to happen at random. I have improved the ordering of my logs so next time it happens it should //hopefully// actually tell me the issue. Given that the files are only run from recent changes if they are new uploads

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-22 Thread TheSandDoctor
TheSandDoctor added a comment. @Dvorapa grabs the file from recent changes using site_rc_listener <https://github.com/TheSandDoctor/Commons-image-corruption-detector/blob/master/rcwatcher.py#L50> and then sends it to the other script for processing. site_rc_listener is what must be

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-22 Thread TheSandDoctor
TheSandDoctor added a comment. @Dvorapa Just trying to create a file page reference given a name of a file from recent changes. Here is the error log <https://phabricator.thesanddoctor.com/T118#1710>. The line that causes the problem is `file_page = pywikibot.FilePag

[Pywikipedia-bugs] [Maniphest] [Assigned] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-21 Thread TheSandDoctor
TheSandDoctor assigned this task to Dvorapa. TheSandDoctor triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa, TheSandDoctor Cc: Dvorapa, zh

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-21 Thread TheSandDoctor
TheSandDoctor added a comment. @Dvorapa But what would cause it to return it then when looking at images? I am sort of confused here. TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Pywikipedia-bugs] [Maniphest] [Updated] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-21 Thread TheSandDoctor
TheSandDoctor added a project: User-TheSandDoctor. TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: zhuyifei1999, TheSandDoctor, Mpaa, Aklapper, pywikibot-bugs-list, Fructibus

[Pywikipedia-bugs] [Maniphest] [Retitled] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'

2020-02-21 Thread TheSandDoctor
TheSandDoctor renamed this task from "Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER' in category add" to "Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'". TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL

[Pywikipedia-bugs] [Maniphest] [Changed Subscribers] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER' in category add

2020-02-21 Thread TheSandDoctor
TheSandDoctor added a subscriber: zhuyifei1999. TheSandDoctor added a comment. @zhuyifei1999 Do you think that such a raise could be made? The problem that I see with both handlings though is that the titles are //not// "invalid" as they are the valid image titles on the wiki(?).

[Pywikipedia-bugs] [Maniphest] [Commented On] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER' in category add

2020-02-21 Thread TheSandDoctor
TheSandDoctor added a comment. @Fructibus Was this resolved or? TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: TheSandDoctor, Mpaa, Aklapper, pywikibot-bugs-list, Fructibus

[Pywikipedia-bugs] [Maniphest] [Retitled] T181443: Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER' in category add

2020-02-21 Thread TheSandDoctor
TheSandDoctor renamed this task from "Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER'" to "Pywikibot stops when finding the character \uFFFD - 'REPLACEMENT CHARACTER' in category add". TASK DETAIL https://phabricator.wikimedia.org/T181443 EMAIL

[Pywikipedia-bugs] [Maniphest] [Edited] T245374: WMFTimeoutException on non-existent files

2020-02-16 Thread TheSandDoctor
TheSandDoctor updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T245374 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: TheSandDoctor, Aklapper, AntiCompositeNumber, pywikibot-bugs-list, Zkhalido

[Pywikipedia-bugs] [Maniphest] [Created] T245374: WMFTimeoutException on non-existent files

2020-02-16 Thread TheSandDoctor
TheSandDoctor created this task. TheSandDoctor added projects: MediaWiki-API, Operations, Pywikibot. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. Restricted Application added a project: Core Platform Team. TASK DESCRIPTION Pywikibot keeps attempting to access non

[Pywikipedia-bugs] [Maniphest] [Edited] T244491: EventStreams first message never found

2020-02-06 Thread TheSandDoctor
TheSandDoctor updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T244491 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TheSandDoctor Cc: Aklapper, TheSandDoctor, pywikibot-bugs-list, Zkhalido, 4748kitoko, holger.knust

[Pywikipedia-bugs] [Maniphest] [Created] T244491: EventStreams first message never found

2020-02-06 Thread TheSandDoctor
TheSandDoctor created this task. TheSandDoctor added projects: Pywikibot, Event-Platform. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. Restricted Application added a project: Analytics. TASK DESCRIPTION This is similar to T184713 <https://phabricator.wikimedia.