[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread gerritbot 
gerritbot added a comment.


  Change 635323 **merged** by jenkins-bot:
  [pywikibot/core@master] [bugfix] Add Server414Error to pywikibot.__init__()
  
  https://gerrit.wikimedia.org/r/635323

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, gerritbot
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, 
joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, 
Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Dvorapa, 
Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread gerritbot 
gerritbot added a comment.


  Change 635323 had a related patch set uploaded (by Mpaa; owner: Mpaa):
  [pywikibot/core@master] [bugfix] Add Server414Error to pywikibot.__init__()
  
  https://gerrit.wikimedia.org/r/635323

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, gerritbot
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread gerritbot 
gerritbot added a comment.


  Change 635303 **merged** by jenkins-bot:
  [pywikibot/core@master] [IMPR] add Server414Error in reflink.py and close file
  
  https://gerrit.wikimedia.org/r/635303

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, 
joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, 
Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Dvorapa, 
Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread Rubin16 
Rubin16 added a comment.


  In T266000#6564377 , @Mpaa 
wrote:
  
  > Seems working, strange.
  > Anyhow I have added Server414Error to the managed exceptions, so the bot 
won't crash.
  
  The patch isn't working for me:
  
File "/srv/paws/pwb/pywikibot/tools/__init__.py", line 1708, in __getattr__
return getattr(self._module, attr)
AttributeError: module 'pywikibot' has no attribute 'Server414Error'
Dropped throttle(s).
Closing network session.
  
  To get a link I actually used this option:
  
pywikibot.output(ref.url)

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rubin16
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, 
joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, 
Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Dvorapa, 
Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread Mpaa 
Mpaa added a comment.


  Seems working, strange.
  Anyhow I have added Server414Error to the managed exceptions, so the bot 
won't crash.

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mpaa
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread gerritbot 
gerritbot added a comment.


  Change 635303 had a related patch set uploaded (by Mpaa; owner: Mpaa):
  [pywikibot/core@master] [IMPR] add Server414Error in reflink.py
  
  https://gerrit.wikimedia.org/r/635303

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread Rubin16 
Rubin16 added a comment.


  I think I got it, the link was:
  
  
https://365info.kz/2017/03/beriku-imashevu-uporno-ne-dayut-boltatsya-bez-dela-ashimbaev

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rubin16
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread Rubin16 
Rubin16 added a comment.


Python 3.6.9 (default, Jul 17 2020, 12:50:27)
[GCC 8.4.0]
LOADING SITE wikipedia:ru VERSION: 1.36.0-wmf.13
Found 1 wikipedia:ru processes running, including this one.
WARNING: /home/paws/reflinks2.py:498: ResourceWarning: unclosed file 
<_io.BufferedReader name='404-links.txt'>
  listof404pages, 'r', 'latin_1').read()

Retrieving 50 pages from wikipedia:ru.
No changes were needed on [[Центральная избирательная комиссия Республики 
Беларусь]]
Traceback (most recent call last):
  File "/home/paws/reflinks2.py", line 542, in run
ref.url, use_fake_user_agent=self._use_fake_user_agent)
  File "/srv/paws/pwb/pywikibot/tools/__init__.py", line 1450, in wrapper
return obj(*__args, **__kw)
  File "/srv/paws/pwb/pywikibot/comms/http.py", line 501, in fetch
request.data = response
  File "/srv/paws/pwb/pywikibot/comms/threadedhttp.py", line 71, in data
callback(self)
  File "/srv/paws/pwb/pywikibot/comms/http.py", line 349, in 
error_handling_callback
raise Server414Error('Too long GET request')
pywikibot.exceptions.Server414Error: Too long GET request

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/srv/paws/pwb/pwb.py", line 363, in 
if not main():
  File "/srv/paws/pwb/pwb.py", line 358, in main
file_package)
  File "/srv/paws/pwb/pwb.py", line 75, in run_python_file
main_mod.__dict__)
  File "/home/paws/reflinks2.py", line 823, in 
main()
  File "/home/paws/reflinks2.py", line 819, in main
bot.run()
  File "/home/paws/reflinks2.py", line 620, in run
except pywikibot.Server414Error as e:
  File "/srv/paws/pwb/pywikibot/tools/__init__.py", line 1708, in 
__getattr__
return getattr(self._module, attr)
AttributeError: module 'pywikibot' has no attribute 'Server414Error'
Dropped throttle(s).
Closing network session.
CRITICAL: Exiting due to uncaught exception 
Network session closed.
@PAWS:~$

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rubin16
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread Mpaa 
Mpaa added a comment.


  Or better, add another exception handling after line 620
  
except pywikibot.Server414Error as e:
pywikibot.output("Server414Error --> Can't retrieve page {} : {}"
 .format(ref.url, e))
continue
  
  and see what is printed when this is triggered.

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mpaa
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread Mpaa 
Mpaa added a comment.


  Print the url, if possible.
  Add
  
pywikibot.output(ref.url)
f = comms.http.fetch(ref.url, use_fake_user_agent=self._use_fake_user_agent)

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mpaa
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread Rubin16 
Rubin16 added a comment.


  In T266000#6563997 , @Mpaa 
wrote:
  
  > Not sure this is a pywikibot  error.
  > Could you find out which is the ref.url it is trying to fetch in:
  >
  >   f = comms.http.(ref.url, use_fake_user_agent=self._use_fake_user_agent)
  >
  > and post it here?
  
  I need some more instruction how I can do it :) sorry for asking

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rubin16
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T266000: http.py - error_handling_callback

2020-10-20 Thread Mpaa 
Mpaa added a comment.


  Not sure this is a pywikibot  error.
  Could you find out which is the ref.url it is trying to fetch in:
  
f = comms.http.(ref.url, use_fake_user_agent=self._use_fake_user_agent)
  
  and post it here?

TASK DETAIL
  https://phabricator.wikimedia.org/T266000

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mpaa
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs