[Pywikipedia-bugs] [Maniphest] [Created] T159645: http response doesn't contain a charset

[Rubin16]

Rubin16 created this task. Rubin16 added a project: Pywikibot-core. Herald added subscribers: pywikibot-bugs-list, Aklapper.

TASK DESCRIPTION

reflinks.py seems to be completely non-working now: you can try

pwb.py reflinks.py -lang:ru -family:wikipedia -start:! -v -ignorepdf

I get unicode decode errors, I also got this one:

WARNING: Http response status 404
WARNING : Redirect 404 : http://www.billboard.com/news/richard-s-prayer-stays-atop-u-k-chart-949770.story
Http response doesn't contain a charset.
Traceback (most recent call last):
  File "/srv/paws/pwb/pwb.py", line 263, in <module>
    if not main():
  File "/srv/paws/pwb/pwb.py", line 257, in main
    run_python_file(filename, [filename] + args, argvu, file_package)
  File "/srv/paws/pwb/pwb.py", line 121, in run_python_file
    main_mod.__dict__)
  File "/srv/paws/pwb/scripts/reflinks.py", line 797, in <module>
    main()
  File "/srv/paws/pwb/scripts/reflinks.py", line 793, in main
    bot.run()
  File "/srv/paws/pwb/scripts/reflinks.py", line 605, in run
    linkedpagetext = self.NON_HTML.sub(b'', linkedpagetext)
TypeError: can't use a bytes pattern on a string-like object
Dropped throttle(s).
<class 'TypeError'>
CRITICAL: Closing network session.
Network session closed.

I tried to start script from localhost, from Wikimedia Labs and using PAWS but it doesn't help.

In this case the error relates to this article:

https://ru.wikipedia.org/wiki/(You_Drive_Me)_Crazy

But it crashes practically every edit.

Rubinbot@PAWS:~$ pwb.py version
Pywikibot: [https] r-pywikibot-core.git (785fee8, g7905, 2017/03/04, 21:00:12, n/a)
Release version: 3.0-dev
requests version: 2.13.0
  cacerts: /srv/paws/lib/python3.4/site-packages/requests/cacert.pem
    certificate test: ok
Python: 3.4.2 (default, Oct  8 2014, 10:45:20)
[GCC 4.9.1]
PYWIKIBOT2_DIR: /srv/paws
PYWIKIBOT2_DIR_PWB: /srv/paws/pwb
PYWIKIBOT2_NO_USER_CONFIG: Not set
Config base dir: /srv/paws
Usernames for family "commons":
        *: Rubinbot (no sysop configured)
Usernames for family "mediawiki":
        *: Rubinbot (no sysop configured)
Usernames for family "wikiquote":
        *: Rubinbot (no sysop configured)
Usernames for family "wikimedia":
        *: Rubinbot (no sysop configured)
Usernames for family "wiktionary":
        *: Rubinbot (no sysop configured)
Usernames for family "wikiversity":
        *: Rubinbot (no sysop configured)
Usernames for family "wikiboots":
        *: Rubinbot (no sysop configured)
Usernames for family "wikipedia":
        *: Rubinbot (no sysop configured)
Usernames for family "wikidata":
        *: Rubinbot (no sysop configured)
Usernames for family "meta":
        *: Rubinbot (no sysop configured)
Usernames for family "wikisource":
        *: Rubinbot (no sysop configured)
Rubinbot@PAWS:~$

TASK DETAIL

https://phabricator.wikimedia.org/T159645

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rubin16
Cc: Aklapper, pywikibot-bugs-list, Rubin16, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Sn1per, jayvdb, Dalba, Masti, Alchimista, Rxy

_______________________________________________
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs