[Pywikipedia-bugs] [Maniphest] [Retitled] T166617: HttpRequest: not all headers contain 'content-type'.

[Mpaa]

Mpaa created this task. Mpaa added a project: Pywikibot-core. Herald added subscribers: pywikibot-bugs-list, Aklapper.

TASK DESCRIPTION

pwb.py reflinks.py -lang:ru -family:wikipedia -start:! -v -ignorepdf

Traceback (most recent call last):
  File "pwb.py", line 262, in <module>
    if not main():
  File "pwb.py", line 255, in main
    run_python_file(filename, [filename] + args, argvu, file_package)
  File "pwb.py", line 121, in run_python_file
    main_mod.__dict__)
  File "./scripts/reflinks.py", line 798, in <module>
    main()
  File "./scripts/reflinks.py", line 793, in main
    bot.run()
  File "./scripts/reflinks.py", line 588, in run
    linkedpagetext = f.content
  File "/home/user/python/core/pywikibot/comms/threadedhttp.py", line 181, in content
    return self.decode(self.encoding)
  File "/home/user/python/core/pywikibot/comms/threadedhttp.py", line 138, in encoding
    if not self.charset and not self.header_encoding:
  File "/home/user/python/core/pywikibot/comms/threadedhttp.py", line 121, in header_encoding
    content_type = self.response_headers['content-type']
  File "/home/user/anaconda3/lib/python3.6/site-packages/requests/structures.py", line 54, in __getitem__
    return self._store[key.lower()][1]
KeyError: 'content-type'
Dropped throttle(s).
<class 'KeyError'>
CRITICAL: Closing network session.
Network session closed.



(Pdb) self.response_headers
{'Date': 'Tue, 30 May 2017 20:03:29 GMT', 'Server': 'Apache/2.4.6 (CentOS) OpenSSL/1.0.1e-fips', 'Last-Modified': 'Wed, 08 Feb 2006 19:49:40 GMT', 'ETag': '"338b0-40c4dcbea7d00"', 'Accept-Ranges': 'bytes', 'Content-Length': '211120', 'Keep-Alive': 'timeout=5, max=100', 'Connection': 'Keep-Alive'}

TASK DETAIL

https://phabricator.wikimedia.org/T166617

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mpaa
Cc: Aklapper, pywikibot-bugs-list, Mpaa, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Sn1per, jayvdb, Dalba, Masti, Alchimista, Rxy

_______________________________________________
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs