[Pywikipedia-bugs] [Maniphest] [Commented On] T185561: weblinkchecker.py slows down (itself, OS) to freeze after a while reaching 100% of RAM

[zhuyifei1999]

zhuyifei1999 added a comment.

zhuyifei1999@zhuyifei1999-ThinkPad-X260:~$ curl -I 'http://aplikace.mvcr.cz/sbirka-zakonu/ViewFile.aspx?type=z&id=26659'
HTTP/1.1 200 OK
Date: Sun, 04 Mar 2018 19:38:07 GMT
Server: MVCR
Cache-Control: private
Content-Length: 1867373444
Content-Type: application/octet-stream; charset=utf-8
Content-Disposition: attachment; filename=sb0121-2013-10001-121_2013.pdf
Set-Cookie: ASP.NET_SessionId=252fcnqhzeijqh45pp2upxny; path=/; HttpOnly
zhuyifei1999@zhuyifei1999-ThinkPad-X260:~$ numfmt --to=iec-i --suffix=B 1867373444
1.8GiB

We are downloading a 1.8GiB file!

root@T185561:~/pywikibot# ls -l *G
-rw-r--r-- 1 root root 1251385240 Mar  4 19:19 1.3G
-rw-r--r-- 1 root root 1802500696 Mar  4 19:18 1.8G
-rw-r--r-- 1 root root 3225508800 Mar  4 19:15 3.2G

zhuyifei1999@zhuyifei1999-ThinkPad-X260:~$ python
Python 2.7.12 (default, Dec  4 2017, 14:50:18) 
[GCC 5.4.0 20160609] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> 3225508800 - 1867373444 - 1251385240
106750116
>>> 
zhuyifei1999@zhuyifei1999-ThinkPad-X260:~$ numfmt --to=iec-i --suffix=B 106750116
102MiB

Only 102MiB unaccounted for.

TASK DETAIL

https://phabricator.wikimedia.org/T185561

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: zhuyifei1999
Cc: gerritbot, Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Magul, Tbscho, rafidaslam, MayS, Mdupont, JJMC89, Avicennasis, jayvdb, Masti, Alchimista, Rxy

_______________________________________________
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs