Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread Alex Brollo
2013/8/19 Maarten Dammers maar...@mdammers.nl Hi Alex, Op 19-8-2013 15:08, Alex Brollo schreef: I didn't know at all was Beautifulsoup does; reading doc for the first time, I see that's a xml/parser. Is it superior to pyquery? When I needed xml parsing, I found pyquery simple and so

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread BinĂ¡ris
2013/8/20 Alex Brollo alex.bro...@gmail.com Thanks Maarten, so BS is one more module that I don't need. Really I use pywikipedia in a personal, exotic way - running only some basic scripts, an approach similar to wikitools. This is an important point. Now I found the real words for this

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread Dr. Trigon
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Transtellar Cruise Lines would like to apologize to passengers for the continuing delay to this flight. We are currently awaiting the loading of our complement of small lemon-soaked paper napkins for your comfort, refreshment

[Pywikipedia-l] A basic pywikipedia version

2013-08-20 Thread Alex Brollo
While first comparing piwikipedia and wikitools, I have been astonished to see how much light and simple are scripts to run a bot and do basic things, ti: reading and writing pages, access to API, and so on. I'll try - consider that I'm far from skilled or professional - to prune off from

Re: [Pywikipedia-l] Switch to HTTPS, implications for Pywikibot?

2013-08-20 Thread Amir Ladsgroup
We just need to do some setups. It's not a big deal. I'll put it in my TODO list On Tue, Aug 20, 2013 at 8:27 AM, Morten Wang nett...@gmail.com wrote: I noticed this message from a thread on wikitech-l and wikibots-l: http://lists.wikimedia.org/pipermail/wikibots-l/2013-August/000353.html

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread Dr. Trigon
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 20.08.2013 03:40, BinĂ¡ris wrote: Ok that sound like a good solution - in fact we should enhance the Installation Manual [1] and explain this there. The link should point to the manual, what do you think? Some time back you had something similar

Re: [Pywikipedia-l] Switch to HTTPS, implications for Pywikibot?

2013-08-20 Thread Amir Ladsgroup
I made two changes and this changes has to be merged ASAP https://gerrit.wikimedia.org/r/80003 https://gerrit.wikimedia.org/r/80006 after that bot operators just need to update On Tue, Aug 20, 2013 at 1:27 PM, Amir Ladsgroup ladsgr...@gmail.com wrote: We just need to do some setups. It's not

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread William H. Magill
On Aug 20, 2013, at 5:15 AM, Dr. Trigon dr.tri...@surfeu.ch wrote: What about a README file instead of an URL? Was there a final decision made whether to docu things locally in the repo (REDAME, doxygen, ...) vs. online www.mediawiki.org ? The README file for pywikipedia IS A BLOODY JOKE

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread Lewis Cawte
On 20/08/2013 16:07, William H. Magill wrote: On Aug 20, 2013, at 5:15 AM, Dr. Trigon dr.tri...@surfeu.ch wrote: What about a README file instead of an URL? Was there a final decision made whether to docu things locally in the repo (REDAME, doxygen, ...) vs. online www.mediawiki.org ? The

Re: [Pywikipedia-l] Time lag between wikidata writes

2013-08-20 Thread Chinmay Naik
Hi, I am Chinmay Naik, a Gsoc intern and operator of ProteinBoxBot(runs on pywikipedia - formerly rewrite branch). When i run the bot, there exists a sleep time of around 10 s (7s average) between two successive writes. The bot will handle around 40,000 wikidata items corresponding to gene wiki

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread William H. Magill
On Aug 20, 2013, at 11:49 AM, Lewis Cawte lewisca...@googlemail.com wrote: One last point -- since you have these assorted configure scripts which MUST be run before one can begin using the product -- why not have an install script, which automatically runs them as needed. ... of course

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread William H. Magill
On Aug 20, 2013, at 11:49 AM, Lewis Cawte lewisca...@googlemail.com wrote: I realize also that from a developers point of view, maintaining a WIKI is a PAIN it is much easier to stay inside one's text editor (or whatever tool is being used to write and modify the code with) and to

Re: [Pywikipedia-l] Time lag between wikidata writes

2013-08-20 Thread Merlijn van Deen
The sleep time as implemented in pywikipedia is influenced by three factors: - the minimum time between requests, minthrottle=1 (by default) in user-config.py - the minimum time between page saves, put_throttle=10 - the database lag on the DB servers - pages will not be saved unless the lag

Re: [Pywikipedia-l] A basic pywikipedia version

2013-08-20 Thread Merlijn van Deen
Hi Alex, I'm not sure what you are proposing - what do you want to prune off, exactly, and how is python-wikitools [1] related to this? We already have 'a real pywikipedia core containing nothing but really needed modules to run basics with personal scripts.' - it's called pywikibot-core ;-). We

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread William H. Magill
On Aug 20, 2013, at 2:28 PM, Lewis Cawte lewisca...@googlemail.com wrote: On 20/08/2013 19:19, William H. Magill wrote: On Aug 20, 2013, at 11:49 AM, Lewis Cawte lewisca...@googlemail.com wrote: One last point -- since you have these assorted configure scripts which MUST be run before one

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread William H. Magill
On Aug 20, 2013, at 4:18 PM, William H. Magill mag...@icloud.com wrote: On Aug 20, 2013, at 2:28 PM, Lewis Cawte lewisca...@googlemail.com wrote: On 20/08/2013 19:19, William H. Magill wrote: On Aug 20, 2013, at 11:49 AM, Lewis Cawte lewisca...@googlemail.com wrote: One last point --

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread Merlijn van Deen
On 20 August 2013 22:18, William H. Magill mag...@icloud.com wrote: Please insert URL to wiki: http//www.lotro-wiki.com (...snip...) ValueError: unknown url type: http//www.lotro-wiki.com Try using http://www.lotro-wiki.com (note the colon) instead. Merlijn

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread Lewis Cawte
On 20/08/2013 21:18, William H. Magill wrote: On Aug 20, 2013, at 2:28 PM, Lewis Cawte lewisca...@googlemail.com wrote: On 20/08/2013 19:19, William H. Magill wrote: On Aug 20, 2013, at 11:49 AM, Lewis Cawte lewisca...@googlemail.com wrote: One last point -- since you have these assorted

Re: [Pywikipedia-l] BeautifulSoup

2013-08-20 Thread William H. Magill
On Aug 20, 2013, at 4:43 PM, Merlijn van Deen valhall...@arctus.nl wrote: On 20 August 2013 22:18, William H. Magill mag...@icloud.com wrote: Please insert URL to wiki: http//www.lotro-wiki.com (...snip...) ValueError: unknown url type: http//www.lotro-wiki.com Try using

Re: [Pywikipedia-l] A basic pywikipedia version

2013-08-20 Thread Alex Brollo
Thanks for comment and suggestions. Alex 2013/8/20 Merlijn van Deen valhall...@arctus.nl Hi Alex, I'm not sure what you are proposing - what do you want to prune off, exactly, and how is python-wikitools [1] related to this? We already have 'a real pywikipedia core containing nothing but

Re: [Pywikipedia-l] Switch to HTTPS, implications for Pywikibot?

2013-08-20 Thread Merlijn van Deen
On 20 August 2013 15:40, Amir Ladsgroup ladsgr...@gmail.com wrote: after that bot operators just need to update OK, this seems to be giving some problems. If you get ERROR: Traceback (most recent call last): File X\core\pywikibot\data\api.py, line 286, in submit body=paramstring) File