Re: [Toolserver-l] 502
Hi, My irc-bot seems to be still running and I can access [1] and [2] without a problem from here (the Netherlands). What url's do you have problems with? Sumurai8 [1] http://toolserver.org/~tparis/pcount/index.php?name=Sumurai8lang=nlwiki=wikipedia [2] http://toolserver.org/~tparis/pages/index.php?name=Sumurai8lang=nlwiki=wikipedianamespace=0redirects=none 2012/11/12 Magnus Manske magnusman...@googlemail.com I suddenly see a lot of 502 error on the toolserver from the UK. Anyone else? (can't find a IRC client for OSX 10.6 quickly...) ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Future of the toolserver
2012/9/26 Platonides platoni...@gmail.com: On 26/09/12 08:27, Federico Leva (Nemo) wrote: Yes, I know about MMP. It was introduced much later, after people were already very used to doing things in an individualized manner. From what I'm told MMPs aren't used much. So you think that even new users (I believe many users arrived after MMP were introduced) are not using MMP due to bad old habits of the other users? I've had a hard time trying to convince some users to use a MMP; I think it's not trivial to understand what models actually work and are liked. The reason is as simple as being much more easier, run mkdir and start coding vs open a jira request to get a new MMP for a project which may or may not be interesting (heh, most tools were probably born after coding for a couple of hours after having a good idea) and which nobody is wanting to maintain with you, probably. It is not hard to start coding in your own workspace and move code from your newly created directory to a MMP. A MMP doesn't necessarely have to be maintained by multiple users. While it's convenient having someone in the project that can jump in in case your tool breaks badly and you are not around to fix it, it is not by any means necessary. Ryan wrote: Toolserver's model is fundamentally different. It's based on an old concept of shared hosting. Labs is built on a model more like a VPS (really more like EC2). Due to that, it's possible to give users far more rights. labs model didn't exist when the toolserver started. This route was the only 'normal' one to follow, specially with a single server. It even looks too new for labs right now. If you guys want to build the exact same Toolserver environment as a Labs project, go for it. I have a good feeling you'll start doing things differently when you see the affordances given by having more rights, though. I have a few ideas on how to improve it on webtools, based on toolserver experience, but without big changes. MMPs aren't a very elegant solution. I'd prefer not to force an inelegant solution into a system that allows much more elegant approaches. Actually, I'm unsure on how to replicate MMP accounts there. It shouldn't need to manually create them everywhere. The elegant solution is probably to have those accounts in LDAP... Any ideas? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] How to silence qsub/qcronsub?
Hi, I think setting the -o (output) parameter to /dev/null while omitting the -e (errors) and the -j (merging errors output) parameter should only log errors. See https://wiki.toolserver.org/view/Job_scheduling#arguments_to_qsub/qcronsub Sumurai8 2012/3/7 Simon Kågedal Reimer skage...@gmail.com Hi! Does anyone have a solution for making qsub/qcronsub not say Your job ... has been submitted to standard output? Been getting a lot of e-mails from cronie lately... I *do* of course want it to say something when things are not working as expected, so I don't want all output silenced. Regards, Simon Kågedal Reimer (skagedal) ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] help me with my first cronsub
Hi, I believe the first argument of cronsub should specify a name for the cronjob. When the job is running this name will show up in qstat and it can be used to kill the job jusing qdel. It should be something like: 0 3 * * * cronsub newpagefetch $HOME/newpagefetch.sh Sumurai8 2011/8/27 Ted Timmons t...@perljam.net: Here's the error: Your cron job on willow cronsub $HOME/newpagefetch.sh produced the following output: qsub: ERROR! argument to -N option must not contain / Here's the cron entry: $ crontab -l 0 3 * * * cronsub $HOME/newpagefetch.sh Here's the shell script: $ cat newpagefetch.sh #!/bin/sh #$ -sl newpagefetch #$ -m bae #$ -j y #$ -o $HOME/newpagefetch.log java -jar $HOME/NewPageFetcherApplication.jar What am I doing wrong? ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] alphabetic codes in irc update streams
I think these are the flags you see on any recent changes page. If that's the case: M = minor edit B = bot N = new Sumurai8 2011/6/22 Ed Summers e...@pobox.com: I was wondering if anyone knew if there is a list of the codes that follow the page names in the mediawiki IRC update stream. For example the MB in the following example: 20:43 @rc-pmtpa [[2007–08 A-League]] MB http://en.wikipedia.org/w/index.php?diff=435699936oldid=435699679 * Cydebot * (+3) Robot - Speedily moving category 2008 in Australian football (soccer) to [[:Category:2008 in Australian association football]] per [[WP:CFDS|CFDS]]. I'm trying to identify bots for this visualization of the updates [1]. Any tips or pointers would be appreciated. //Ed [1] http://wikistream.inkdroid.org ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Two beginner questions
irc listening with python is fairly easy; just use a socket import socket IRC = socket.socket(socket.AF_INET, socket.SOCK_STREAM) IRC.connect(('irc.freenode.net', 6667)) while True: text = IRC.recv(1024) msgs = text.split('\n') for msg in msgs: if msg.split(' ', 1)[0] == PING: pong = msg.split(' ', 1)[1] IRC.send(PONG %s % pong) print msg If you want to do periodically things, like writing the output to a file very 10 minutes, you have to set a timeout. Otherwise the script will wait at the recv-line till it receives data 2010/12/9 Alex Brollo alex.bro...@gmail.com 1. I'm testing my skill and I run my script under cron. The python script begin with these rows (and it runs): # -*- coding: utf-8 -*- #!/usr/bin/python import os,sys if not sys.platform==win32: sys.path.append('/home/alebot/pywikipedia') os.chdir(/home/alebot/scripts) Then I tried to move to batch job sheduling, but... my script gives an error: now the server dislikes sys.path row. Why? I obviously have to study more: but what/where have I sto study? :-( 2. The script bring into life a python bot, who reads RecentChanges at 10 minutes intervals by a cron routine. Is perhaps more efficient a #irc bot listening it.wikisource #irc channel for recent changes in your opinion? Where can I find a good python script to read #irc channels? Thanks - I apologize for so banal questions. Alex ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Two beginner questions
Oops, forgot to put a return after the pongmsg, like this: IRC.send(PONG %s\n % pong) The IRC-server will try to process the line after it finds a \n in your msg Op 9 december 2010 17:04:24 UTC+1 heeft Sumurai8 sumur...@wikiweet.nl het volgende geschreven: irc listening with python is fairly easy; just use a socket import socket IRC = socket.socket(socket.AF_INET, socket.SOCK_STREAM) IRC.connect(('irc.freenode.net', 6667)) while True: text = IRC.recv(1024) msgs = text.split('\n') for msg in msgs: if msg.split(' ', 1)[0] == PING: pong = msg.split(' ', 1)[1] IRC.send(PONG %s % pong) print msg If you want to do periodically things, like writing the output to a file very 10 minutes, you have to set a timeout. Otherwise the script will wait at the recv-line till it receives data 2010/12/9 Alex Brollo alex.bro...@gmail.com 1. I'm testing my skill and I run my script under cron. The python script begin with these rows (and it runs): # -*- coding: utf-8 -*- #!/usr/bin/python import os,sys if not sys.platform==win32: sys.path.append('/home/alebot/pywikipedia') os.chdir(/home/alebot/scripts) Then I tried to move to batch job sheduling, but... my script gives an error: now the server dislikes sys.path row. Why? I obviously have to study more: but what/where have I sto study? :-( 2. The script bring into life a python bot, who reads RecentChanges at 10 minutes intervals by a cron routine. Is perhaps more efficient a #irc bot listening it.wikisource #irc channel for recent changes in your opinion? Where can I find a good python script to read #irc channels? Thanks - I apologize for so banal questions. Alex ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Two beginner questions
It's just a plain idea how you can make an irc bot. Possible solutions are making the buffer bigger or preserving the last message if it doesn't end with a \n. For WikiLinkBot the first solution works just fine (If reading the recent changes every 10 minutes just works fine, making a bigger buffer should do the job (max. 500 edits in 600 seconds, then just make the buffer a little bigger). Sumurai8 2010/12/9 River Tarnell river.tarn...@wikimedia.de: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Sumurai8 (DD): text = IRC.recv(1024) msgs = text.split('\n') This seems to have a bug: if there's more than 1024 bytes waiting, you could receive only part of the final message; so you will truncate that message, and the next recv will receive the other half (which will then be effectively junk). - river. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (FreeBSD) iEYEARECAAYFAk0A/0QACgkQIXd7fCuc5vKX8QCeKN77J7YXVJaO5utUVMyxCC5a ubsAnR/+E/8WtjZuD1Qrc78S5v68ZQ5/ =z4ru -END PGP SIGNATURE- ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
Re: [Toolserver-l] Two beginner questions
Well... you can actually send every 3 minutes a PONG-message without listening to the IRC-channel and the server will gladly accept that ^_^ . That's what I did at the time I didn't know about the timeout-option of a socket :) But most of the time it is just better to follow the rules and end each line with \r\n (nice, didn't know about that, so changed it in my script :) ), send a PONG-msg followed by everything that was send after the PING-message, etc, etc. 2010/12/9 Bryan Tong Minh bryan.tongm...@gmail.com: On Thu, Dec 9, 2010 at 5:36 PM, Platonides platoni...@gmail.com wrote: Sumurai8 (DD) wrote: Oops, forgot to put a return after the pongmsg, like this: IRC.send(PONG %s\n % pong) The IRC-server will try to process the line after it finds a \n in your msg According to the protocol, it should be a CRLF (\r\n). Although a bare \n seems to be commonly accepted as well. In fact some ircds only look at the first 4 chars, PONG, regardless whether there is a new line at all. Bryan ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette ___ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette