https://bugzilla.wikimedia.org/show_bug.cgi?id=62942
Bug ID: 62942
Summary: Normal jobs sometimes run on
tools-webgrid-tomcat.eqiad.wmflabs
Product: Wikimedia Labs
Version: unspecified
Hardware: All
OS: All
Status: NEW
Severity: minor
Priority: Unprioritized
Component: tools
Assignee: m...@uberbox.org
Reporter: valhall...@arctus.nl
CC: benap...@gmail.com, t...@tim-landscheidt.de
Web browser: ---
Mobile Platform: ---
nl:User:Valhallasw-toolserver-botje runs from a crontab on tools-login under
the nlwikibots service group:
0 * * * * qsub $HOME/bin/tvpupdater > /dev/null
The job is queued hourly, and only at midnight local time (Europe/Amsterdam),
pages are edited on nlwiki. This currently corresponds to 2300UTC, and 2200UTC
in the near future.
In the edit message, the bot reports the host at which it is currently running:
https://nl.wikipedia.org/wiki/Speciaal:Bijdragen/Valhallasw-toolserver-botje
Expected behavior would be running from the tools-exec-* hosts, but the bot
often runs from the tools-webgrid-tomcat host.
$HOME/bin/tvpupdater sets several SGE parameters:
#$ -l h_rt=0:30:00 # max runtime
#$ -l virtual_free=25M # max memory use, excluding shared libs, toolserver
#$ -l h_vmem=256M # max memory use, including shared libs, Tools Labs
#$ -l arch=* # mag op zowel linux als solaris
#$ -N tvpupdater-valhallasw # naam van taak, eindigt in naam eigenaar
#$ -M valhall...@arctus.nl
#$ -m a # alleen mails bij een abort (vanwege bv. runtime-overschrijding)
#$ -b y # draai over netwerkschijf ipv het bestand te kopiëren
#$ -o /dev/null # output naar /dev/null
#$ -e $HOME/tvpupdater-valhallasw.err
and then changes the directory, and invokes ~/bots/tvpupdater/runbot, which
activates a virtualenv and, in turn, starts the actual bot script.
I have been able to get two job numbers for runs on the tomcat hosts. Their
qacct data is shown below.
qacct -j 40719
==============================================================
qname webgrid-tomcat
hostname tools-webgrid-tomcat.eqiad.wmflabs
group tools.nlwikibots
owner tools.nlwikibots
project NONE
department defaultdepartment
jobname tvpupdater-valhallasw
jobnumber 40719
taskid undefined
account sge
priority 0
qsub_time Mon Mar 17 23:00:02 2014
start_time Mon Mar 17 23:00:13 2014
end_time Mon Mar 17 23:00:45 2014
granted_pe NONE
slots 1
failed 0
exit_status 0
ru_wallclock 32
ru_utime 0.196
ru_stime 0.056
ru_maxrss 16456
ru_ixrss 0
ru_ismrss 0
ru_idrss 0
ru_isrss 0
ru_minflt 12120
ru_majflt 0
ru_nswap 0
ru_inblock 8
ru_oublock 32
ru_msgsnd 0
ru_msgrcv 0
ru_nsignals 0
ru_nvcsw 639
ru_nivcsw 78
cpu 0.252
mem 0.019
io 0.002
iow 0.000
maxvmem 209.957M
arid undefined
qacct -j 64375
==============================================================
qname webgrid-tomcat
hostname tools-webgrid-tomcat.eqiad.wmflabs
group tools.nlwikibots
owner tools.nlwikibots
project NONE
department defaultdepartment
jobname tvpupdater-valhallasw
jobnumber 64375
taskid undefined
account sge
priority 0
qsub_time Fri Mar 21 23:00:02 2014
start_time Fri Mar 21 23:00:17 2014
end_time Fri Mar 21 23:00:43 2014
granted_pe NONE
slots 1
failed 0
exit_status 0
ru_wallclock 26
ru_utime 0.216
ru_stime 0.080
ru_maxrss 16444
ru_ixrss 0
ru_ismrss 0
ru_idrss 0
ru_isrss 0
ru_minflt 12106
ru_majflt 2
ru_nswap 0
ru_inblock 64
ru_oublock 32
ru_msgsnd 0
ru_msgrcv 0
ru_nsignals 0
ru_nvcsw 506
ru_nivcsw 171
cpu 0.296
mem 0.021
io 0.002
iow 0.000
maxvmem 209.945M
arid undefined
--
You are receiving this mail because:
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
