Re: [Toolserver-l] How to silence qsub/qcronsub?

2012-03-08 Thread Simon Kågedal Reimer 
Ah, sorry, that didn't work - can't run qsub directly from cronie
since we need to set some environment variables etc.

Suggesting instead this patch to qcronsub (patched version at
/home/skagedal/local/bin/qcronsub2):

--- /sge62/bin/sol-amd64/qcronsub   2012-03-01 00:24:30.297917000 +
+++ ./qcronsub2 2012-03-08 08:27:14.098206000 +
@@ -13,7 +13,7 @@
 fi
 if [ -s ${MYTEMPFILE} ]
  then
-  cat ${MYTEMPFILE}
+  cat ${MYTEMPFILE}  /dev/stderr
 fi
 rm -f ${MYTEMPFILE}
 exit ${RC}


2012/3/8 Simon Kågedal Reimer skage...@gmail.com:
 Hi, thanks for the advice! Here is some testing:

 # Output when things are ok:
 skagedal@clematis:~/fafafa$ qcronsub ./do_fafafa.sh
 Your job 1753569 (Fafafa) has been submitted
 # Output when things are not ok:
 skagedal@clematis:~/fafafa$ qcronsub ./do_fififi.sh
 Unable to read script file because of error: error opening
 ./do_fififi.sh: No such file or directory
 # Piping to -dev/null:
 skagedal@clematis:~/fafafa$ qcronsub ./do_fafafa.sh  /dev/null
 # Good, nice and quiet.
 skagedal@clematis:~/fafafa$ echo $?
 0
 # And returned zero for success!
 skagedal@clematis:~/fafafa$ qcronsub ./do_fafafi.sh  /dev/null
 # Hmm, also quiet - qcronsub outputs all messages, even on error, on stdout
 skagedal@clematis:~/fafafa$ echo $?
 14
 # But returns correctly. What about qsub?
 skagedal@clematis:~/fafafa$ qsub ./do_fafafa.sh  /dev/null
 skagedal@clematis:~/fafafa$ qsub ./do_fififi.sh  /dev/null
 Unable to read script file because of error: error opening
 ./do_fififi.sh: No such file or directory
 skagedal@clematis:~/fafafa$ echo $?
 14
 # Works as expected!
 # How about the -o option? Let's try qcronsub.
 skagedal@clematis:~/fafafa$ qcronsub ./do_fafafa.sh -o myfile.txt
 Your job 1753616 (Fafafa) has been submitted
 # Nope. qsub then?
 skagedal@clematis:~/fafafa$ qsub ./do_fafafa.sh -o myfile.txt
 Your job 1753617 (Fafafa) has been submitted
 # Nope, that options seems to do something else.


 So, in summary, I believe changing qcronsub fafafa.sh (which I
 currently have in my cronie) to qsub fafafa.sh  /dev/null will give
 me the behavior I want. However, without the added qcronsub uniqueness
 functionality, which is ok for my purposes. (as Platonides said, I'd
 get a mail from cronie anyway when qcronsub failed - but a less
 descriptive e-mail...)

 Merlissimo, I would suggest changing qcronsub so that it outputs on
 stderr when return code is not 0. Thanks!

 Regards, Simon

 On Wed, Mar 7, 2012 at 10:02 PM, Sumurai8 (DD) sumur...@gmail.com wrote:
 Hi,

 I think setting the -o (output) parameter to /dev/null while omitting the -e
 (errors) and the -j (merging errors  output) parameter should only log
 errors. See
 https://wiki.toolserver.org/view/Job_scheduling#arguments_to_qsub/qcronsub

 Sumurai8

 2012/3/7 Simon Kågedal Reimer skage...@gmail.com

 Hi!

 Does anyone have a solution for making qsub/qcronsub not say Your job ...
 has been submitted to standard output?

 Been getting a lot of e-mails from cronie lately...

 I *do* of course want it to say something when things are not working as
 expected, so I don't want all output silenced.

 Regards,
 Simon Kågedal Reimer (skagedal)


 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette



 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p corrupt?

2012-03-08 Thread Aaron Halfaker 
The missing image for Hubble_Space_Telescope_picture_of_Betelgeuse.jpg
exists on commons and is pulled into enwiki.

I was able to find the Hexen page:
grphack@willow:~$ mysql -h enwiki-p.rrdb.toolserver.org enwiki_p -e SELECT
* FROM page WHERE page_namespace = 0 and page_title =
'Hexen:_Beyond_Heretic'
+-++---+---+--+--+-+---++-+--+
| page_id | page_namespace | page_title| page_restrictions |
page_counter | page_is_redirect | page_is_new | page_random   |
page_touched   | page_latest | page_len |
+-++---+---+--+--+-+---++-+--+
|   13612 |  0 | Hexen:_Beyond_Heretic |   |
   120 |0 |   0 | 0.821679617112204 |
20120308123616 |   480826930 |12016 |
+-++---+---+--+--+-+---++-+--+

-Aaron

On Thu, Mar 8, 2012 at 12:15 AM, MZMcBride z...@mzmcbride.com wrote:

 MZMcBride wrote:
  Can someone verify the integrity of the page table for me, please?
 
  ---
  mzmcbride@willow:~$ sql enwiki_p;
 
  mysql select * from page where page_namespace = 6 and page_title =
  'Hubble_Space_Telescope_picture_of_Betelgeuse.jpg';
  Empty set (0.00 sec)
 
  mysql select * from page where page_namespace = 0 and page_title =
  'Hexen:_Beyond_Heretic';
  Empty set (0.00 sec)
  ---
 
  Compare:
 
  * http://enwp.org/File:Hubble_Space_Tele 
  scope_picture_of_Betelgeuse.jpghttp://enwp.org/File:Hubble_Space_Telescope_picture_of_Betelgeuse.jpg
  * https://en.wikipedia.org/wiki/Hexen:_Beyond_Heretic
 
  To me, this indicates that either the master has some very serious
 problem
  (unlikely) or that the Toolserver's copy of the database has become
 corrupt
  (much more likely). Can anyone verify my findings?

 Re: the missing image (Hubble Space ...), I filed
 https://bugzilla.wikimedia.org/show_bug.cgi?id=35054.

 The Hexen case needs further investigation.

 MZMcBride



 ___
 Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
 https://lists.wikimedia.org/mailman/listinfo/toolserver-l
 Posting guidelines for this list:
 https://wiki.toolserver.org/view/Mailing_list_etiquette

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p corrupt?

2012-03-08 Thread DaB. 
Hello,
At Thursday 08 March 2012 19:40:16 DaB. wrote:
 To me, this indicates that either the master has some very serious problem
 (unlikely) or that the Toolserver's copy of the database has become corrupt
 (much more likely). Can anyone verify my findings?

the enwiki-copy on thyme is corrupt, like status.toolserver.org tells since a 
few days. If the copy of rosemary is corrupt too is unknown at the moment. I 
will request a fresh dump at the wmf, but this can take some time.

Sincerly,
DaB.

-- 
Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885


signature.asc
Description: This is a digitally signed message part.
___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] How to silence qsub/qcronsub?

2012-03-08 Thread Platonides 
On 08/03/12 09:32, Simon Kågedal Reimer wrote:
 Ah, sorry, that didn't work - can't run qsub directly from cronie
 since we need to set some environment variables etc.

Just
 SGE_ROOT=/sge62 qsub $HOME/do_fififi.sh
would work.

But changing qcronsub is indeed appropiate.
 Suggesting instead this patch to qcronsub (patched version at
 /home/skagedal/local/bin/qcronsub2):
 
 --- /sge62/bin/sol-amd64/qcronsub   2012-03-01 00:24:30.297917000 +
 +++ ./qcronsub2 2012-03-08 08:27:14.098206000 +
 @@ -13,7 +13,7 @@
  fi
  if [ -s ${MYTEMPFILE} ]
   then
 -  cat ${MYTEMPFILE}
 +  cat ${MYTEMPFILE}  /dev/stderr
  fi
  rm -f ${MYTEMPFILE}
  exit ${RC}

Or just
+  cat ${MYTEMPFILE} 2


BTW, why is qcronsub at /sge62/bin/sol-amd64/qcronsub ?
Wouldn't /opt/local/bin/qcronsub (like cronsub) be more appropiate?

___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette

Re: [Toolserver-l] enwiki_p corrupt?

2012-03-08 Thread MZMcBride 
DaB. wrote:
 At Thursday 08 March 2012 19:40:16 DaB. wrote:
 To me, this indicates that either the master has some very serious problem
 (unlikely) or that the Toolserver's copy of the database has become corrupt
 (much more likely). Can anyone verify my findings?
 
 the enwiki-copy on thyme is corrupt, like status.toolserver.org tells since a
 few days. If the copy of rosemary is corrupt too is unknown at the moment. I
 will request a fresh dump at the wmf, but this can take some time.

Thanks. I forgot to check there. :-)

MZMcBride



___
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list: 
https://wiki.toolserver.org/view/Mailing_list_etiquette