Re: [gt-user] globus-job-status: UNKNOWN JOB STATE 0
>>> Strange. Yea - looks like a bug. Is that repeatable / happens for every >>> PBS job? >> I haven't tested hard yet but at least I saw such status twice (for >> different jobs). >> >>> Are you using the SEG for PBS job monitoring? >> not yet. It wasn't clear for me how to configure SEG. It's written: >> It must be explicitly enabled by adding the -seg-module LRM option to >> the job manager configuration. >> But in what configuration file does it need to specify "-seg-module" >> option? in $GLOBUS_LOCATION/etc/globus-pbs.conf? > > Doc is here: > http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#gram5-Interface_Config_Frag-seg_module Sorry, I wasn't reading careful enough. It's clear now how to configure SEG from URL above. So now I have $ ll /usr/local/globus-5.0.0/etc/grid-services/jobmanager lrwxrwxrwx 1 globus globus 56 Jan 22 14:58 /usr/local/globus-5.0.0/etc/grid-services/jobmanager -> /usr/local/globus-5.0.0/etc/grid-services/jobmanager-pbs $ cat /usr/local/globus-5.0.0/etc/grid-services/jobmanager-pbs stderr_log,local_cred - /usr/local/globus-5.0.0/libexec/globus-job-manager globus-job-manager -conf /usr/local/globus-5.0.0/etc/globus-job-manager.conf -type pbs -seg-module pbs $ cat /usr/local/globus-5.0.0/etc/globus-pbs.conf log_path=/var/spool/torque/server_logs $ cat /usr/local/globus-5.0.0/etc/globus-job-manager.conf -home "/usr/local/globus-5.0.0" -globus-gatekeeper-host vps115.jinr.ru -globus-gatekeeper-port 2119 -globus-gatekeeper-subject "/C=RU/O=JINR/OU=LIT/CN=vps115.jinr.ru" -globus-host-cputype i686 -globus-host-manufacturer pc -globus-host-osname Linux -globus-host-osversion 2.6.9-023stab046.2 -globus-toolkit-version 5.0.0 -stdio-log "$(HOME)" -log-levels 'FATAL|ERROR' -state-file-dir /usr/local/globus-5.0.0/tmp/gram_job_state $ globus-job-manager-event-generator -scheduler pbs -background -pidfile $GLOBUS_LOCATION/var/globus-job-manager-seg-pbs.pid Error: pbs not configured I've tried also to reload/restart xinetd since globus-gatekeeper is run by xinetd. More hints? GRAM5 was compiled as $ ./configure --prefix=$GLOBUS_LOCATION $ make But $GLOBUS_LOCATION/etc/globus-pbs.conf could be found that's why I run $ make gram5-pbs install. More hints? Nikolay. > > No - it goes in $GLOBUS_LOCATION/etc/grid-services/jobmanager-pbs > > Mine looks like this: > % cat jobmanager-pbs > stderr_log,local_cred - > /home/smartin/gt/5.0.0/INSTALL/libexec/globus-job-manager globus-job-manager > -conf /home/smartin/gt/5.0.0/INSTALL/etc/globus-job-manager.conf -type pbs > -seg-module pbs > >> How? Just add >> '-seg-module' to new line? e.g. >> log_path=/var/spool/torque/server_logs >> -seg-module >> $ cat /usr/local/globus-5.0.0/etc/globus-pbs.conf >> log_path=/var/spool/torque/server_logs >> -seg-module >> >> [root]$ globus-job-manager-event-generator -scheduler pbs -background >> -pidfile $GLOBUS_LOCATION/var/globus-job-manager-seg-pbs.pid >> Error: pbs not configured > > Maybe that is a result of you adding the extra -seg-module line to the > globus-pbs.conf file ?? > >> So what exact steps needs to be performed to run SEG? >> >> Nikolay. >> >>> If not, try using the SEG and see what happens. >>> >>> http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#gram5-Interface_Config_Frag-seg_module >>> >>> http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#id2545819 >>> >>> -Stu >>> >>> On Jan 22, 2010, at Jan 22, 7:43 AM, Nikolay Kutovskiy wrote: >>> Hello list, I have installed GRAM5 to use PBS and get the following output of globus-job-status command: $ globus-job-submit :2119/jobmanager-pbs /bin/hostname https://:51499/16073727533535086921/7782764993921513916/ [user]$ globus-job-status https://:51499/16073727533535086921/7782764993921513916/ UNKNOWN JOB STATE 0 [user]$ globus-job-status https://:51499/16073727533535086921/7782764993921513916/ UNKNOWN JOB STATE 0 [user]$ globus-job-status https://:51499/16073727533535086921/7782764993921513916/ UNKNOWN JOB STATE 0 [user]$ globus-job-status https://:51499/16073727533535086921/7782764993921513916/ DONE Is that a bug? some GRAM5|PBS misconfiguration? Commands like globus-job-run work fine. Environment: gt5.0.0-all-source-installer.tar.bz2 torque-2.3.7-1cri torque-docs-2.3.7-1cri torque-server-2.3.7-1cri torque-client-2.3.7-1cri torque-scheduler-2.3.7-1cri Thanks in advance, Nikolay >
Re: [gt-user] prews-test
There is doc and examples here: http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#gram5-admin-testing -Stu On Jan 22, 2010, at Jan 22, 12:12 PM, Nikolay Kutovskiy wrote: > It is written in documentation > (http://www.globus.org/toolkit/docs/5.0/5.0.0/admin/install/#gtadmin-packaging) > there is the target 'prews-test' which is "Tests for pre-webservices > components". > I wonder how those tests can be run? > > Nikolay.
Re: [gt-user] globus-job-status: UNKNOWN JOB STATE 0
On Jan 22, 2010, at Jan 22, 12:00 PM, Nikolay Kutovskiy wrote: > Hi Stuart > > Stuart Martin wrote on 22/01/10 19:04: >> Hi Nikolay, >> >> Strange. Yea - looks like a bug. Is that repeatable / happens for every >> PBS job? > I haven't tested hard yet but at least I saw such status twice (for > different jobs). > >> >> Are you using the SEG for PBS job monitoring? > not yet. It wasn't clear for me how to configure SEG. It's written: > It must be explicitly enabled by adding the -seg-module LRM option to > the job manager configuration. > But in what configuration file does it need to specify "-seg-module" > option? in $GLOBUS_LOCATION/etc/globus-pbs.conf? Doc is here: http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#gram5-Interface_Config_Frag-seg_module No - it goes in $GLOBUS_LOCATION/etc/grid-services/jobmanager-pbs Mine looks like this: % cat jobmanager-pbs stderr_log,local_cred - /home/smartin/gt/5.0.0/INSTALL/libexec/globus-job-manager globus-job-manager -conf /home/smartin/gt/5.0.0/INSTALL/etc/globus-job-manager.conf -type pbs -seg-module pbs > How? Just add > '-seg-module' to new line? e.g. > log_path=/var/spool/torque/server_logs > -seg-module > $ cat /usr/local/globus-5.0.0/etc/globus-pbs.conf > log_path=/var/spool/torque/server_logs > -seg-module > > [root]$ globus-job-manager-event-generator -scheduler pbs -background > -pidfile $GLOBUS_LOCATION/var/globus-job-manager-seg-pbs.pid > Error: pbs not configured Maybe that is a result of you adding the extra -seg-module line to the globus-pbs.conf file ?? > > So what exact steps needs to be performed to run SEG? > > Nikolay. > >> If not, try using the SEG and see what happens. >> >> http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#gram5-Interface_Config_Frag-seg_module >> >> http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#id2545819 >> >> -Stu >> >> On Jan 22, 2010, at Jan 22, 7:43 AM, Nikolay Kutovskiy wrote: >> >>> Hello list, >>> >>> I have installed GRAM5 to use PBS and get the following output of >>> globus-job-status command: >>> $ globus-job-submit :2119/jobmanager-pbs /bin/hostname >>> https://:51499/16073727533535086921/7782764993921513916/ >>> >>> [user]$ globus-job-status >>> https://:51499/16073727533535086921/7782764993921513916/ >>> UNKNOWN JOB STATE 0 >>> >>> [user]$ globus-job-status >>> https://:51499/16073727533535086921/7782764993921513916/ >>> UNKNOWN JOB STATE 0 >>> >>> [user]$ globus-job-status >>> https://:51499/16073727533535086921/7782764993921513916/ >>> UNKNOWN JOB STATE 0 >>> [user]$ globus-job-status >>> https://:51499/16073727533535086921/7782764993921513916/ >>> DONE >>> >>> Is that a bug? some GRAM5|PBS misconfiguration? >>> >>> Commands like globus-job-run work fine. >>> Environment: >>> gt5.0.0-all-source-installer.tar.bz2 >>> torque-2.3.7-1cri >>> torque-docs-2.3.7-1cri >>> torque-server-2.3.7-1cri >>> torque-client-2.3.7-1cri >>> torque-scheduler-2.3.7-1cri >>> >>> Thanks in advance, >>> Nikolay >>
[gt-user] prews-test
It is written in documentation (http://www.globus.org/toolkit/docs/5.0/5.0.0/admin/install/#gtadmin-packaging) there is the target 'prews-test' which is "Tests for pre-webservices components". I wonder how those tests can be run? Nikolay.
Re: [gt-user] globus-job-status: UNKNOWN JOB STATE 0
Hi Stuart Stuart Martin wrote on 22/01/10 19:04: > Hi Nikolay, > > Strange. Yea - looks like a bug. Is that repeatable / happens for every PBS > job? I haven't tested hard yet but at least I saw such status twice (for different jobs). > > Are you using the SEG for PBS job monitoring? not yet. It wasn't clear for me how to configure SEG. It's written: It must be explicitly enabled by adding the -seg-module LRM option to the job manager configuration. But in what configuration file does it need to specify "-seg-module" option? in $GLOBUS_LOCATION/etc/globus-pbs.conf? How? Just add '-seg-module' to new line? e.g. log_path=/var/spool/torque/server_logs -seg-module $ cat /usr/local/globus-5.0.0/etc/globus-pbs.conf log_path=/var/spool/torque/server_logs -seg-module [root]$ globus-job-manager-event-generator -scheduler pbs -background -pidfile $GLOBUS_LOCATION/var/globus-job-manager-seg-pbs.pid Error: pbs not configured So what exact steps needs to be performed to run SEG? Nikolay. > If not, try using the SEG and see what happens. > > http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#gram5-Interface_Config_Frag-seg_module > > http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#id2545819 > > -Stu > > On Jan 22, 2010, at Jan 22, 7:43 AM, Nikolay Kutovskiy wrote: > >> Hello list, >> >> I have installed GRAM5 to use PBS and get the following output of >> globus-job-status command: >> $ globus-job-submit :2119/jobmanager-pbs /bin/hostname >> https://:51499/16073727533535086921/7782764993921513916/ >> >> [user]$ globus-job-status >> https://:51499/16073727533535086921/7782764993921513916/ >> UNKNOWN JOB STATE 0 >> >> [user]$ globus-job-status >> https://:51499/16073727533535086921/7782764993921513916/ >> UNKNOWN JOB STATE 0 >> >> [user]$ globus-job-status >> https://:51499/16073727533535086921/7782764993921513916/ >> UNKNOWN JOB STATE 0 >> [user]$ globus-job-status >> https://:51499/16073727533535086921/7782764993921513916/ >> DONE >> >> Is that a bug? some GRAM5|PBS misconfiguration? >> >> Commands like globus-job-run work fine. >> Environment: >> gt5.0.0-all-source-installer.tar.bz2 >> torque-2.3.7-1cri >> torque-docs-2.3.7-1cri >> torque-server-2.3.7-1cri >> torque-client-2.3.7-1cri >> torque-scheduler-2.3.7-1cri >> >> Thanks in advance, >> Nikolay >
Re: [gt-user] Simple MDS Alternative
Hi, Yes, we have a team led by U. Chicago that is integrating a new set of open source tools for this purpose. Unlike the original MDS development effort, which was aimed at providing monitoring middleware, our effort is focused on the "service registry" problem. The goal is to provide a high-level metadata registry for services: what services are known to the system, and for each service, what does it do, who is it intended for, who is operating it, what kind of service levels does it support, where's the documentation for it, where can you get current detailed status info, etc. The data for such a system is quite simple, of course. The tricky part is building a (secure) system that allows the people who operate the services (of which there are many) to register the services and maintain their registration data themselves, but then incorporate those registrations in a variety of community-specific registries. E.g., a service at U Chicago is described by the U Chicago operators, but this info then is automatically incorporated into the (distinct) registries used by TeraGrid, OSG, CANARIE, a medical consortium, etc... Our team began by using MDS4, but we've been replacing bits and pieces of it for several years now and now have something that's more based on native Apache tools and REST interfaces. We have an effort underway to feed the results back in to Globus as a replacement for MDS, but there is currently no estimated time for when it will appear again in Globus. The project is being tracked at http://www.ci.uchicago.edu/wiki/bin/view/IIS/WebHome (a relatively new wiki for the existing project), and we have a paper on it: http://doi.acm.org/10.1145/1658260.1658271. (Sorry, I don't have an open full-text version of the paper to point you to.) -- Lee On Jan 21, 2010, at 4:47 PM, Adam Bishop wrote: Greetings, I am researching alternatives to the MDS utility previously included in the Globus 4.x toolkit. The current iteration of the Nimbus monitoring plug-ins for Nagios rely on the MDS to act as the public registry for the dynamic state of a cluster, but I would like to evaluate alternatives. The ability for various sites to submit gathered data to a single "master" registry which can then be queried would be ideal. Complicated query support such as XPath is necessary; simple presenting a snippet of XML is all that is required. If there been any discussion or thoughts regarding an alternative to MDS for resource publishing, I'm very interested to hear about it. Cheers, Adam Bishop University of Victoria
Re: [gt-user] globus-job-status: UNKNOWN JOB STATE 0
Hi Nikolay, Strange. Yea - looks like a bug. Is that repeatable / happens for every PBS job? Are you using the SEG for PBS job monitoring? If not, try using the SEG and see what happens. http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#gram5-Interface_Config_Frag-seg_module http://www.globus.org/toolkit/docs/5.0/5.0.0/execution/gram5/admin/#id2545819 -Stu On Jan 22, 2010, at Jan 22, 7:43 AM, Nikolay Kutovskiy wrote: > Hello list, > > I have installed GRAM5 to use PBS and get the following output of > globus-job-status command: > $ globus-job-submit :2119/jobmanager-pbs /bin/hostname > https://:51499/16073727533535086921/7782764993921513916/ > > [user]$ globus-job-status > https://:51499/16073727533535086921/7782764993921513916/ > UNKNOWN JOB STATE 0 > > [user]$ globus-job-status > https://:51499/16073727533535086921/7782764993921513916/ > UNKNOWN JOB STATE 0 > > [user]$ globus-job-status > https://:51499/16073727533535086921/7782764993921513916/ > UNKNOWN JOB STATE 0 > [user]$ globus-job-status > https://:51499/16073727533535086921/7782764993921513916/ > DONE > > Is that a bug? some GRAM5|PBS misconfiguration? > > Commands like globus-job-run work fine. > Environment: > gt5.0.0-all-source-installer.tar.bz2 > torque-2.3.7-1cri > torque-docs-2.3.7-1cri > torque-server-2.3.7-1cri > torque-client-2.3.7-1cri > torque-scheduler-2.3.7-1cri > > Thanks in advance, > Nikolay
[gt-user] globus-job-status: UNKNOWN JOB STATE 0
Hello list, I have installed GRAM5 to use PBS and get the following output of globus-job-status command: $ globus-job-submit :2119/jobmanager-pbs /bin/hostname https://:51499/16073727533535086921/7782764993921513916/ [user]$ globus-job-status https://:51499/16073727533535086921/7782764993921513916/ UNKNOWN JOB STATE 0 [user]$ globus-job-status https://:51499/16073727533535086921/7782764993921513916/ UNKNOWN JOB STATE 0 [user]$ globus-job-status https://:51499/16073727533535086921/7782764993921513916/ UNKNOWN JOB STATE 0 [user]$ globus-job-status https://:51499/16073727533535086921/7782764993921513916/ DONE Is that a bug? some GRAM5|PBS misconfiguration? Commands like globus-job-run work fine. Environment: gt5.0.0-all-source-installer.tar.bz2 torque-2.3.7-1cri torque-docs-2.3.7-1cri torque-server-2.3.7-1cri torque-client-2.3.7-1cri torque-scheduler-2.3.7-1cri Thanks in advance, Nikolay
[gt-user] GT5.0.0 gcc32dbgpthr problem
Hello, I am trying to build GT5.0.0 from source (since binaries are not available for now). I get the following error: [globus]$ ./configure --prefix=$GLOBUS_LOCATION --with-buildopts="-verbose" [globus]$ make | tee installer.log [...snip...] start - checking whether we are using the GNU C++ compiler... no checking whether /usr/bin/gcc accepts -g... no checking dependency style of /usr/bin/gcc... none checking how to run the C++ preprocessor... /usr/bin/gcc -E configure: error: C++ preprocessor "/usr/bin/gcc -E" fails sanity check See `config.log' for more details. gpt-build > ...SKIPPING gcc32dbgpthr gpt-build > Changing to /home/globus/gt5.0.0-all-source-installer/BUILD WARNING: The following flavors are not supported for this platform: gcc32dbgpthr gpt-build > CHECKING BUILD DEPENDENCIES FOR globus_libtool ERROR: At least one flavor needs to be defined for package globus_libtool make: *** [globus_libtool-thr-compile] Error 2 end - ./configure --prefix=$GLOBUS_LOCATION --with-buildopts="-verbose" doesn't help either. installer.log is available at http://wwwinfo.jinr.ru/~kut/gt/GT5_installer.log. Problem was solved by installing gcc-c++ rpm package (what is not mentioned at http://globus.org/toolkit/docs/latest-stable/admin/install/#gtadmin-prereq-required) Environment: OS version is Scientific Linux 4.8 $ gcc -v Reading specs from /usr/lib/gcc/i386-redhat-linux/3.4.6/specs Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --enable-shared --enable-threads=posix --disable-checking --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-java-awt=gtk --host=i386-redhat-linux Thread model: posix gcc version 3.4.6 20060404 (Red Hat 3.4.6-11) $ make -v GNU Make 3.80 Copyright (C) 2002 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
