On Tue, Jun 22, 2010 at 3:21 PM, Martin Feller <[email protected]> wrote:
> Please enable debug logging on the server-side in ws-gram and send
> the container logfile containing logs of a problematic job submission.
I have enabled the debug logging in ws-gram by uncommenting the following line:
log4j.category.org.globus.exec=DEBUG
in the $GLOBUS_LOCATION/container-log4j.properties file.
This is what I get by running "globusrun-ws -submit -c /bin/touch touched_it":
2010-06-22 19:14:06,548 DEBUG monitoring.JobStateMonitor
[Timer-3,flushCache:358] Entering flushCache()
2010-06-22 19:14:06,550 DEBUG monitoring.JobStateMonitor
[Timer-3,flushCache:398] Exiting flushCache()
2010-06-22 19:14:50,526 WARN authorization.GridMapAuthorization
[ServiceThread-73,isPermitted:170] Gridmap authorization failed: peer
"/O=KGrid/CN=Marco Lackovic" not in gridmap file
"/etc/grid-security/grid-mapfile"
2010-06-22 19:14:50,527 WARN authorization.ServiceAuthorizationChain
[ServiceThread-73,authorize:292] "/O=KGrid/CN=Marco Lackovic" is not
authorized to use operation:
{http://www.globus.org/namespaces/2004/10/gram/job}createManagedJob on
this service
2010-06-22 19:15:06,547 DEBUG monitoring.JobStateMonitor
[Timer-3,flushCache:358] Entering flushCache()
2010-06-22 19:15:06,548 DEBUG monitoring.JobStateMonitor
[Timer-3,flushCache:398] Exiting flushCache()
And this is what I get starting the container:
2010-06-22 19:13:02,250 DEBUG factory.ManagedJobFactoryService
[main,<init>:67] Creating ManagedJobFactoryService
2010-06-22 19:13:02,400 DEBUG exec.ManagedExecutableJobHome
[main,<init>:120] Entering ManagedExecutableJobHome()
2010-06-22 19:13:02,401 DEBUG exec.ManagedExecutableJobHome
[main,<init>:121] Leaving ManagedExecutableJobHome()
2010-06-22 19:13:02,423 DEBUG exec.ManagedExecutableJobHome
[main,initialize:131] Entering initialize()
2010-06-22 19:13:02,434 DEBUG exec.RunQueue [main,<clinit>:70] created
RunQueue with 18 threads
2010-06-22 19:13:02,521 DEBUG exec.StateMachine [main,init:129] local
invocations: false
2010-06-22 19:13:02,586 DEBUG exec.ManagedExecutableJobHome
[main,initialize:157] Leaving initialize()
2010-06-22 19:13:06,002 DEBUG utils.AuthorizationHelper
[main,initialize:38] getting factory service name
2010-06-22 19:13:06,003 DEBUG utils.AuthorizationHelper
[main,initialize:43] getting security descriptor for JNDI path
ManagedJobFactoryService
2010-06-22 19:13:06,010 DEBUG utils.AuthorizationHelper
[main,initialize:48] getting authz PDP name
2010-06-22 19:13:06,011 DEBUG utils.AuthorizationHelper
[main,initialize:57] Detected authorization PDP plugin "gridmap".
2010-06-22 19:13:06,011 DEBUG utils.AuthorizationHelper
[main,initialize:62] Using gridmap authorization PDP plugin.
2010-06-22 19:13:06,016 DEBUG factory.ManagedJobFactoryHome
[main,initialize:105] Creating ManagedJobFactoryHome
2010-06-22 19:13:06,043 DEBUG factory.ManagedJobFactoryHome
[main,initialize:124] Register to MDS: true
2010-06-22 19:13:06,073 DEBUG factory.ManagedJobFactoryHome
[main,initialize:138] JNDI: binding found home:
org.globus.wsrf.jndi.ServiceResourceRef:ResourceRef[className=org.globus.exec.service.factory.ManagedJobFactoryHome,factoryClassLocation=null,factoryClassName=org.apache.naming.factory.ResourceFactory,{type=resourceKeyType,content=java.lang.String},{type=factory,content=org.globus.wsrf.jndi.BeanFactory},{type=resourceClass,content=org.globus.exec.service.factory.ManagedJobFactoryResource}]
2010-06-22 19:13:06,074 DEBUG factory.ManagedJobFactoryHome
[main,initialize:146] boundJNDIObjectClazz=class
org.globus.exec.service.factory.ManagedJobFactoryHome
2010-06-22 19:13:06,075 DEBUG factory.ManagedJobFactoryHome
[main,initialize:138] JNDI: binding found mdsConfiguration:
org.globus.wsrf.impl.servicegroup.client.MDSConfiguration:org.globus.wsrf.impl.servicegroup.client.mdsconfigurat...@396cbd97
2010-06-22 19:13:06,076 DEBUG factory.ManagedJobFactoryHome
[main,initialize:146] boundJNDIObjectClazz=class
org.globus.wsrf.impl.servicegroup.client.MDSConfiguration
2010-06-22 19:13:06,076 DEBUG factory.ManagedJobFactoryHome
[main,initialize:138] JNDI: binding found MultiResourceConfiguration:
org.globus.wsrf.jndi.ServiceResourceRef:ResourceRef[className=org.globus.exec.service.factory.FactoryResourceConfiguration,factoryClassLocation=null,factoryClassName=org.apache.naming.factory.ResourceFactory,{type=enableDefaultSoftwareEnvironment,content=false},{type=substitutionDefinitionsRefreshPeriod,content=480},{type=factory,content=org.globus.wsrf.jndi.BeanFactory},{type=substitutionDefinitionsFile,content=/usr/local/globus-4.0.8//etc/gram-service-Multi/substitution-definition.properties},{type=localResourceManagerName,content=Multi}]
2010-06-22 19:13:06,077 DEBUG factory.ManagedJobFactoryHome
[main,initialize:146] boundJNDIObjectClazz=class
org.globus.exec.service.factory.FactoryResourceConfiguration
2010-06-22 19:13:06,081 DEBUG factory.ManagedJobFactoryHome
[main,initialize:155] Creating factory resource for Multi
2010-06-22 19:13:06,107 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}localResourceManager
2010-06-22 19:13:06,130 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}globusLocation
2010-06-22 19:13:06,131 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}hostCPUType
2010-06-22 19:13:06,133 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}hostManufacturer
2010-06-22 19:13:06,133 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}hostOSName
2010-06-22 19:13:06,134 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}hostOSVersion
2010-06-22 19:13:06,135 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}scratchBaseDirectory
2010-06-22 19:13:06,135 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}delegationFactoryEndpoint
2010-06-22 19:13:06,138 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}stagingDelegationFactoryEndpoint
2010-06-22 19:13:06,141 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}condorArchitecture
2010-06-22 19:13:06,142 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}condorOS
2010-06-22 19:13:06,143 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://mds.globus.org/glue/ce/1.1}GLUECE
2010-06-22 19:13:06,143 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://mds.globus.org/glue/ce/1.1}GLUECESummary
2010-06-22 19:13:06,144 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://mds.globus.org/metadata/2005/02}ServiceMetaDataInfo
2010-06-22 19:13:06,147 DEBUG exec.ManagedExecutableJobHome
[main,getHome:479] created MEJH instance
2010-06-22 19:13:06,148 DEBUG factory.ManagedJobFactoryHome
[main,add:222] In custom add
2010-06-22 19:13:06,157 DEBUG factory.ManagedJobFactoryResource
[Timer-1,refresh:435] Refreshed Substitution Definitions:
{GLOBUS_LOCATION=/usr/local/globus-4.0.8/}
2010-06-22 19:13:06,169 DEBUG factory.ManagedJobFactoryHome
[main,add:229] registering to MDS
2010-06-22 19:13:06,169 DEBUG factory.ManagedJobFactoryResource
[Thread-3,run:186] recovery thread active
2010-06-22 19:13:06,181 DEBUG exec.ManagedExecutableJobHome
[Thread-3,recover:179] Entering recover()
2010-06-22 19:13:06,201 DEBUG exec.ManagedExecutableJobHome
[Thread-3,recover:187] Loading the home's list of resource keys
2010-06-22 19:13:06,234 DEBUG exec.ManagedExecutableJobHome
[Thread-3,recover:250] Leaving recover()
2010-06-22 19:13:06,234 DEBUG factory.ManagedJobFactoryResource
[Thread-3,run:200] recovery thread finished
2010-06-22 19:13:06,412 DEBUG factory.ManagedJobFactoryHome
[main,initialize:138] JNDI: binding found securityProp:
org.apache.naming.SynchronizedContext:org.apache.naming.synchronizedcont...@2c6691da
2010-06-22 19:13:06,412 DEBUG factory.ManagedJobFactoryHome
[main,initialize:146] boundJNDIObjectClazz=class
org.apache.naming.SynchronizedContext
2010-06-22 19:13:06,413 DEBUG factory.ManagedJobFactoryHome
[main,initialize:138] JNDI: binding found ForkResourceConfiguration:
org.globus.wsrf.jndi.ServiceResourceRef:ResourceRef[className=org.globus.exec.service.factory.FactoryResourceConfiguration,factoryClassLocation=null,factoryClassName=org.apache.naming.factory.ResourceFactory,{type=enableDefaultSoftwareEnvironment,content=false},{type=substitutionDefinitionsRefreshPeriod,content=480},{type=factory,content=org.globus.wsrf.jndi.BeanFactory},{type=substitutionDefinitionsFile,content=/usr/local/globus-4.0.8//etc/gram-service-Fork/substitution-definition.properties},{type=localResourceManagerName,content=Fork}]
2010-06-22 19:13:06,414 DEBUG factory.ManagedJobFactoryHome
[main,initialize:146] boundJNDIObjectClazz=class
org.globus.exec.service.factory.FactoryResourceConfiguration
2010-06-22 19:13:06,415 DEBUG factory.ManagedJobFactoryHome
[main,initialize:155] Creating factory resource for Fork
2010-06-22 19:13:06,416 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}localResourceManager
2010-06-22 19:13:06,417 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}globusLocation
2010-06-22 19:13:06,417 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}hostCPUType
2010-06-22 19:13:06,418 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}hostManufacturer
2010-06-22 19:13:06,418 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}hostOSName
2010-06-22 19:13:06,419 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}hostOSVersion
2010-06-22 19:13:06,419 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}scratchBaseDirectory
2010-06-22 19:13:06,423 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}delegationFactoryEndpoint
2010-06-22 19:13:06,424 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}stagingDelegationFactoryEndpoint
2010-06-22 19:13:06,424 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}condorArchitecture
2010-06-22 19:13:06,425 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://www.globus.org/namespaces/2004/10/gram/job}condorOS
2010-06-22 19:13:06,426 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://mds.globus.org/glue/ce/1.1}GLUECE
2010-06-22 19:13:06,427 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://mds.globus.org/glue/ce/1.1}GLUECESummary
2010-06-22 19:13:06,427 DEBUG factory.ManagedJobFactoryResource
[main,createNewResourceProperty:311] Creating resource property for:
{http://mds.globus.org/metadata/2005/02}ServiceMetaDataInfo
2010-06-22 19:13:06,435 DEBUG monitoring.JobStateMonitor
[main,getInstance:151] Constructing JobStateMonitor
2010-06-22 19:13:06,454 DEBUG monitoring.JobStateMonitor
[main,getInstance:167] Initialized JSM (SEG daemon status true)
2010-06-22 19:13:06,520 DEBUG monitoring.JobStateMonitor
[main,start:290] Entering start()
2010-06-22 19:13:06,543 DEBUG monitoring.JobStateMonitor
[main,start:297] starting seg with timestamp Tue Jun 22 13:31:28 BST
2010
2010-06-22 19:13:06,544 DEBUG monitoring.SchedulerEventGenerator
[main,start:348] Starting seg thread
2010-06-22 19:13:06,546 DEBUG monitoring.JobStateMonitor
[main,start:304] creating flush task
2010-06-22 19:13:06,554 DEBUG monitoring.JobStateMonitor
[main,start:316] creating recovery update task
2010-06-22 19:13:06,555 DEBUG monitoring.JobStateMonitor
[main,start:325] Exiting start()
2010-06-22 19:13:06,567 DEBUG factory.ManagedJobFactoryResource
[Thread-7,run:186] recovery thread active
2010-06-22 19:13:06,571 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,throttleRestart:299] throttleRestart called
2010-06-22 19:13:06,580 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,startSegProcess:253] Starting seg process
2010-06-22 19:13:06,580 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,startSegProcess:272] executing command:
2010-06-22 19:13:06,580 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,startSegProcess:275]
->/usr/local/globus-4.0.8/libexec/globus-scheduler-event-generator
2010-06-22 19:13:06,580 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,startSegProcess:275] ->-s
2010-06-22 19:13:06,581 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,startSegProcess:275] ->fork
2010-06-22 19:13:06,581 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,startSegProcess:275] ->-t
2010-06-22 19:13:06,581 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,startSegProcess:275] ->1277209888
2010-06-22 19:13:06,580 DEBUG factory.ManagedJobFactoryResource
[Thread-7,run:200] recovery thread finished
2010-06-22 19:13:06,580 DEBUG factory.ManagedJobFactoryResource
[Timer-1,refresh:435] Refreshed Substitution Definitions:
{GLOBUS_LOCATION=/usr/local/globus-4.0.8/}
2010-06-22 19:13:06,702 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,run:134] Started SEG process for local resource manager fork
2010-06-22 19:13:06,702 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,run:142] getting seg input
2010-06-22 19:13:06,703 DEBUG monitoring.SchedulerEventGenerator
[Thread-6,run:147] Seg input buffer is not ready
2010-06-22 19:13:06,708 DEBUG factory.ManagedJobFactoryHome
[main,add:222] In custom add
2010-06-22 19:13:06,718 DEBUG factory.ManagedJobFactoryHome
[main,add:229] registering to MDS
2010-06-22 19:13:06,741 DEBUG factory.ManagedJobFactoryHome
[main,initialize:138] JNDI: binding found configuration:
org.globus.exec.service.factory.FactoryServiceConfiguration:org.globus.exec.service.factory.factoryserviceconfigurat...@52e3fda4
2010-06-22 19:13:06,742 DEBUG factory.ManagedJobFactoryHome
[main,initialize:146] boundJNDIObjectClazz=class
org.globus.exec.service.factory.FactoryServiceConfiguration
2010-06-22 19:13:06,742 DEBUG factory.ManagedJobFactoryHome
[main,initialize:138] JNDI: binding found homeConfiguration:
org.globus.exec.service.factory.FactoryHomeConfiguration:org.globus.exec.service.factory.factoryhomeconfigurat...@7621447f
2010-06-22 19:13:06,743 DEBUG factory.ManagedJobFactoryHome
[main,initialize:146] boundJNDIObjectClazz=class
org.globus.exec.service.factory.FactoryHomeConfiguration
--
Marco Lackovic
http://grid.deis.unical.it/lackovic/
