Hi everybody!
After about a week of trial and error debugging work i decided to have
some experts look at my problem. ;)
First of all some background: We installed GT 4.0.4 on one of our
clusters and as far as i could remember globusrun-ws (i was asking one
of my collegue who was helping me with the installation but he wasn't
sure himself) was working when we first tried it. After a while we
remarked that some other components of GT weren't working as expected
and we figured the problem was the fact that we run gpt-postinstall as
root and not as user globus while we were installing it, so we run
gpt-postinstall again as user 'globus'.
Now every time we try to use globusrun-ws it hangs. globus-job-run on
the other hand works perfectly.
Here's the output when i try to run a job with globusrun-ws:
globusrun-ws -submit -F hydra -s -c /bin/hostname
Delegating user credentials...Done.
Submitting job...Done.
Job ID: uuid:1f363be0-182a-11dc-8b33-0002a5e72f21
Termination time: 06/12/2007 14:43 GMT
Current job state: Active
hydra <-- it hangs here till i cancel the job.
After cancelling the job it continues and i get this:
Canceling...Canceled.
Destroying job...Done.
Cleaning up any delegated credentials...Done.
globusrun-ws: Operation was canceled
the output of globus-gatekeeper.log
TIME: Mon Jun 11 16:38:17 2007
PID: 24648 -- Notice: 6: Got connection 140.78.104.101 at Mon Jun 11
16:38:17 2007
Failed reading length 0
GSS authentication failure
globus_gss_assist token :3: read failure: Connection closed
Failure: GSS failed Major:01090000 Minor:00000000 Token:00000003
TIME: Mon Jun 11 16:38:17 2007
PID: 24648 -- Failure: GSS failed Major:01090000 Minor:00000000
Token:00000003
I'll attach the container.log to this mail because it's a rather big file!
Does anybody have a clue what could be wrong here?
Regards,
Christoph Spielmann
2007-06-11 16:56:00,640 INFO exec.RunQueue [main,initialize:68] Starting state
machine with 18 run queues.
Exception in thread "GLUE refresher 0" java.lang.NoSuchMethodError:
org.globus.mds.glue.batchprovider.SchedulerType.getInfo()Lorg/globus/mds/glue/InfoType;
at
org.globus.mds.usefulrp.GLUEResourceProperty$SchedulerListener.executionPerformed(GLUEResourceProperty.java:438)
at
org.globus.mds.usefulrp.GLUEResourceProperty$PeriodicExecutor.runScript(GLUEResourceProperty.java:382)
at
org.globus.mds.usefulrp.GLUEResourceProperty$PeriodicExecutor.run(GLUEResourceProperty.java:260)
at java.lang.Thread.run(Thread.java:595)
2007-06-11 16:56:02,635 DEBUG factory.ReliableFileTransferFactoryService
[main,<init>:129] Registration to MDS enabled
Exception in thread "GLUE refresher 0" java.lang.NoSuchMethodError:
org.globus.mds.glue.batchprovider.SchedulerType.getInfo()Lorg/globus/mds/glue/InfoType;
at
org.globus.mds.usefulrp.GLUEResourceProperty$SchedulerListener.executionPerformed(GLUEResourceProperty.java:438)
at
org.globus.mds.usefulrp.GLUEResourceProperty$PeriodicExecutor.runScript(GLUEResourceProperty.java:382)
at
org.globus.mds.usefulrp.GLUEResourceProperty$PeriodicExecutor.run(GLUEResourceProperty.java:260)
at java.lang.Thread.run(Thread.java:595)
2007-06-11 16:56:04,016 INFO exec.ManagedExecutableJobHome
[Thread-3,recover:183] Recovered resource with ID
d299ba90-5d18-11db-8c8b-e0cb149b178b.
2007-06-11 16:56:04,782 DEBUG service.ReliableFileTransferImpl
[main,<init>:338] maximum active allowed:100
2007-06-11 16:56:04,820 DEBUG database.RFTDatabaseSetup
[main,setupDBConnection:162] Setting up db : maximum active connection is 20
2007-06-11 16:56:04,822 DEBUG database.RFTDatabaseSetup
[main,setupDBConnection:164] Setting up db : maximum idle connection is 10
2007-06-11 16:56:04,824 DEBUG database.RFTDatabaseSetup
[main,setupDBConnection:166]
dbOptionsjdbc:postgresql://hydra.gup.uni-linz.ac.at/rftDatabase globus
org.postgresql.Driver 20 1 -1 10
2007-06-11 16:56:06,694 DEBUG service.ReliableFileTransferHome
[main,initialize:61] Loading the RFT home's list of resource keys
2007-06-11 16:56:06,751 DEBUG service.ReliableFileTransferHome
[main,initialize:68] Number of RFT resources to be recovered:0
Starting SOAP server at: https://140.78.104.100:8443/wsrf/services/
With the following services:
[1]: https://140.78.104.100:8443/wsrf/services/AdminService
[2]: https://140.78.104.100:8443/wsrf/services/AuthzCalloutTestService
[3]: https://140.78.104.100:8443/wsrf/services/CASService
[4]: https://140.78.104.100:8443/wsrf/services/ContainerRegistryEntryService
[5]: https://140.78.104.100:8443/wsrf/services/ContainerRegistryService
[6]: https://140.78.104.100:8443/wsrf/services/CounterService
[7]: https://140.78.104.100:8443/wsrf/services/DefaultIndexService
[8]: https://140.78.104.100:8443/wsrf/services/DefaultIndexServiceEntry
[9]: https://140.78.104.100:8443/wsrf/services/DefaultTriggerService
[10]: https://140.78.104.100:8443/wsrf/services/DefaultTriggerServiceEntry
[11]: https://140.78.104.100:8443/wsrf/services/DelegationFactoryService
[12]: https://140.78.104.100:8443/wsrf/services/DelegationService
[13]: https://140.78.104.100:8443/wsrf/services/DelegationTestService
[14]: https://140.78.104.100:8443/wsrf/services/EnactmentEngineService
[15]: https://140.78.104.100:8443/wsrf/services/InMemoryServiceGroup
[16]: https://140.78.104.100:8443/wsrf/services/InMemoryServiceGroupEntry
[17]: https://140.78.104.100:8443/wsrf/services/InMemoryServiceGroupFactory
[18]: https://140.78.104.100:8443/wsrf/services/IndexFactoryService
[19]: https://140.78.104.100:8443/wsrf/services/IndexService
[20]: https://140.78.104.100:8443/wsrf/services/IndexServiceEntry
[21]: https://140.78.104.100:8443/wsrf/services/ManagedExecutableJobService
[22]: https://140.78.104.100:8443/wsrf/services/ManagedJobFactoryService
[23]: https://140.78.104.100:8443/wsrf/services/ManagedMultiJobService
[24]: https://140.78.104.100:8443/wsrf/services/ManagementService
[25]:
https://140.78.104.100:8443/wsrf/services/NotificationConsumerFactoryService
[26]: https://140.78.104.100:8443/wsrf/services/NotificationConsumerService
[27]: https://140.78.104.100:8443/wsrf/services/NotificationTestService
[28]:
https://140.78.104.100:8443/wsrf/services/PersistenceTestSubscriptionManager
[29]:
https://140.78.104.100:8443/wsrf/services/ReliableFileTransferFactoryService
[30]: https://140.78.104.100:8443/wsrf/services/ReliableFileTransferService
[31]: https://140.78.104.100:8443/wsrf/services/RendezvousFactoryService
[32]: https://140.78.104.100:8443/wsrf/services/SampleAuthzService
[33]: https://140.78.104.100:8443/wsrf/services/SchedulerService
[34]: https://140.78.104.100:8443/wsrf/services/SecureCounterService
[35]: https://140.78.104.100:8443/wsrf/services/SecurityTestService
[36]: https://140.78.104.100:8443/wsrf/services/ShutdownService
[37]: https://140.78.104.100:8443/wsrf/services/SubscriptionManagerService
[38]: https://140.78.104.100:8443/wsrf/services/TestAuthzService
[39]: https://140.78.104.100:8443/wsrf/services/TestRPCService
[40]: https://140.78.104.100:8443/wsrf/services/TestService
[41]: https://140.78.104.100:8443/wsrf/services/TestServiceRequest
[42]: https://140.78.104.100:8443/wsrf/services/TestServiceWrongWSDL
[43]: https://140.78.104.100:8443/wsrf/services/TriggerFactoryService
[44]: https://140.78.104.100:8443/wsrf/services/TriggerService
[45]: https://140.78.104.100:8443/wsrf/services/TriggerServiceEntry
[46]: https://140.78.104.100:8443/wsrf/services/Version
[47]: https://140.78.104.100:8443/wsrf/services/WidgetNotificationService
[48]: https://140.78.104.100:8443/wsrf/services/WidgetService
[49]: https://140.78.104.100:8443/wsrf/services/gsi/AuthenticationService
[50]: https://140.78.104.100:8443/wsrf/services/mds/test/execsource/IndexService
[51]:
https://140.78.104.100:8443/wsrf/services/mds/test/execsource/IndexServiceEntry
[52]: https://140.78.104.100:8443/wsrf/services/mds/test/subsource/IndexService
[53]:
https://140.78.104.100:8443/wsrf/services/mds/test/subsource/IndexServiceEntry
2007-06-11 16:56:24,469 INFO exec.StateMachine [RunQueue
Other,logJobAccepted:3236] Job ea084ff6-182b-11dc-8010-0002a5e72f21 accepted
for local user 'agp11092'
2007-06-11 16:56:31,903 INFO impl.DefaultIndexService
[ServiceThread-13,processConfigFile:107] Reading default registration
configuration from file: /opt/globus/etc/globus_wsrf_mds_index/hierarchy.xml
2007-06-11 16:57:14,120 DEBUG factory.ReliableFileTransferFactoryService
[RunQueue FileCleanUp,createReliableFileTransfer:169] PerformanceLog
createReliableFileTransfer() enter
2007-06-11 16:57:14,123 DEBUG factory.ReliableFileTransferFactoryService
[RunQueue FileCleanUp,createReliableFileTransfer:199] Got a delete request
2007-06-11 16:57:14,129 DEBUG database.ReliableFileTransferDbAdapter [RunQueue
FileCleanUp,getNextRequestId:345] next request id: 42
2007-06-11 16:57:14,151 DEBUG database.ReliableFileTransferDbAdapter [RunQueue
FileCleanUp,getNextRequestId:354] updated row with : 43
2007-06-11 16:57:14,192 DEBUG service.ReliableFileTransferHome [RunQueue
FileCleanUp,create:125] Created a ReliableTransferResource with key 43
2007-06-11 16:57:14,209 DEBUG service.ReliableFileTransferResource [RunQueue
FileCleanUp,initialize:419] Enter initialize()
2007-06-11 16:57:14,219 DEBUG database.ReliableFileTransferDbAdapter [RunQueue
FileCleanUp,getOverallStatus:1261] OverallStatus for requestId: 43 Finished:0
Retrying:0 Failed:0 Active:0 Pending:2 Cancelled:0
2007-06-11 16:57:14,228 DEBUG service.ReliableFileTransferResource [RunQueue
FileCleanUp,initialize:445] Exit initialize()
2007-06-11 16:57:14,351 DEBUG service.ReliableFileTransferResource [RunQueue
FileCleanUp,processDelegatedCredential:378] Registered a new listener with
id:0a2903c0-182c-11dc-8bda-e3ecbb876616
2007-06-11 16:57:14,366 DEBUG factory.ReliableFileTransferFactoryService
[RunQueue FileCleanUp,createReliableFileTransfer:239] PerformanceLog created
RFTresource with RequestID:43
2007-06-11 16:57:14,370 DEBUG factory.ReliableFileTransferFactoryService
[RunQueue FileCleanUp,createReliableFileTransfer:258] PerformanceLog exit
createReliableFileTransfer() for :43
2007-06-11 16:57:14,372 DEBUG factory.ReliableFileTransferFactoryService
[RunQueue FileCleanUp,stop:57] MY_PERFORMANCE_LOG%%task=RFT create resource
(complete)%%duration=251%%startTime=2007-06-11 16:57:14
2007-06-11 16:57:16,208 DEBUG service.ReliableFileTransferImpl [RunQueue
FileCleanUp,start:105] PerformanceLog Enter start() 43
2007-06-11 16:57:16,209 DEBUG service.ReliableFileTransferImpl [RunQueue
FileCleanUp,start:111] Start called for : 43
2007-06-11 16:57:16,319 DEBUG service.RFTResourceManager [RunQueue
FileCleanUp,getNext:257] reached concurrency.no more transfers
2007-06-11 16:57:16,321 DEBUG service.ReliableFileTransferImpl [RunQueue
FileCleanUp,start:124] PerformanceLog Exit start() for 43
2007-06-11 16:57:16,322 DEBUG service.ReliableFileTransferImpl [RunQueue
FileCleanUp,stop:57] MY_PERFORMANCE_LOG%%task=RFT start resource
(complete)%%duration=115%%startTime=2007-06-11 16:57:16
2007-06-11 16:57:16,525 DEBUG service.TransferWork [WorkThread-22,run:684] This
is a delete:81
2007-06-11 16:57:16,526 DEBUG service.TransferWork
[WorkThread-22,getDeleteClient:399] [Request 43, Transfer 81] deleting
gsiftp://hydra.gup.uni-linz.ac.at:2811/home/local/agrid/agp11092/ea084ff6-182b-11dc-8010-0002a5e72f21.0.stdout
2007-06-11 16:57:17,272 DEBUG vanilla.FTPControlChannel
[WorkThread-22,open:128] opening control channel to hydra.gup.uni-linz.ac.at :
2811
2007-06-11 16:57:17,283 DEBUG vanilla.Reply [WorkThread-22,<init>:65] read 1st
line
2007-06-11 16:57:17,583 DEBUG vanilla.Reply [WorkThread-22,<init>:68] 1st line:
220 hydra.gup.uni-linz.ac.at GridFTP Server 2.3 (gcc32, 1144436882-63) ready.
2007-06-11 16:57:17,584 DEBUG vanilla.FTPControlChannel
[WorkThread-22,read:259] Control channel received: 220 hydra.gup.uni-linz.ac.at
GridFTP Server 2.3 (gcc32, 1144436882-63) ready.
2007-06-11 16:57:17,630 DEBUG service.DeleteClient [WorkThread-22,<init>:96]
Subject name is null in DeleteClient
2007-06-11 16:57:17,634 DEBUG vanilla.FTPControlChannel
[WorkThread-22,write:279] Control channel sending: AUTH GSSAPI
2007-06-11 16:57:17,635 DEBUG vanilla.Reply [WorkThread-22,<init>:65] read 1st
line
2007-06-11 16:57:17,640 DEBUG vanilla.Reply [WorkThread-22,<init>:68] 1st line:
334 Using authentication type; ADAT must follow.
2007-06-11 16:57:17,641 DEBUG vanilla.FTPControlChannel
[WorkThread-22,read:259] Control channel received: 334 Using authentication
type; ADAT must follow.
2007-06-11 16:57:18,114 DEBUG vanilla.Reply [WorkThread-22,<init>:65] read 1st
line
2007-06-11 16:57:18,119 DEBUG vanilla.Reply [WorkThread-22,<init>:68] 1st line:
235 GSSAPI Authentication successful.
2007-06-11 16:57:18,120 DEBUG vanilla.FTPControlChannel
[WorkThread-22,read:259] Control channel received: 235 GSSAPI Authentication
successful.
2007-06-11 16:57:18,121 DEBUG vanilla.FTPControlChannel
[WorkThread-22,write:279] Control channel sending: USER :globus-mapping:
2007-06-11 16:57:18,122 DEBUG vanilla.Reply [WorkThread-22,<init>:65] read 1st
line
2007-06-11 16:57:18,123 DEBUG vanilla.Reply [WorkThread-22,<init>:68] 1st line:
331 Password required for :globus-mapping:.
2007-06-11 16:57:18,124 DEBUG vanilla.FTPControlChannel
[WorkThread-22,read:259] Control channel received: 331 Password required for
:globus-mapping:.
2007-06-11 16:57:18,124 DEBUG vanilla.FTPControlChannel
[WorkThread-22,write:279] Control channel sending: PASS dummy
2007-06-11 16:57:18,125 DEBUG vanilla.Reply [WorkThread-22,<init>:65] read 1st
line
2007-06-11 16:57:18,130 DEBUG vanilla.Reply [WorkThread-22,<init>:68] 1st line:
230 User agp11092 logged in.
2007-06-11 16:57:18,131 DEBUG vanilla.FTPControlChannel
[WorkThread-22,read:259] Control channel received: 230 User agp11092 logged in.
2007-06-11 16:57:18,131 DEBUG service.TransferWork
[WorkThread-22,statusChanged:155] [Request 43, Transfer 81] status changed
called with status: 3
2007-06-11 16:57:18,135 DEBUG service.RFTResourceManager
[WorkThread-22,updateTransferJob:362] Updating transfer : 81 with status: 3 and
attempts:1
2007-06-11 16:57:18,156 DEBUG service.RFTResourceManager
[WorkThread-22,getOverallStatus:323] OverallStatus for requestId: 43 Finished:0
Retrying:0 Failed:0 Active:1 Pending:1 Cancelled:0
2007-06-11 16:57:18,157 DEBUG service.TransferWork
[WorkThread-22,statusChanged:175] [Request 43, Transfer 81] setting overall rp
to (finished: 0, active: 1, failed: 0, restarted: 0, pending: 1, cancelled: 0)
2007-06-11 16:57:18,166 DEBUG service.DeleteClient [WorkThread-22,delete:187]
Deleting
/home/local/agrid/agp11092/ea084ff6-182b-11dc-8010-0002a5e72f21.0.stdout
2007-06-11 16:57:18,167 DEBUG vanilla.FTPControlChannel
[WorkThread-22,write:279] Control channel sending: DELE
/home/local/agrid/agp11092/ea084ff6-182b-11dc-8010-0002a5e72f21.0.stdout
2007-06-11 16:57:18,168 DEBUG vanilla.Reply [WorkThread-22,<init>:65] read 1st
line
2007-06-11 16:57:18,170 DEBUG vanilla.Reply [WorkThread-22,<init>:68] 1st line:
250 OK.
2007-06-11 16:57:18,171 DEBUG vanilla.FTPControlChannel
[WorkThread-22,read:259] Control channel received: 250 OK.
2007-06-11 16:57:18,171 DEBUG service.TransferWork
[WorkThread-22,processStates:493] [Request 43, Transfer 81] processing state
for transfer of
gsiftp://hydra.gup.uni-linz.ac.at:2811/home/local/agrid/agp11092/ea084ff6-182b-11dc-8010-0002a5e72f21.0.stdout
-> null
2007-06-11 16:57:18,172 DEBUG service.TransferWork
[WorkThread-22,processStates:504] [Request 43, Transfer 81] transfer done
2007-06-11 16:57:18,172 DEBUG service.TransferWork
[WorkThread-22,statusChanged:155] [Request 43, Transfer 81] status changed
called with status: 0
2007-06-11 16:57:18,174 DEBUG service.RFTResourceManager
[WorkThread-22,updateTransferJob:362] Updating transfer : 81 with status: 0 and
attempts:1
2007-06-11 16:57:18,232 DEBUG service.RFTResourceManager
[WorkThread-22,getOverallStatus:323] OverallStatus for requestId: 43 Finished:1
Retrying:0 Failed:0 Active:0 Pending:1 Cancelled:0
2007-06-11 16:57:18,233 DEBUG service.TransferWork
[WorkThread-22,statusChanged:175] [Request 43, Transfer 81] setting overall rp
to (finished: 1, active: 0, failed: 0, restarted: 0, pending: 1, cancelled: 0)
2007-06-11 16:57:18,237 DEBUG service.TransferWork [WorkThread-23,run:684] This
is a delete:82
2007-06-11 16:57:18,238 DEBUG service.TransferWork
[WorkThread-23,getDeleteClient:399] [Request 43, Transfer 82] deleting
gsiftp://hydra.gup.uni-linz.ac.at:2811/home/local/agrid/agp11092/ea084ff6-182b-11dc-8010-0002a5e72f21.0.stderr
2007-06-11 16:57:18,238 DEBUG service.TransferWork
[WorkThread-23,statusChanged:155] [Request 43, Transfer 82] status changed
called with status: 3
2007-06-11 16:57:18,240 DEBUG service.RFTResourceManager
[WorkThread-23,updateTransferJob:362] Updating transfer : 82 with status: 3 and
attempts:1
2007-06-11 16:57:18,256 DEBUG service.RFTResourceManager
[WorkThread-23,getOverallStatus:323] OverallStatus for requestId: 43 Finished:1
Retrying:0 Failed:0 Active:1 Pending:0 Cancelled:0
2007-06-11 16:57:18,272 DEBUG service.TransferWork
[WorkThread-23,statusChanged:175] [Request 43, Transfer 82] setting overall rp
to (finished: 1, active: 1, failed: 0, restarted: 0, pending: 0, cancelled: 0)
2007-06-11 16:57:18,272 DEBUG service.DeleteClient [WorkThread-23,delete:187]
Deleting
/home/local/agrid/agp11092/ea084ff6-182b-11dc-8010-0002a5e72f21.0.stderr
2007-06-11 16:57:18,273 DEBUG vanilla.FTPControlChannel
[WorkThread-23,write:279] Control channel sending: DELE
/home/local/agrid/agp11092/ea084ff6-182b-11dc-8010-0002a5e72f21.0.stderr
2007-06-11 16:57:18,274 DEBUG vanilla.Reply [WorkThread-23,<init>:65] read 1st
line
2007-06-11 16:57:18,276 DEBUG vanilla.Reply [WorkThread-23,<init>:68] 1st line:
250 OK.
2007-06-11 16:57:18,277 DEBUG vanilla.FTPControlChannel
[WorkThread-23,read:259] Control channel received: 250 OK.
2007-06-11 16:57:18,277 DEBUG service.TransferWork
[WorkThread-23,processStates:493] [Request 43, Transfer 82] processing state
for transfer of
gsiftp://hydra.gup.uni-linz.ac.at:2811/home/local/agrid/agp11092/ea084ff6-182b-11dc-8010-0002a5e72f21.0.stderr
-> null
2007-06-11 16:57:18,278 DEBUG service.TransferWork
[WorkThread-23,processStates:504] [Request 43, Transfer 82] transfer done
2007-06-11 16:57:18,278 DEBUG service.TransferWork
[WorkThread-23,statusChanged:155] [Request 43, Transfer 82] status changed
called with status: 0
2007-06-11 16:57:18,280 DEBUG service.RFTResourceManager
[WorkThread-23,updateTransferJob:362] Updating transfer : 82 with status: 0 and
attempts:1
2007-06-11 16:57:18,289 DEBUG service.RFTResourceManager
[WorkThread-23,getOverallStatus:323] OverallStatus for requestId: 43 Finished:2
Retrying:0 Failed:0 Active:0 Pending:0 Cancelled:0
2007-06-11 16:57:18,290 DEBUG service.TransferWork
[WorkThread-23,statusChanged:175] [Request 43, Transfer 82] setting overall rp
to (finished: 2, active: 0, failed: 0, restarted: 0, pending: 0, cancelled: 0)
2007-06-11 16:57:18,291 DEBUG service.TransferWork
[WorkThread-23,setRequestStatus:229] [Request 43, Transfer 82] setting status
RP to Done
2007-06-11 16:57:18,445 DEBUG service.TransferWork
[WorkThread-23,startNewTransfer:623] PerformanceLog All transfers done for 43
2007-06-11 16:57:18,678 DEBUG service.TransferWork
[WorkThread-23,startNewTransfer:636] [Request 43, Transfer 82] all transfers of
43 are done
2007-06-11 16:57:18,679 DEBUG vanilla.FTPControlChannel
[WorkThread-23,write:279] Control channel sending: QUIT
2007-06-11 16:57:18,680 DEBUG vanilla.Reply [WorkThread-23,<init>:65] read 1st
line
2007-06-11 16:57:18,915 DEBUG vanilla.Reply [WorkThread-23,<init>:68] 1st line:
221 Goodbye.
2007-06-11 16:57:18,916 DEBUG vanilla.FTPControlChannel
[WorkThread-23,read:259] Control channel received: 221 Goodbye.
2007-06-11 16:57:18,917 DEBUG vanilla.FTPControlChannel
[WorkThread-23,close:176] ftp socket closed
2007-06-11 16:57:18,917 DEBUG vanilla.FTPServerFacade [WorkThread-23,close:340]
close data channels
2007-06-11 16:57:18,918 DEBUG vanilla.FTPServerFacade [WorkThread-23,close:343]
close server socket
2007-06-11 16:57:18,919 DEBUG vanilla.FTPServerFacade
[WorkThread-23,stopTaskThread:369] stop master thread
2007-06-11 16:57:19,720 DEBUG service.ReliableFileTransferResource [RunQueue
Other,remove:728] Removing the resource with id: 43
2007-06-11 16:57:19,722 DEBUG service.ReliableFileTransferResource [RunQueue
Other,remove:736] deleting subscriptions file
2007-06-11 16:57:19,731 DEBUG service.RFTResourceManager [RunQueue
Other,removeDelegatedCredListeners:211] Removing delegation listeners for id: 43
2007-06-11 16:57:19,747 DEBUG service.RFTResourceManager [RunQueue
Other,removeDelegatedCredListeners:222] Delegation listener to be
destroyed:0a2903c0-182c-11dc-8bda-e3ecbb876616
2007-06-11 16:57:19,851 DEBUG service.ReliableFileTransferResource [RunQueue
Other,remove:749] PerformanceLog RFT Resource with key: 43 Destroyed
2007-06-11 16:57:20,317 INFO exec.StateMachine [RunQueue
CacheCleanUp,logJobFailed:3255] Job ea084ff6-182b-11dc-8010-0002a5e72f21 failed
