-----------------
The delegation succeeds, it writes the EPR file almost immediately, but
then takes five minutes to come back and give me a command line prompt.
Has anyone else seen this, and do they know the cause?
No, never saw that before. Do all other calls take so long too, or just the
delegation calls? Does the persisted credential show up on disk
quickly on the server-side (see below for location of persisted creds)
when you delegate?
Further tests show that even when I enter a non-existent host name
in the globus-credential-delegate that the java process it spawns
still takes five minutes to exit. Thread dump of said process
is below.
[t...@snowball osgtg]$ globus-credential-delegate -h tg.opensciencgrid.org
-p 9443 steve.epr.tg
EPR will be written to: steve.epr.tg
2009-02-19 10:12:14,601 ERROR delegation.DelegationUtil
[main,getCertificateChainRP:558] GSSException: Failure unspecified at
GSS-API level [Caused by: tg.opensciencgrid.org: tg.opensciencgrid.org]
Exception in thread "main" Error during startup processing. Caused by .
Caused by AxisFault
faultCode:
{http://schemas.xmlsoap.org/soap/envelope/}Server.userException
faultSubcode:
faultString: GSSException: Failure unspecified at GSS-API level [Caused
by: tg.opensciencgrid.org: tg.opensciencgrid.org]
faultActor:
faultNode:
faultDetail:
{http://xml.apache.org/axis/}stackTrace:Failure unspecified at
GSS-API level. Caused by java.net.UnknownHostException:
tg.opensciencgrid.org: tg.opensciencgrid.org
at java.net.InetAddress.getAllByName0(InetAddress.java:1145)
at java.net.InetAddress.getAllByName(InetAddress.java:1072)
at java.net.InetAddress.getAllByName(InetAddress.java:1008)
at java.net.InetAddress.getByName(InetAddress.java:958)
at
org.globus.gsi.gssapi.GlobusGSSName.<init>(GlobusGSSName.java:112)
at
org.globus.gsi.gssapi.GlobusGSSManagerImpl.createName(GlobusGSSManagerImpl.java:299)
at
org.globus.gsi.gssapi.auth.HostAuthorization.getExpectedName(HostAuthorization.java:62)
at
org.globus.axis.transport.SSLContextHelper.init(SSLContextHelper.java:118)
at
org.globus.axis.transport.SSLContextHelper.<init>(SSLContextHelper.java:65)
at
org.globus.axis.transport.HTTPSSender.getSocket(HTTPSSender.java:41)
at
org.apache.axis.transport.http.HTTPSender.writeToSocket(HTTPSender.java:397)
at
org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:135)
at
org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32)
at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118)
at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83)
at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165)
at org.apache.axis.client.Call.invokeEngine(Call.java:2741)
at org.apache.axis.client.Call.invoke(Call.java:2724)
at org.apache.axis.client.Call.invoke(Call.java:2400)
at org.apache.axis.client.Call.invoke(Call.java:2323)
at org.apache.axis.client.Call.invoke(Call.java:1770)
at
org.globus.delegationService.DelegationFactoryPortTypeSOAPBindingStub.getResourceProperty(DelegationFactoryPortTypeSOAPBindingStub.java:1323)
at
org.globus.delegation.DelegationUtil.getCertificateChainRP(DelegationUtil.java:556)
at
org.globus.delegation.DelegationUtil.getCertificateChainRP(DelegationUtil.java:514)
at
org.globus.delegation.client.BaseClient.getCertificateToSign(BaseClient.java:48)
at org.globus.delegation.client.Delegate.main(Delegate.java:85)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at
org.globus.bootstrap.BootstrapBase.launch(BootstrapBase.java:95)
at org.globus.bootstrap.Bootstrap.main(Bootstrap.java:37)
{http://xml.apache.org/axis/}hostname:snowball.fnal.gov
GSSException: Failure unspecified at GSS-API level [Caused by:
tg.opensciencgrid.org: tg.opensciencgrid.org]
at org.apache.axis.AxisFault.makeFault(AxisFault.java:101)
at
org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:144)
at
org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32)
at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118)
at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83)
at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165)
at org.apache.axis.client.Call.invokeEngine(Call.java:2741)
at org.apache.axis.client.Call.invoke(Call.java:2724)
at org.apache.axis.client.Call.invoke(Call.java:2400)
at org.apache.axis.client.Call.invoke(Call.java:2323)
at org.apache.axis.client.Call.invoke(Call.java:1770)
at
org.globus.delegationService.DelegationFactoryPortTypeSOAPBindingStub.getResourceProperty(DelegationFactoryPortTypeSOAPBindingStub.java:1323)
at
org.globus.delegation.DelegationUtil.getCertificateChainRP(DelegationUtil.java:556)
at
org.globus.delegation.DelegationUtil.getCertificateChainRP(DelegationUtil.java:514)
at
org.globus.delegation.client.BaseClient.getCertificateToSign(BaseClient.java:48)
at org.globus.delegation.client.Delegate.main(Delegate.java:85)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at
org.globus.bootstrap.BootstrapBase.launch(BootstrapBase.java:95)
at org.globus.bootstrap.Bootstrap.main(Bootstrap.java:37)
Caused by: GSSException: Failure unspecified at GSS-API level [Caused by:
tg.opensciencgrid.org: tg.opensciencgrid.org]
at
org.globus.gsi.gssapi.GlobusGSSName.<init>(GlobusGSSName.java:115)
at
org.globus.gsi.gssapi.GlobusGSSManagerImpl.createName(GlobusGSSManagerImpl.java:299)
at
org.globus.gsi.gssapi.auth.HostAuthorization.getExpectedName(HostAuthorization.java:62)
at
org.globus.axis.transport.SSLContextHelper.init(SSLContextHelper.java:118)
at
org.globus.axis.transport.SSLContextHelper.<init>(SSLContextHelper.java:65)
at
org.globus.axis.transport.HTTPSSender.getSocket(HTTPSSender.java:41)
at
org.apache.axis.transport.http.HTTPSender.writeToSocket(HTTPSender.java:397)
at
org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:135)
... 20 more
Full thread dump Java HotSpot(TM) Client VM (1.5.0_14-b03 mixed mode):
"DestroyJavaVM" prio=1 tid=0x0805e1e8 nid=0x6bfb waiting on condition
[0x00000000..0xbfffb790]
"Thread-16" prio=1 tid=0x0874fef8 nid=0x6c12 in Object.wait()
[0x8c6d4000..0x8c6d4f30]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-15" prio=1 tid=0x0874efa8 nid=0x6c11 in Object.wait()
[0x8c755000..0x8c755eb0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-14" prio=1 tid=0x0874e1d0 nid=0x6c10 in Object.wait()
[0x8c7d6000..0x8c7d6e30]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-13" prio=1 tid=0x0874d108 nid=0x6c0f in Object.wait()
[0x8c858000..0x8c8581b0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-12" prio=1 tid=0x0874c1b8 nid=0x6c0e in Object.wait()
[0x8c8d8000..0x8c8d9130]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-11" prio=1 tid=0x0874b1f8 nid=0x6c0d in Object.wait()
[0x8c959000..0x8c95a0b0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-10" prio=1 tid=0x0874a2a8 nid=0x6c0c in Object.wait()
[0x8c9da000..0x8c9db030]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-9" prio=1 tid=0x08749350 nid=0x6c0b in Object.wait()
[0x8ca5b000..0x8ca5bfb0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8d940> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-7" prio=1 tid=0x087483d0 nid=0x6c0a in Object.wait()
[0x8cadc000..0x8cadcf30]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-6" prio=1 tid=0x087443e8 nid=0x6c09 in Object.wait()
[0x8cb5d000..0x8cb5deb0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-5" prio=1 tid=0x08743498 nid=0x6c08 in Object.wait()
[0x8cbde000..0x8cbdee30]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-4" prio=1 tid=0x08742548 nid=0x6c07 in Object.wait()
[0x8cc60000..0x8cc601b0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-3" prio=1 tid=0x08741670 nid=0x6c06 in Object.wait()
[0x8cce0000..0x8cce1130]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-2" prio=1 tid=0x087407f0 nid=0x6c05 in Object.wait()
[0x8cd61000..0x8cd620b0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-1" prio=1 tid=0x08745770 nid=0x6c04 in Object.wait()
[0x8cde2000..0x8cde3030]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Thread-0" prio=1 tid=0x086a3578 nid=0x6c03 in Object.wait()
[0x8ce63000..0x8ce63fb0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(Unknown
Source)
- locked <0x90c8dd10> (a java.lang.Object)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor.getTask(Unknown
Source)
at
EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:595)
"Low Memory Detector" daemon prio=1 tid=0x080d7c58 nid=0x6c01 runnable
[0x00000000..0x00000000]
"CompilerThread0" daemon prio=1 tid=0x080d66a8 nid=0x6c00 waiting on
condition [0x00000000..0x8de8b818]
"Signal Dispatcher" daemon prio=1 tid=0x080d5828 nid=0x6bff runnable
[0x00000000..0x00000000]
"Finalizer" daemon prio=1 tid=0x080caae8 nid=0x6bfe in Object.wait()
[0x8e18d000..0x8e18e130]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c3f818> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:120)
- locked <0x90c3f818> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:136)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=1 tid=0x080c9e20 nid=0x6bfd in
Object.wait() [0x8e20e000..0x8e20f0b0]
at java.lang.Object.wait(Native Method)
- waiting on <0x90c3f8a0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:474)
at
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x90c3f8a0> (a java.lang.ref.Reference$Lock)
"VM Thread" prio=1 tid=0x080c7118 nid=0x6bfc runnable
"VM Periodic Task Thread" prio=1 tid=0x080d9148 nid=0x6c02 waiting on
condition
