Hi,
I have been submitting around 20-40 jobs to two different clusters
recently but I always get an error after most jobs have been submitted.
Error authenticating user at source/dest hostServer refused performing the
request. Custom message: Server refused GSSAPI authentication.
I can get fileStage done for other very similar jobs in the same batch
but after a while I got this error. I've attached the error below, does
anyone know what does this mean? Thanks.
-Ryan
uuid:9d92f540-563d-11dc-8f89-98e0131895db exits abnormlly with error code =
0
Fault:
fault type: org.globus.exec.generated.StagingFaultType:
attribute: fileStageOut
description:
Staging error for RSL element fileStageOut.
faultReason:
faultString:
gt2ErrorCode: 0
originator: Address:
https://129.7.41.247:8443/wsrf/services/ManagedJobFactoryService
Reference property[0]:
<ns6:ResourceID
xmlns:ns6="http://www.globus.org/namespaces/2004/10/gram/job">d7dd2360-563d-
11dc-8227-94bc7c237346</ns6:ResourceID>
stackTrace:
org.globus.exec.generated.StagingFaultType: Staging error for RSL element
fileStageOut.
Timestamp: Wed Aug 29 09:50:23 CDT 2007
Originator: Address:
https://129.7.41.247:8443/wsrf/services/ManagedJobFactoryService
Reference property[0]:
<ns6:ResourceID
xmlns:ns6="http://www.globus.org/namespaces/2004/10/gram/job">d7dd2360-563d-
11dc-8227-94bc7c237346</ns6:ResourceID>
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
sorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
torAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:274)
at java.lang.Class.newInstance0(Class.java:308)
at java.lang.Class.newInstance(Class.java:261)
at org.globus.exec.utils.FaultUtils.makeFault(FaultUtils.java:485)
at
org.globus.exec.utils.FaultUtils.createStagingFault(FaultUtils.java:363)
at
org.globus.exec.service.exec.StateMachine.processStageOutResponseState(State
Machine.java:1936)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at
org.globus.exec.service.exec.StateMachine.processState(StateMachine.java:319
)
at org.globus.exec.service.exec.RunThread.run(RunThread.java:94)
Error authenticating user at source/dest hostServer refused performing the
request. Custom message: Server refused GSSAPI authentication. (error code
1) [Nested exception message: Custom message: Unexpected reply: 421 Idle
Timeout: closing control connection.]. Caused by
org.globus.ftp.exception.ServerException: Server refused performing the
request. Custom message: Server refused GSSAPI authentication. (error code
1) [Nested exception message: Custom message: Unexpected reply: 421 Idle
Timeout: closing control connection.]. Nested exception is
org.globus.ftp.exception.UnexpectedReplyCodeException: Custom message:
Unexpected reply: 421 Idle Timeout: closing control connection.
at
org.globus.ftp.extended.GridFTPControlChannel.authenticate(GridFTPControlCha
nnel.java:166)
at org.globus.ftp.GridFTPClient.authenticate(GridFTPClient.java:99)
at org.globus.ftp.GridFTPClient.authenticate(GridFTPClient.java:84)
at
org.globus.transfer.reliable.service.TransferClient.authenticateDestination(
TransferClient.java:557)
at
org.globus.transfer.reliable.service.TransferClient.authenticate(TransferCli
ent.java:530)
at
org.globus.transfer.reliable.service.TransferWork.getNewClient(TransferWork.
java:445)
at
org.globus.transfer.reliable.service.TransferWork.getTransferClient(Transfer
Work.java:383)
at
org.globus.transfer.reliable.service.TransferWork.run(TransferWork.java:694)
at
org.globus.wsrf.impl.work.WorkManagerImpl$WorkWrapper.run(WorkManagerImpl.ja
va:355)
at java.lang.Thread.run(Thread.java:534)
at java.lang.Class.newInstance(J)Ljava.lang.Object;(Unknown Source)
at
org.apache.axis.encoding.ser.BeanDeserializer.<init>(BeanDeserializer.
java:90)
at
org.apache.axis.encoding.ser.BeanDeserializer.<init>(BeanDeserializer.
java:76)
at
org.globus.exec.generated.StagingFaultType.getDeserializer(StagingFaultType.
java:152)
at
java.lang.reflect.Method.invoke(Ljava.lang.Object;[Ljava.lang.Object;J)Ljava
.lang.Object;(Unknown
Source)
at
org.apache.axis.encoding.ser.BaseDeserializerFactory.getSpecialized(BaseDese
rializerFactory.java:154)
at
org.apache.axis.encoding.ser.BaseDeserializerFactory.getDeserializerAs(BaseD
eserializerFactory.java:84)
at
org.apache.axis.encoding.DeserializationContext.getDeserializer(Deserializat
ionContext.java:464)
at
org.apache.axis.encoding.DeserializationContext.getDeserializerForType(Deser
ializationContext.java:547)
at
org.apache.axis.encoding.ser.BeanDeserializer.getDeserializer(BeanDeserializ
er.java:441)
at
org.apache.axis.encoding.ser.BeanDeserializer.onStartChild(BeanDeserializer.
java:241)
at
org.apache.axis.encoding.DeserializationContext.startElement(Deserialization
Context.java:1035)
at
org.apache.axis.message.SAX2EventRecorder.replay(SAX2EventRecorder.java:165)
at
org.apache.axis.message.MessageElement.publishToHandler(MessageElement.java:
1140)
at
org.apache.axis.message.MessageElement.getValueAsType(MessageElement.java:91
7)
at
org.globus.wsrf.encoding.ObjectDeserializer.toObject(ObjectDeserializer.java
:104)
at
org.globus.exec.client.GramJob.deserializeFaultRP(GramJob.java:1678)
at org.globus.exec.client.GramJob.refreshStatus(GramJob.java:1749)
stateWhenFailureOccurred: StageOut
timestamp:
java.util.GregorianCalendar[time=1188399023102,areFieldsSet=true,areAllField
sSet=true,lenient=true,zone=sun.util.calendar.ZoneInfo[id="GMT",offset=0,dst
Savings=0,useDaylight=false,transitions=0,lastRule=null],firstDayOfWeek=1,mi
nimalDaysInFirstWeek=1,ERA=1,YEAR=2007,MONTH=7,WEEK_OF_YEAR=35,WEEK_OF_MONTH
=5,DAY_OF_MONTH=29,DAY_OF_YEAR=241,DAY_OF_WEEK=4,DAY_OF_WEEK_IN_MONTH=5,AM_P
M=1,HOUR=2,HOUR_OF_DAY=14,MINUTE=50,SECOND=23,MILLISECOND=102,ZONE_OFFSET=0,
DST_OFFSET=0]
Message:
org.globus.exec.generated.StagingFaultType: Staging error for RSL element
fileStageOut.