Hi Martin,
I have set it to 60 but I now get a different error
uuid:b1b74400-626c-11dc-8d0a-e6b9c339d7fa exits abnormally with error code =
0
Fault:
fault type: org.globus.exec.generated.StagingFaultType:
attribute: fileStageOut
description:
Staging error for RSL element fileStageOut.
faultReason:
faultString:
gt2ErrorCode: 0
originator: Address:
https://128.42.61.211:8443/wsrf/services/ManagedJobFactoryService
Reference property[0]:
<ns6:ResourceID
xmlns:ns6="http://www.globus.org/namespaces/2004/10/gram/job";>b8b5bb60-626c-
11dc-afd0-9daa1fcc3b74</ns6:ResourceID>
stackTrace:
org.globus.exec.generated.StagingFaultType: Staging error for RSL element
fileStageOut.
Timestamp: Thu Sep 13 22:12:21 CDT 2007
Originator: Address:
https://128.42.61.211:8443/wsrf/services/ManagedJobFactoryService
Reference property[0]:
<ns6:ResourceID
xmlns:ns6="http://www.globus.org/namespaces/2004/10/gram/job";>b8b5bb60-626c-
11dc-afd0-9daa1fcc3b74</ns6:ResourceID>
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
sorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
torAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:274)
at java.lang.Class.newInstance0(Class.java:308)
at java.lang.Class.newInstance(Class.java:261)
at org.globus.exec.utils.FaultUtils.makeFault(FaultUtils.java:485)
at
org.globus.exec.utils.FaultUtils.createStagingFault(FaultUtils.java:363)
at
org.globus.exec.service.exec.StateMachine.processStageOutResponseState(State
Machine.java:1936)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at
org.globus.exec.service.exec.StateMachine.processState(StateMachine.java:319
)
at org.globus.exec.service.exec.RunThread.run(RunThread.java:94)
Transient transfer error
Server refused performing the request. Custom message: Server reported
transfer failure (error code 1) [Nested exception message: Custom message:
Unexpected reply: 500-Command failed. :
globus_gridftp_server_file.c:globus_l_gfs_file_server_write_cb:1920:
500-callback failed.
500-globus_xio_system_select.c:globus_l_xio_system_try_writev:1474:
500-System error in writev: Connection timed out
500-globus_xio: A system call failed: Connection timed out
500 End.]. Caused by org.globus.ftp.exception.ServerException: Server
refused performing the request. Custom message: Server reported transfer
failure (error code 1) [Nested exception message: Custom message:
Unexpected reply: 500-Command failed. :
globus_gridftp_server_file.c:globus_l_gfs_file_server_write_cb:1920:
500-callback failed.
I wonder if you know what caused that 500-callback fail? "500-System error
in writev: Connection timed out" Thank you.
-Ryan
-----Original Message-----
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]
Sent: Wednesday, August 29, 2007 5:44 PM
To: Ryan(Yang) Zhang
Cc: [email protected]
Subject: Re: [gt-user] GSIFTP error: Error authenticating user at
source/dest hostServer refused performing the request
Ryan,
Do you have admin access to the GridFTP servers? If so: add the
following option to $GLOBUS_LOCATION/etc/gridftp.conf:
control_preauth_timeout 60
If that file doesn't exist, create it. Restart the GridFTP server
after that (more infos on
http://www.globus.org/toolkit/docs/4.0/data/gridftp/admin-index.html)
I had exactly the same error message and the problem seems to be
that RFT creates a connection to a GridFTP server and authenticates
more than 30 seconds later (30s is the default value for that
timeout). You may set it even to a higher value.
It would be interesting for us to know if this solves the issue for
you too. RFT should probably handle this better, hopefully we can fix
that soon.
Martin
> Hi,
> I have been submitting around 20-40 jobs to two different clusters
> recently but I always get an error after most jobs have been submitted.
> Error authenticating user at source/dest hostServer refused performing the
> request. Custom message: Server refused GSSAPI authentication.
> I can get fileStage done for other very similar jobs in the same batch
> but after a while I got this error. I've attached the error below, does
> anyone know what does this mean? Thanks.
>
> -Ryan
>
> uuid:9d92f540-563d-11dc-8f89-98e0131895db exits abnormlly with error code
> =
> 0
> Fault:
> fault type: org.globus.exec.generated.StagingFaultType:
> attribute: fileStageOut
> description:
> Staging error for RSL element fileStageOut.
> faultReason:
> faultString:
> gt2ErrorCode: 0
> originator: Address:
> https://129.7.41.247:8443/wsrf/services/ManagedJobFactoryService
> Reference property[0]:
> <ns6:ResourceID
>
xmlns:ns6="http://www.globus.org/namespaces/2004/10/gram/job";>d7dd2360-563d-
> 11dc-8227-94bc7c237346</ns6:ResourceID>
>
> stackTrace:
> org.globus.exec.generated.StagingFaultType: Staging error for RSL element
> fileStageOut.
> Timestamp: Wed Aug 29 09:50:23 CDT 2007
> Originator: Address:
> https://129.7.41.247:8443/wsrf/services/ManagedJobFactoryService
> Reference property[0]:
> <ns6:ResourceID
>
xmlns:ns6="http://www.globus.org/namespaces/2004/10/gram/job";>d7dd2360-563d-
> 11dc-8227-94bc7c237346</ns6:ResourceID>
>
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
>
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
> sorImpl.java:39)
> at
>
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
> torAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:274)
> at java.lang.Class.newInstance0(Class.java:308)
> at java.lang.Class.newInstance(Class.java:261)
> at org.globus.exec.utils.FaultUtils.makeFault(FaultUtils.java:485)
> at
> org.globus.exec.utils.FaultUtils.createStagingFault(FaultUtils.java:363)
> at
>
org.globus.exec.service.exec.StateMachine.processStageOutResponseState(State
> Machine.java:1936)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
> )
> at
>
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
> .java:25)
> at java.lang.reflect.Method.invoke(Method.java:324)
> at
>
org.globus.exec.service.exec.StateMachine.processState(StateMachine.java:319
> )
> at org.globus.exec.service.exec.RunThread.run(RunThread.java:94)
> Error authenticating user at source/dest hostServer refused performing the
> request. Custom message: Server refused GSSAPI authentication. (error code
> 1) [Nested exception message: Custom message: Unexpected reply: 421 Idle
> Timeout: closing control connection.]. Caused by
> org.globus.ftp.exception.ServerException: Server refused performing the
> request. Custom message: Server refused GSSAPI authentication. (error code
> 1) [Nested exception message: Custom message: Unexpected reply: 421 Idle
> Timeout: closing control connection.]. Nested exception is
> org.globus.ftp.exception.UnexpectedReplyCodeException: Custom message:
> Unexpected reply: 421 Idle Timeout: closing control connection.
> at
>
org.globus.ftp.extended.GridFTPControlChannel.authenticate(GridFTPControlCha
> nnel.java:166)
> at
> org.globus.ftp.GridFTPClient.authenticate(GridFTPClient.java:99)
> at
> org.globus.ftp.GridFTPClient.authenticate(GridFTPClient.java:84)
> at
>
org.globus.transfer.reliable.service.TransferClient.authenticateDestination(
> TransferClient.java:557)
> at
>
org.globus.transfer.reliable.service.TransferClient.authenticate(TransferCli
> ent.java:530)
> at
>
org.globus.transfer.reliable.service.TransferWork.getNewClient(TransferWork.
> java:445)
> at
>
org.globus.transfer.reliable.service.TransferWork.getTransferClient(Transfer
> Work.java:383)
> at
>
org.globus.transfer.reliable.service.TransferWork.run(TransferWork.java:694)
> at
>
org.globus.wsrf.impl.work.WorkManagerImpl$WorkWrapper.run(WorkManagerImpl.ja
> va:355)
> at java.lang.Thread.run(Thread.java:534)
>
> at java.lang.Class.newInstance(J)Ljava.lang.Object;(Unknown
> Source)
> at
>
org.apache.axis.encoding.ser.BeanDeserializer.<init>(BeanDeserializer.
> java:90)
> at
>
org.apache.axis.encoding.ser.BeanDeserializer.<init>(BeanDeserializer.
> java:76)
> at
>
org.globus.exec.generated.StagingFaultType.getDeserializer(StagingFaultType.
> java:152)
> at
>
java.lang.reflect.Method.invoke(Ljava.lang.Object;[Ljava.lang.Object;J)Ljava
> .lang.Object;(Unknown
> Source)
> at
>
org.apache.axis.encoding.ser.BaseDeserializerFactory.getSpecialized(BaseDese
> rializerFactory.java:154)
> at
>
org.apache.axis.encoding.ser.BaseDeserializerFactory.getDeserializerAs(BaseD
> eserializerFactory.java:84)
> at
>
org.apache.axis.encoding.DeserializationContext.getDeserializer(Deserializat
> ionContext.java:464)
> at
>
org.apache.axis.encoding.DeserializationContext.getDeserializerForType(Deser
> ializationContext.java:547)
> at
>
org.apache.axis.encoding.ser.BeanDeserializer.getDeserializer(BeanDeserializ
> er.java:441)
> at
>
org.apache.axis.encoding.ser.BeanDeserializer.onStartChild(BeanDeserializer.
> java:241)
> at
>
org.apache.axis.encoding.DeserializationContext.startElement(Deserialization
> Context.java:1035)
> at
>
org.apache.axis.message.SAX2EventRecorder.replay(SAX2EventRecorder.java:165)
> at
>
org.apache.axis.message.MessageElement.publishToHandler(MessageElement.java:
> 1140)
> at
>
org.apache.axis.message.MessageElement.getValueAsType(MessageElement.java:91
> 7)
> at
>
org.globus.wsrf.encoding.ObjectDeserializer.toObject(ObjectDeserializer.java
> :104)
> at
> org.globus.exec.client.GramJob.deserializeFaultRP(GramJob.java:1678)
> at org.globus.exec.client.GramJob.refreshStatus(GramJob.java:1749)
>
> stateWhenFailureOccurred: StageOut
> timestamp:
>
java.util.GregorianCalendar[time=1188399023102,areFieldsSet=true,areAllField
>
sSet=true,lenient=true,zone=sun.util.calendar.ZoneInfo[id="GMT",offset=0,dst
>
Savings=0,useDaylight=false,transitions=0,lastRule=null],firstDayOfWeek=1,mi
>
nimalDaysInFirstWeek=1,ERA=1,YEAR=2007,MONTH=7,WEEK_OF_YEAR=35,WEEK_OF_MONTH
>
=5,DAY_OF_MONTH=29,DAY_OF_YEAR=241,DAY_OF_WEEK=4,DAY_OF_WEEK_IN_MONTH=5,AM_P
>
M=1,HOUR=2,HOUR_OF_DAY=14,MINUTE=50,SECOND=23,MILLISECOND=102,ZONE_OFFSET=0,
> DST_OFFSET=0]
> Message:
> org.globus.exec.generated.StagingFaultType: Staging error for RSL element
> fileStageOut.
>
>
>
