Dear fellow GT users,

I am encountering a problem when attempting to transfer a large file using GridFTP. The size of the file is ~5GB (4,831,840,904 bytes, to be specific) and I try to transfer it with a command of the form:

  globus-url-copy -dbg file:///<path to local file> \
    gsiftp://<remote server>/<path>

The transfer progresses for approx. 25 minutes, with debugging output of the form:

  debug: data callback, no error, buffer 0xf7a89008, length 1048576,
  offset=4829741056, eof=false
  debug: data callback, no error, buffer 0xf7988008, length 1048576,
  offset=4830789632, eof=false
  debug: data callback, no error, buffer 0xf7b8a008, length 2696,
  offset=4831838208, eof=true

... at which point the transfer appears to hang indefinitely.

If I check the destination, I see that the remote file has been created, has the correct length and checksum, and has a sensible creation time. However, the client never exits (I've left it to run for up to an hour before aborting).

I am able to transfer smaller files (I've tried a 10 MB file) successfully, and I've checked that there is sufficient space on the remote machine to hold the file.

Interestingly, if I activate parallel streams:

  globus-url-copy -dbg -p 4 file:///<path to local file> \
    gsiftp://<remote server>/<path>

the transfer does complete successfully (in around 10 minutes), so I am wondering if the problem is related to the transfer time, rather than the file size.

My client is running:

  > globus-url-copy -version

  globus-url-copy: 3.20

on a linux machine (kernel version 2.6.9). The remote server is running a similar version of linux and reports GridFTP Server 1.12.

Any advice on what might be causing the problem would be much appreciated.

Thanks in advance,
George.

--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

Reply via email to