Dear Globus folks,
(maybe this should go to -dev rather than -user)
We have been testing GridFTP + UDT (gt5.0.2) for the Bio-mirror.net project,
which daily mirrors 100's of GB of biology data around the world. The results
so far are very good. There have been some installation problems, and
I have code patches if you want them. A few of these I think would be
usefully added to a future GridFTP release.
- Don Gilbert
Summary of GridFTP (gt5.0.2) patches
-- UDT change udt4/src/channel.cpp for Solaris10:
add UNIX to ifdef BSD, OSX for setsockopt max buffer
-- UDT globus configure{.ac}: update for *solaris* and *darwin* flags
(always compiles with -DLINUX otherwise, also fails to configure
on Linux-Powerpc, were it tries assembly for wrong processor)
-- gridftp server, anonymous ftp directories: limit to anonymous user home
dir
in globus_i_gfs_control.c:globus_l_gfs_get_full_path() : add anon_user
path restrictions
(I tried chroot() first but that was overly complex to decipher).
-- gridftp server: log_transfers, UDT client IP was 0.0.0.0 always
globus_i_gfs_data.c:globus_l_gfs_data_end_transfer_kickout() : small
patch
-- globus-url-copy: set dest file timestamp to match source file time
(essential for -sync, usual FTP practice)
globus_url_copy.c: add globus_l_set_dest_timestamp() and add int
src_mtime
in globus_l_guc_src_dst_pair_t and globus_l_guc_transfer_t structures
Here are our results to date, with testing still in progress.
GridFTP TCP and UDT times for 113 GB transfer
from Bio-mirror.net (Indiana USA)
Ping Time(min) TCP/ Distance
Site RTT TCP UDT UDT Km Network Route
--------------------------------------------------------------
NCSA 10 139 138 1 200 Indiana - U of Illinois - NCSA
13.9 13.9 Megabytes/sec
Purdue 17 125 125 1 500 In. - Chicago - Purdue, Indiana
15.3 15.3 Mb/sec
ORNL 25 361 120 3 1200 In. - Chi. - Nashv., Tennesee - ORNL
5.3 15.9 Mb/sec
TACC 37 616 120 5 2000 In. - Chi. - Huston, Texas - TACC
3.1 15.9 Mb/sec
SDSC 65 -- -- - 3300 In. - Chi. - LA, California - SDSC
...
CSTNET 274 -- -- 14 12000 In. - Michigan - Kreonet, Korea - Beijing,
China
0.48 6.67 Mb/sec (from preliminary 3GB test)
--------------------------------------------------------------
Transfer times (minutes), and below speed in Megabytes/second,
for TCP and UDT, and the TCP/UDT ratio.
NCSA, Purdue, ORNL, TACC, SDSC are Teragrid.org sites in USA.
Land/sea line distance is given in Km.
RTT is network distance as average round trip ping time in ms.
TCP and UDT transfers were run simultaneously from each site.
-- d.gilbert--bioinformatics--indiana-u--bloomington-in-47405
-- [email protected] -- http://marmot.bio.indiana.edu/
